4 days ago
Airflow
Amazon Redshift
AWS
Azure
Cloud
ETL
Google Cloud Platform
Java
Kafka
Kotlin
NoSQL
Python
Scala
Spark
SQL
Tableau
Unity
Unix
Go
• We are creating the future of sports, driven by powerful data products and platforms that serve our Athletes and Teammates. • As a Senior Data Engineer, you will build datasets and make them accessible to our partner teams. • Your work will enable product teams, data scientists, and decision-makers across the company to bring together insights and inform our business. • You will be responsible for troubleshooting and job monitoring. • You will design and support the business’s database and table schemas for new and existing data sources for the data warehouse. • You will work closely with analysts, data scientists, and other data consumers to gather and deliver high quality data.
• 5 + years of experience in Data Warehousing and development using data technologies such as Relational & NoSQL databases, open data formats, building data pipelines (ETL and ELT) with batch or streaming ingestion, loading and transforming data. • Expert in SQL and/or SQL based languages and performance tuning of SQL queries • Strong understanding of Normalized/Dimensional model disciplines and similar data warehousing techniques. • Experience in one or more of the programming languages are required: Python (Preferred), Scala, C++, or Java, Go, Kotlin. • Strong experience working with ETL/ELT concepts of data integration, consolidation, enrichment, and aggregation in petabyte scale data sets. • Experience with at least one of the following cloud platforms: Microsoft Azure (Preferred), Amazon Web Services (AWS), or Google Cloud Platform (GCP) • Strong Experience with cloud-based data warehouses – e.g., Snowflake, Big Query, Synapse, RedShift, etc. • Experience with message queuing, stream processing (Kafka, Flink, Spark Streams) • Strong Grasp of data management principles: Data Lake, Data Mesh, Data Catalog, Master Data, Data Quality, etc. • Experience in BI tooling such as Qlik, MicroStrategy, Tableau, PowerBI or Looker • Experience with orchestration tools (Control-M, Airflow etc.) • Strong communication skills across different mediums to craft compelling messages to drive action and alignment. • Comfort with agile delivery methodologies in a fast-paced complex environment – Scrum, SAFe , utilizing tools such as Jira, Confluence, and GitHub • Ideal candidates will have experience working with one of the following industries: Retail, Supply Chain, Logistics, Manufacturing or Marketing • Proficient in Linux/Unix environments
Apply Now5 days ago
10,000+ employees
Allstate seeks a Sr PA Data Engineer to manage human capital data infrastructure for analytics.
🇺🇸 United States – Remote
💵 $69.2k - $123.8k / year
💰 Post-IPO Equity on 2014-01
⏰ Full Time
🟠 Senior
🚰 Data Engineer
🦅 H1B Visa Sponsor
5 days ago
10,000+ employees
Senior Data Engineer role focusing on full-stack data engineering and machine learning at Allstate subsidiary Arity.
🇺🇸 United States – Remote
💵 $85.6k - $152.7k / year
💰 Post-IPO Equity on 2014-01
⏰ Full Time
🟠 Senior
🚰 Data Engineer
🦅 H1B Visa Sponsor
December 24, 2024
S&P Global seeks a Senior Quant Data Engineer to develop quantitative products. Join the Research Signals team to build data platforms and ensure data integrity.
December 24, 2024
S&P Global seeks a Senior Quant Data Engineer to develop quantitative products and datasets, collaborating with various teams.
December 22, 2024
Join 540 to create data transformations for the U.S. Army. Work remote while solving architectural challenges.