Senior Data Ingestion Engineer
November 15
Description
• Lead the Enterprise Data Platform Ingestion team. • Ingest data from a variety of source systems. • Manage, maintain, and oversee ETL/ELT pipelines on Databricks. • Document ingestion and integration flows and pipelines. • Use Airflow to schedule and automate ingestion jobs. • Ensure ELT/ETL design meets security and compliance guidelines. • Maintain ETL/ELT pipeline infrastructure and implement monitoring strategies.
Requirements
• 10+ years of experience in Data Engineering, ingestion pipelining, and ETL/ELT • Bachelor’s degree in computer science, engineering, statistics, or related field • Hands-on experience with Spark/Scala, SQL/SparkSQL, Python/PySpark • Knowledge on Kong-API and Kinesis is a plus • Experience with Databricks, AWS Unity Catalog • ETL/ELT development using Apache Airflow • Familiarity with data quality guidelines, CI/CD pipelines, Agile, Git, and version control
Benefits
• Bonus Program • Pension and Retirement Plans • Medical, Dental and Vision Coverage • Paid Time Off • Paid Parental Leave • Support for Community Involvement
Apply NowSimilar Jobs
November 12
Lead instrumentation and controls projects for mining and energy sectors.