Principal Data Engineer

November 23

Apply Now
Logo of Seamless.AI

Seamless.AI

Artificial Intelligence β€’ Machine Learning β€’ Natural Language Processing β€’ Neuro-Linguistic Programming β€’ Data Science

201 - 500

Description

β€’ Design, develop, and maintain robust and scalable ETL pipelines to acquire, transform, and load data from various sources into our data ecosystem. β€’ Collaborate with cross-functional teams to understand data requirements and develop efficient data acquisition and integration strategies. β€’ Implement data transformation logic using Python and other relevant programming languages and frameworks. β€’ Utilize AWS Glue or similar tools to create and manage ETL jobs, workflows, and data catalogs. β€’ Optimize and tune ETL processes for improved performance and scalability, particularly with large data sets. β€’ Apply methodologies and techniques for data matching, deduplication, and aggregation to ensure data accuracy and quality. β€’ Implement and maintain data governance practices to ensure compliance, data security, and privacy. β€’ Collaborate with the data engineering team to explore and adopt new technologies and tools that enhance the efficiency and effectiveness of data processing.

Requirements

β€’ Bachelor's degree in Computer Science, Information Systems, related fields or equivalent years of work experience. β€’ 7+ years of experience as a Data Engineer, with a focus on ETL processes and data integration. β€’ Professional experience with Spark and AWS pipeline development required.

Apply Now

Similar Jobs

November 23

Join Marsh McLennan as a Data Architect Manager, leading data strategies and solutions. Provide thought leadership, oversee integration, and enhance data reliability.

November 20

As a Principal Consultant, deliver SAP Data Management for digital transformation at Argano. Guide clients in their data transformation journeys, ensuring alignment with business objectives.

November 18

Yottaa

51 - 200

Join Yottaa as a Big Data Architect. Drive data architecture and manage complex solutions for website performance and security.

November 15

Autodesk seeks a Data Architect to design data models and system flows. Collaborate with teams to ensure fit-for-purpose data across enterprise systems.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or lior@remoterocketship.com