GCP Data Engineer - Airflow

January 25

Apply Now

Receive Emails with Similar Jobs

Xebia

WebsiteLinkedInAll Job Openings

Xebia is a leading Software Engineering and IT consultancy company that specializes in digital transformation, agile transformation, cloud solutions, data and AI, DevOps, SRE, and other IT services. It helps businesses across various industries to harness new technologies for sustainable growth and improved efficiency. With a global presence, Xebia partners with companies to provide high-quality consulting, training, and managed services. Known for being at the forefront of technological innovation, Xebia is recognized for its deep collaboration with platforms like GitHub and is committed to making AI integration in software development easier and more accessible. The company serves a wide range of sectors including finance, technology, healthcare, and manufacturing, aiming to create digital leaders and empower organizations to achieve their strategic goals through cutting-edge technology and people-centric approaches.

IT Consultancy • Continuous Delivery • Offshore Services • Deployment Automation • Digital Transformation

5001 - 10000 employees

🏢 Enterprise

🤖 Artificial Intelligence

☁️ SaaS

📋 Description

• As a Data Engineer at Xebia, you will work closely with engineering, product, and data teams to deliver our clients scalable and robust data solutions. • Your key responsibilities will include designing, building, and maintaining data platforms and pipelines and mentoring new engineers. • You will be developing and maintaining data pipelines to ensure seamless data flow from the Loyalty system to the data lake and data warehouse, ensuring data integrity, consistency, and availability across all data systems. • integrating data from various sources, including transactional databases, third-party APIs, and external data sources, into the data lake. • implementing ETL processes to transform and load data into the data warehouse for analytics and reporting. • working closely with cross-functional teams including Engineering, Business Analytics, Data Science and Product Management to understand data requirements and deliver solutions. • collaborating with data engineers to ensure data engineering best practices are integrated into the development process. • optimizing data storage and retrieval to improve performance and scalability. • monitoring and troubleshooting data pipelines to ensure high reliability and efficiency. • implementing and enforcing data governance policies to ensure data security, privacy, and compliance. • developing documentation and standards for data processes and procedures.

🎯 Requirements

• 5+ years in a data engineering role, with hands-on experience in building data processing pipelines • proficiency with GCP services, for large-scale data processing and optimization • extensive experience with Apache Airflow, including DAG creation, triggers, and workflow optimization • knowledge of data partitioning, batch configuration, and performance tuning for terabyte-scale processing • strong Python proficiency, with expertise in modern data libraries and frameworks (e.g., Databricks, Snowflake, Spark, SQL) • hands-on experience with ETL tools and processes • deep understanding of relational and NoSQL databases, data modelling, and data warehousing concepts • excellent command of oral and written English • Bachelor's or Master’s degree in Computer Science, Information Systems, or a related field • Work from the European Union region and a work permit are required. • Nice to have: experience with ecommerce systems and their data integration • knowledge of data visualization tools (e.g., Tableau, Looker) • understanding of machine learning and data analytics • certification in cloud platforms (AWS Certified Data Analytics, Google Professional Data Engineer, etc.)