IT Consultancy • Continuous Delivery • Offshore Services • Deployment Automation • Digital Transformation
Yesterday
Airflow
Apache
AWS
Azure
Cloud
Distributed Systems
Docker
ETL
Google Cloud Platform
Kafka
Kubernetes
Python
Spark
SQL
Terraform
Go
IT Consultancy • Continuous Delivery • Offshore Services • Deployment Automation • Digital Transformation
• responsible for at-scale infrastructure design, build and deployment with a focus on distributed systems • building and maintaining architecture patterns for data processing, workflow definitions, and system to system integrations using Big Data and Cloud technologies • evaluating and translating technical design to workable technical solutions/code and technical specifications at par with industry standards • driving creation of re-usable artifacts • establishing scalable, efficient, automated processes for data analysis, data model development, validation, and implementation • working closely with analysts/data scientists to understand impact to the downstream data models • writing efficient and well-organized software to ship products in an iterative, continual release environment • contributing and promoting good software engineering practices across the team • communicating clearly and effectively to technical and non-technical audiences • defining data retention policies • monitoring performance and advising any necessary infrastructure changes
• available to start immediately • readiness to work with the US Timezone (up to 9PM CET) • 5+ years’ experience as a data engineer • 2+ years’ experience with AWS • strong SQL skills • Python scripting proficiency • hands-on experience in building data processing pipelines • experience in structuring and modelling data in both relational and non-relational forms • strong expertise in cloud data platforms/warehouses like Databricks or Snowflake • extensive experience in big data engineering on a terabyte scale, including streaming technologies and near-real-time processing • experience working with VCS like Git • excellent command of oral and written English • ability to work with different stakeholders and drive consensus within the team • good verbal and written communication skills in English
Apply NowYesterday
Join Xebia as a Senior AWS Data Engineer. Focus on building scalable cloud data solutions for global, innovative projects.
Yesterday
Join 3Pillar Global as a Senior Data Engineer, building data ingestion pipelines. Contribute to innovative projects in urban living and healthcare.
December 6
Join Qodea as a Senior Data Engineer. Develop scalable data pipelines for Google Cloud projects.
December 6
Join Qodea as a Principal Data Engineer to consult on data architecture using Google Cloud solutions and deliver innovative projects.
December 5
Join Xebia as a Senior GCP Data Engineer, focusing on deploying cloud-based data solutions.