Senior Azure Data Engineer - Aviation Industry
December 5
Description
• Responsible for at-scale infrastructure design, build and deployment with a focus on distributed systems • Building and maintaining architecture patterns for data processing, workflow definitions, and system to system integrations using Big Data and Cloud technologies • Evaluating and translating technical design to workable technical solutions/code and technical specifications at par with industry standards • Driving creation of re-usable artifacts • Establishing scalable, efficient, automated processes for data analysis, data model development, validation, and implementation • Working closely with analysts/data scientists to understand impact to the downstream data models • Writing efficient and well-organized software to ship products in an iterative, continual release environment • Contributing and promoting good software engineering practices across the team • Communicating clearly and effectively to technical and non-technical audiences • Defining data retention policies • Monitoring performance and advising any necessary infrastructure changes
Requirements
• 3+ years’ experience with Azure Data Factory and Databricks • 5+ years’ experience with data engineering or backend/fullstack software development • Strong SQL skills • Python scripting proficiency • Experience with data transformation tools - Databricks and Spark • Experience in structuring and modelling data in both relational and non-relational forms • Experience with CI/CD tooling • Working knowledge of Git • Good verbal and written communication skills in English • Work from the European Union region and a work permit are required • Nice to have: experience with Azure Event Hubs, CosmosDB, Spark Streaming, familiarity with data visualization tools (PowerBI, Tableau etc.), experience in Aviation Industry and Copilot
Apply NowSimilar Jobs
November 19
As a Senior Data Engineer, design and maintain Oracle PBCS database infrastructure and ensure data quality.
October 1
Develop solutions for a proprietary marketplace product in digital transformation.
September 25
Emergn
501 - 1000
Senior Data Engineer at Emergn, improving digital products and experiences.