Azure Data Engineer

September 17

Apply Now

Receive Emails with Similar Jobs

ProArch

WebsiteLinkedInAll Job Openings

Machine Learning • Digital IT Strategy • Big Data • Microsoft Solutions • Agile Transformation

201 - 500

Description

• Design, develop, and implement data engineering solutions on the Azure platform • Create and maintain data pipelines and ETL processes • Optimize data storage and retrieval for performance and scalability • Collaborate with data scientists and analysts to build data models and enable data-driven insights • Ensure data quality and integrity through data validation and cleansing • Monitor and troubleshoot data pipelines and resolve any issues • Stay up-to-date with the latest Azure data engineering best practices and technologies

Requirements

• Excellent communication skills • Strong experience in Python/Pyspark • The ability to understand businesses concepts and work with customers to process data accurately. • A solid of understanding Azure Data Lake, Spark for Synapse (or Azure Databricks), Synapse Pipelines (or Azure Data Factory), Mapping Data Flows, SQL Server, Synapse Serverless/Pools (or SQL Data Warehouse). • Experience with source control, version control and moving data artifacts from Dev to Test to Prod. • A proactive self-starter, who likes deliver value, solves challenges and make progress. • Comfortable working in a team or as an individual contributor • Good data modelling skills (e.g., relationships, entities, facts, and dimensions)