Senior Data Engineer

Yesterday

Apply Now

Receive Emails with Similar Jobs

Zealogics Inc

WebsiteLinkedInAll Job Openings

IT consulting • Systems Implementation • IT & Engineering Staffing • Mechanical Engineering • Electronics Engineering

501 - 1000 employees

🏢 Enterprise

☁️ SaaS

🤖 Artificial Intelligence

Description

• Able to participate in business discussions and assist gathering data requirements • Good analytical and problem-solving skills to help address data challenges • Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the data • Expertise in optimizing data workflows and predictive modeling • Designing and implementing data pipelines using Databricks, Spark • Expertise in batch and streaming data solutions, automating workflows with CI/CD tools like Jenkins and Azure DevOps, and ensuring data governance with Delta Lake

Requirements

• 7+ years of overall experience • More than 5+ years of expertise in Azure technologies with Certification is mandatory • Proficiency in writing complex SQL queries for data extraction, transformation, and analysis • Knowledge of SQL functions, joins, subqueries, and performance tuning • Hands on experience with PySQL/Pyspark • Hands on Experience in creating and managing data pipelines using Azure Data Factory • Understanding of data integration, transformation, and workflow orchestration in Azure environments • Knowledge of data engineering workflows and best practices in Databricks • Hands on experience with Unity Catalog and Databricks workflow • Proficiency in using Git for version control and collaboration in data projects • Ability to work effectively in a team environment, especially in agile or collaborative settings • Clear and effective communication skills to articulate findings and recommendations for other team members • Ability to document processes, workflows, and data analysis results effectively • Willingness to learn new tools, technologies, and techniques as the field of data analytics evolves • Being adaptable to changing project requirements and priorities