Senior Data Engineer - Tech Lead

7 hours ago

Apply Now

Receive Emails with Similar Jobs

Zealogics Inc

WebsiteLinkedInAll Job Openings

IT consulting • Systems Implementation • IT & Engineering Staffing • Mechanical Engineering • Electronics Engineering

501 - 1000

Description

• Able to participate in business discussions and assist gathering data requirements • Good analytical and problem-solving skills to help address data challenges by leading a team • Proficiency in writing complex SQL queries for data extraction, transformation, and analysis • Knowledge of SQL functions, joins, subqueries, and performance tuning • Able to navigate source systems with minimal guidance to understand how data is related • Hands on experience with PySQL/Pyspark etc. • Hands on Experience in creating and managing data pipelines using Azure Data Factory • Understanding of data integration, transformation, and workflow orchestration in Azure environments • Knowledge of data engineering workflows and best practices in Databricks • Clear and effective communication skills to articulate findings and recommendations • Ability to document processes, workflows, and data analysis results effectively • Willingness to learn new tools, technologies, and techniques

Requirements

• 9+ years of overall experience with more than 5 years of expertise in Azure technologies • Ability to envision/lead E2E solution and solve technical issue during offshore • Expertise in optimizing data workflows and predictive modeling • Designing and implementing data pipelines using Databricks, Spark • Expertise in batch and streaming data solutions • Automating workflows with CI/CD tools like Jenkins and Azure DevOps • Ensuring data governance with Delta Lake Spark, PySpark, Delta Lake, Azure DevOps, Python