Senior Data Engineer

7 hours ago

Apply Now

Receive Emails with Similar Jobs

Zealogics Inc

WebsiteLinkedInAll Job Openings

IT consulting • Systems Implementation • IT & Engineering Staffing • Mechanical Engineering • Electronics Engineering

501 - 1000

Description

• Participate in business discussions and assist gathering data requirements • Good analytical and problem-solving skills • Proficiency in writing complex SQL queries • Knowledge of SQL functions, joins, subqueries, and performance tuning • Hands on experience with PySQL/Pyspark etc. • Hands on Experience in creating and managing data pipelines using Azure Data Factory • Understanding of data integration, transformation, and workflow orchestration • Knowledge of data engineering workflows and best practices in Databricks • Understanding existing templates and patterns for development • Hands on experience with Unity Catalog and Databricks workflow • Proficiency in using Git for version control • Ability to work effectively in a team environment • Clear and effective communication skills • Ability to document processes and workflows • Willingness to learn new tools and technologies • Adaptable to changing project requirements

Requirements

• 6+ years of overall experience • More than 5 years of expertise in Azure technologies • Expertise in optimizing data workflows and predictive modeling • Designing and implementing data pipelines using Databricks, Spark • Expertise in batch and streaming data solutions • Automating workflows with CI/CD tools like Jenkins and Azure DevOps • Ensuring data governance with Delta Lake, Spark, PySpark, Azure DevOps, Python