Associate Data Engineer - Azure
September 15
Description
• As an Azure Data engineer with 3+ years IT experience you would be responsible for implementation of Azure native data solutions to support business use cases. • This role will be responsible for developing, optimizing, and standardizing data pipelines. • You will need a blend of superb problem-solving and innovation skills to resolve a wide variety of technical challenges. • You will need to showcase good understanding of database, ETL and cloud concepts. • Develop, and successfully operationalize complex scale data management projects. • Design and develop optimized SQL/PLSQL, PySpark and SparkSQL and shell scripting. • Implement data processing/data movement solutions using Azure services like ADLS, Azure synapse analytics/ADF, Azure SQL DB, Azure EventGrid, Azure Logic apps, Azure Functions, Azure Analysis Service, Databricks etc. • Design and code reusable components and functions. • Design job orchestration (Synapse/ADF Pipelines), change data capture pipelines (preferably using Kafka Connect), metadata design, audit trail, dynamic parameter passing, and error/exception handling. • Design and Implement CICD pipelines using Azure Devops • Write and execute test plans, test cases, and testing ELT/ETL code and data model integrity. • Understanding customer requirements and implementing optimized solutions • Re-engineer and enhance existing code.
Requirements
• Overall, 3+ years of experience, with 2+ years of experience in cloud data engineering roles - with a focus on Azure cloud data migration experience. • Must have had enterprise-scale technical experience with cloud and hybrid infrastructures, migrations, and technology management. • Must have database experience in Azure Cloud Platform • Must have at least 2+ years implementation experience in Python, PySpark and Spark scripting. • Good to have Azure AZ-900 (Azure Fundamentals) and/or Azure DP-203 (Azure Data Engineering - Associate) Certification • Experience in DevOps principles and CI/CD tools such as Azure DevOps/Jenkins/Git • Strong analytical and debugging skills to quickly respond to issues. • Good communication and articulation skills
Benefits
• Competitive Compensation & Total Rewards Incentives • Attractive Mediclaim Coverage • Annual Leave of up to 25 days • 12 Sick Leaves • 12 Casual Leaves • Additional leaves for marriage, child-birth, adoption, bereavement • 11 Holidays for all employees • Utility Allowance to cover for Internet and Phone expenses • Employment Assistance Program • Gratuity eligibility • Business Travel Accident Insurance • Active employee engagement activities • Access to LinkedIn Learning in addition to ongoing Genworth Training calendar
Apply Now