Senior Data Engineer

9 hours ago

Apply Now

Receive Emails with Similar Jobs

dss+

WebsiteLinkedInAll Job Openings

Solutions for the Environment • Solutions for Reliability/Productivity • Solutions for Safety • Training Solutions • Operational Risk Management

1001 - 5000 employees

📋 Compliance

🏢 Enterprise

Description

• Design and implement scalable, efficient data pipelines and workflows using Azure Databricks and associated Azure tools. • Build and manage cloud-based data environments, ensuring high availability, security, and performance. • Partner with data scientists, analysts, and stakeholders to ensure data solutions align with business goals. • Monitor, troubleshoot, and optimize data pipelines for speed, reliability, and scalability. • Implement data governance frameworks, ensuring compliance with security, privacy, and industry regulations.

Requirements

• Expertise in Azure Databricks: Proven experience in designing, implementing, and optimizing solutions on the Azure Databricks platform. • Programming Skills: Advanced knowledge of SQL, Python, PySpark or Scala for data engineering tasks. • Big Data Frameworks: Experience with Apache Spark, Delta Lake, and similar technologies. • Problem-Solving Ability: Demonstrated skill in debugging and resolving performance bottlenecks in data systems. • Collaboration and Communication: Ability to work effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders. • Agile Practices: Experience working in agile environments with iterative delivery and continuous improvement methodologies.