Senior Data Engineer

March 10

Apply Now

Receive Emails with Similar Jobs

SearchLabs

WebsiteLinkedInAll Job Openings

SearchLabs is a recruitment firm that specializes in connecting talented individuals with great companies, focusing especially on the Design, Construction, and Information Technology sectors. Founded in 2010, SearchLabs employs a custom approach to hiring, emphasizing speed and precision to meet the specific needs of both clients and candidates. Their mission is to simplify the hiring process and enhance the experience for all parties involved, with a proven five-step recruitment process designed to align talent with organizational goals.

Recruitment • Construction • Tech • Engineering

11 - 50 employees

👥 HR Tech

🎯 Recruitment

🤝 B2B

📋 Description

• Job Title: Senior Data Engineer (Azure Databricks & ADLS) • Location: Remote • Contract Duration: May – End of the Year • Overview: Design, build, and maintain scalable and efficient data pipelines on Azure Databricks and ADLS. • Requires expertise in Azure Data Factory (ADF), PySpark, Databricks Auto Loader, Delta Lake, and Change Data Capture (CDC). • Strong Azure SQL skills, data governance expertise, and mentoring ability are essential. • Key responsibilities include pipeline development, data ingestion & transformation, monitoring & performance tuning, collaboration, and continuous improvement.

🎯 Requirements

• 5+ years of experience in data engineering, with a strong background in Azure cloud technologies. • Expertise in Azure Databricks, ADLS, ADF, PySpark, Databricks Auto Loader, and Delta Lake. • Strong experience in real-time and batch data processing, including CDC implementation. • Proficiency in Azure SQL, including query optimization, indexing, and partitioning. • Solid understanding of data governance, security best practices, and compliance requirements. • Experience with CI/CD pipelines and automation for data workflows. • Ability to troubleshoot and optimize complex data pipelines for performance and efficiency. • Strong problem-solving skills, attention to detail, and ability to work independently. • Excellent communication and collaboration skills, with experience mentoring junior engineers. • Nice to Have: Experience with streaming technologies such as Azure Event Hubs or Kafka. • Familiarity with machine learning data pipelines and MLOps. • Knowledge of Terraform or Infrastructure as Code (IaC) for Azure resources.