Azure Databricks Engineer

Job not on LinkedIn

🕒 May 25

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

opinov8

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2017

🤝 B2B

🏢 Enterprise

B2B • Enterprise

opinov8 is a global digital and engineering solutions company specializing in custom software, cloud, and data services. Headquartered in London with development centers and remote teams across Ukraine, Egypt, Colombia, Portugal and the EU, opinov8 partners with businesses worldwide to accelerate digital transformation through custom engineering, cloud migrations, and data-driven solutions. The company operates as a remote-first B2B services provider serving clients across sectors such as finance, healthcare, logistics, and media.

📋 Description

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Databricks and Apache Spark; • Develop and optimize PySpark/Spark SQL notebooks for large-scale data processing; • Implement batch and real-time data ingestion pipelines using Azure Data Factory (ADF), Databricks Workflows, and Structured Streaming; • Manage and optimize Delta Lake/Lakehouse architecture, including Bronze, Silver, and Gold layers; • Integrate data from multiple sources including APIs, databases, cloud storage, and third-party systems; • Work with Azure services such as ADLS Gen2, Azure Synapse Analytics, Azure SQL Database, and Azure DevOps; • Monitor, troubleshoot, and improve pipeline performance, scalability, and cost optimization; • Implement data governance, security, access controls, and compliance standards using Unity Catalog and RBAC; • Collaborate with Data Engineers, Data Scientists, Analysts, and Product teams to deliver reliable data solutions; • Support CI/CD implementation, automation, and infrastructure-as-code practices.

🎯 Requirements

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field • 5+ years of experience in Data Engineering or Big Data development • Strong hands-on experience with Azure Databricks and Apache Spark • Proficiency in PySpark, Spark SQL, and SQL • Experience with Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS) • Knowledge of Delta Lake, Lakehouse architecture, and data modeling concepts • Experience with distributed data processing and performance tuning • Familiarity with CI/CD pipelines, Git, and Azure DevOps. • NICE TO HAVE: Experience with Kafka, dbt, Airflow, or Snowflake. Knowledge of Terraform or Infrastructure as Code (IaC). Exposure to MLflow, machine learning pipelines, or MLOps.

🏖️ Benefits

• Digital-First Approach: Great talent knows no borders! You can work from wherever you are — we hire and collaborate with professionals worldwide. • Remote Work Model: Balance your professional and personal life with our flexible working conditions, empowering you to deliver your best from anywhere. • Exciting Projects: Dive into impactful projects across industries that challenge and spark creativity. • Boost Your Expertise: Grow your career with continuous learning, development opportunities, and hands-on experience. • Join the Best Team Ever: Collaborate with our diverse and cross-cultural team of passionate technologists and creative thinkers.