Senior Data Engineer
August 29
Description
• Join the revolution in hospitality tech at Liven. • Manage and optimize data infrastructure within Databricks and AWS environments. • Lead the management of our Databricks platform, including cluster setup, Spark job execution, and performance optimization. • Architect and automate ETL/ELT pipelines using best practices in CI/CD. • Oversee the use of AWS services, such as S3, EC2, RDS, Redshift, and Glue. • Implement Lakehouse and Medallion architectures to optimize data workflows. • Establish data governance frameworks and ensure data quality, security, and compliance. • Partner with data science and analytics teams.
Requirements
• 5+ years in data engineering with demonstrated expertise in Databricks (mandatory). • Advanced skills in Python, Scala, SQL, and big data tools like Spark and Kafka. • Strong understanding of CI/CD practices for data pipelines. • Proven experience with Lakehouse and Medallion architectures, supporting machine learning, analytics, and reporting needs. • Skilled in transforming raw data into actionable datasets, with experience using BI tools such as Looker, PowerBI, or Tableau. • Strong leadership skills, with the ability to lead projects from concept to delivery, mentor junior engineers, and collaborate across teams in an agile environment.
Apply NowSimilar Jobs
August 27
Develop and maintain software systems for analyzing medical data to drive healthcare improvements.
August 14
Implement FDR and enhance data systems for finance modernization.
July 27
Build end-to-end data solutions for companies utilizing 5X's core data stack.
July 23
Develop data-driven strategies and implementations for insurance companies.
