Mid Data Lakehouse Engineer

Yesterday

Apply Now

Receive Emails with Similar Jobs

CLARA Analytics

WebsiteLinkedInAll Job Openings

workers'​ compensation • occupational injuries • insurtech • data science • predictive analytics

51 - 200 employees

Founded 2016

🤖 Artificial Intelligence

☁️ SaaS

Description

• Design, implement, and optimize the Data Lakehouse architecture. • Optimize the performance of data pipelines and queries. • Manage the integration of various data sources into the Data Lakehouse. • Collaborate with data engineering, data science, and business teams. • Define and enforce data governance, quality standards, and security policies. • Monitor workflow performance and ensure SLA targets are met. • Automate existing code and processes using scripting, CI/CD, infrastructure-as-code. • Troubleshoot data-related issues and improve overall system performance. • Work with big data tools (Apache Spark, Delta Lake). • Support and maintain the Data Lakehouse environment. • Stay current with trends in big data and cloud technologies.

Requirements

• 5+ years of hands-on experience with Redshift, Snowflake, Google BigQuery, or similar cloud-based data processing and warehousing solutions. • Experience with AWS Lake Formation • 3+ hands-on experience developing ELT/ETL solutions • Proven experience in designing, implementing, and managing Data Lakehouse architectures. • Fluent in at least one programming language required (Python or Java preferred, SQL accepted). • High proficiency in SQL programming with relational databases. • Experience writing complex SQL queries is a must. • Proficient in data modeling techniques and concepts for both structured and unstructured data. • Experience with data pipeline tools (Hive, Spark, Spark SQL) is preferred. • Experience with containerization and orchestration tools (e.g., Docker, Kubernetes). • Knowledge of machine learning workflows and integration with data lakes/lakehouses is a plus. • Strong knowledge of data governance, security, and privacy policies.

Benefits

• Competitive salary and benefits package • The opportunity to make a real impact on a growing company. • Work on challenging and rewarding projects that will push your technical skills. • Collaborative and supportive work environment. • Be a part of a team that is passionate about what we do.