Mid Data Lakehouse Engineer

December 11, 2024

Apply Now

Receive Emails with Similar Jobs

CLARA Analytics

WebsiteLinkedInAll Job Openings

CLARA Analytics is a leading provider of AI-driven technology solutions for casualty claims management. Its platform, CLARAty. ai, offers tools such as Document Intelligence, Triage, Treatment, and Fraud detection, designed to optimize the claims process for insurance carriers, MGAs/MGUs, reinsurers, and self-insured organizations. By leveraging artificial intelligence and machine learning, CLARA Analytics helps reduce loss costs, improve operational efficiency, and detect fraudulent claims in real-time. Its solutions are used widely within the workers' compensation, auto liability, and general liability sectors, providing actionable insights and industry benchmarking to enhance claims management outcomes.

workers'​ compensation • occupational injuries • insurtech • data science • predictive analytics

51 - 200 employees

Founded 2016

🤖 Artificial Intelligence

☁️ SaaS

📋 Description

• Design, implement, and optimize the Data Lakehouse architecture. • Optimize the performance of data pipelines and queries. • Manage the integration of various data sources into the Data Lakehouse. • Collaborate with data engineering, data science, and business teams. • Define and enforce data governance, quality standards, and security policies. • Monitor workflow performance and ensure SLA targets are met. • Automate existing code and processes using scripting, CI/CD, infrastructure-as-code. • Troubleshoot data-related issues and improve overall system performance. • Work with big data tools (Apache Spark, Delta Lake). • Support and maintain the Data Lakehouse environment. • Stay current with trends in big data and cloud technologies.

🎯 Requirements

• 5+ years of hands-on experience with Redshift, Snowflake, Google BigQuery, or similar cloud-based data processing and warehousing solutions. • Experience with AWS Lake Formation • 3+ hands-on experience developing ELT/ETL solutions • Proven experience in designing, implementing, and managing Data Lakehouse architectures. • Fluent in at least one programming language required (Python or Java preferred, SQL accepted). • High proficiency in SQL programming with relational databases. • Experience writing complex SQL queries is a must. • Proficient in data modeling techniques and concepts for both structured and unstructured data. • Experience with data pipeline tools (Hive, Spark, Spark SQL) is preferred. • Experience with containerization and orchestration tools (e.g., Docker, Kubernetes). • Knowledge of machine learning workflows and integration with data lakes/lakehouses is a plus. • Strong knowledge of data governance, security, and privacy policies.

🏖️ Benefits

• Competitive salary and benefits package • The opportunity to make a real impact on a growing company. • Work on challenging and rewarding projects that will push your technical skills. • Collaborative and supportive work environment. • Be a part of a team that is passionate about what we do.