Big Data Engineer

March 20

Apply Now

Receive Emails with Similar Jobs

H1

WebsiteLinkedInAll Job Openings

H1 is a global healthcare intelligence company that connects life sciences, payors, providers, and patients to AI-enabled data analytics and groundbreaking research to advance medicine. It provides enterprise solutions like HCP Universe, Trial Landscape, and Precise, helping healthcare professionals to access accurate and comprehensive data for clinical trials, scientific research, and medical affairs. H1 empowers medical missions and humanitarian work through H1 Connect and enhances diversity and inclusion in clinical trials by providing insights to improve patient diversity and site performance. The company plays a key role in enabling access to healthcare information and evidence-based medicine globally.

healthcare • provider data • healthcare professional information • diversity data • medical affairs

201 - 500 employees

⚕️ Healthcare Insurance

🤖 Artificial Intelligence

🧬 Biotechnology

📋 Description

• At H1, we believe access to the best healthcare information is a basic human right. Our mission is to provide a platform that can optimally inform every doctor interaction globally. This promotes health equity and builds needed trust in healthcare systems. To accomplish this our teams harness the power of data and AI-technology to unlock groundbreaking medical insights and convert those insights into action that result in optimal patient outcomes and accelerates an equitable and inclusive drug development lifecycle. Visit h1.co to learn more about us. • Data Engineering is responsible for the development and delivery of our most important asset - our data. Looking across thousands of data sources from across the globe, the data engineering team is responsible for making sense out of that data to create the world’s most extensive and comprehensive knowledge base of healthcare stakeholders and the ecosystem they influence. It is our job to ensure that only accurate, normalized data flows through to our customers, and at a velocity that keeps up with the changes in the real world. • As a Data Engineer on the H1DN Team, you will play a key role in building scalable data pipelines and enrichment workflows that transform raw client data into accurate, actionable insights. With minimal guidance, you will focus on data ingestion and enrichment, ensuring seamless integration of client data from diverse sources (CSV, Parquet, JSON, APIs) while tackling challenges related to scalability, data quality, and standardization. • You will: - Develop and enhance processes to enrich raw or partially processed data using established business logic, ensuring it is accurate and ready for product use. - Build and maintain scalable and reliable data pipelines that support the team’s enrichment workflows. - Integrate enriched data from core platforms (e.g., CT platform) into broader data systems, applying necessary transformations and aligning with business requirements. - Contribute to code reviews, holding a high bar for quality and aligning with organizational engineering guidelines. - Follow development workflows, including coding, testing, deployment, and monitoring, to ensure quality and efficiency. - Work collaboratively with team members and escalate issues appropriately when challenges arise. - Contribute to the understanding and execution of tasks with a strong focus on accuracy, scalability, and performance.

🎯 Requirements

• 3+ years of experience in data engineering, specializing in building scalable data pipelines and enrichment processes, with a track record of working with large datasets, including ingestion, transformation, and optimization • Proficiency in Spark, Python, and SQL for building scalable data processing pipelines • Hands-on experience with Kubernetes for container orchestration and deployment • Strong background in AWS, including services such as S3, Lambda, ECS, and RDS for data infrastructure • Experience with EMR and Databricks to optimize large-scale data workflows • Has an understanding of LLM usage in production

🏖️ Benefits

• Full suite of health insurance options, in addition to generous paid time off • Pre-planned company-wide wellness holidays • Retirement options • Health & charitable donation stipends • Impactful Business Resource Groups • Flexible work hours & the opportunity to work from anywhere • The opportunity to work with leading biotech and life sciences companies in an innovative industry with a mission to improve healthcare around the globe