Data Engineer - Apache Spark

2 hours ago

Apply Now

Receive Emails with Similar Jobs

Sunscrapers

WebsiteLinkedInAll Job Openings

Web apps • Mobile apps • Websites • IT outsourcing • Staff Augmentation

11 - 50

Description

Are you ready to take the challenge? • We’re looking for a Data Engineer to join our team in Warsaw or remotely. • Advance your career with Sunscrapers, a leading force in software development, now expanding its presence in a data-centric environment. • Join us in our mission to help clients grow and innovate through a comprehensive tech stack and robust data-related projects. • Enjoy a competitive compensation package that reflects your skills and expertise while working in a company that values ambition, technical excellence, trust-based partnerships, and actively supports contributions to R&D initiatives. • As a Data Engineer you’ll play a pivotal role in building a robust data platform that drives engagement solutions for leading healthcare brands. • Your work will directly support the development of omnichannel digital health experiences, empowering consumers to access the programs, benefits, and care they need. • In this role, you’ll leverage cutting-edge technologies such as Apache Spark, Databricks, and Delta Tables to design and implement scalable data solutions. • You’ll enable actionable insights by integrating diverse data sources, building efficient pipelines, and supporting data-driven decision-making. • Your responsibilities will include: • Design and manage batch data pipelines, including file ingestion, transformation (e.g., CSV to structured formats), and Delta Lake/table management, • Implement scalable architectures for batch and streaming workflows, • Leverage Microsoft equivalents of BigQuery for efficient querying and data storage.

Requirements

What's important for us? • At least 3 years of professional experience as a data engineer, • Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar, • Excellent command in spoken and written English, at least C1, • Strong professional experience with Apache Spark, • Hands on experience on managing production spark clusters either in Databricks, • Experience in CI/CD of data jobs in spark, • Great analytical skills and attention to detail - asking questions and proactively searching for answers, • Creative problem-solving skills, • Great customer service and troubleshooting skills. You'll score extra points for: • Experience with BigQuery, • Experience in managing data governance in the healthcare space.

Benefits

What do we offer? • Working alongside a talented team that’s changing the image of Poland abroad. • Flexible working hours and remote work possibility. • Comfortable office in a penthouse in central Warsaw equipped with all the necessary tools to conquer the universe (Macbook, external screen, ergonomic chairs). • Fully equipped kitchen with fruit, hot and cold drinks. • Multisport card & Private medical care. • Culture of good feedback: evaluation meetings, mentoring. • We value and appreciate our engineers eagerness to learn and improve so we strongly encourage and support their growth!