Lead Senior Data Engineer

April 12

Apply Now

Receive Emails with Similar Jobs

Cars Commerce

WebsiteLinkedInAll Job Openings

Cars Commerce is a comprehensive online platform that facilitates the buying, selling, and research of vehicles. It provides a wide range of listings for new and used cars, along with tools and resources for customers to compare different makes and models, read reviews, and obtain financing options. With a focus on enhancing the car shopping experience, Cars Commerce connects sellers with local dealers and offers estimates for vehicle sales, ensuring a streamlined process for prospective buyers and sellers alike.

Mobile Marketing • Content Marketing • Data and Analytics

1001 - 5000 employees

🛍️ eCommerce

🏪 Marketplace

📋 Description

• Build data pipelines and deriving insights out of the data using advanced analytic techniques, streaming and machine learning at scale • Work within a dynamic, forward thinking team environment where you will design, develop, and maintain mission-critical, highly visible Big Data and Machine Learning applications • Build, deploy and support data pipelines and ML models into production. • Work in close partnership with other Engineering teams, including Data Science, & cross-functional teams, such as Product Management & Product Design • Opportunity to mentor others on the team and share your knowledge across the Cars.com organization • Lead a team and communicate with the management, stakeholders about project status

🎯 Requirements

• Ability to develop Spark jobs to cleanse/enrich/process large amounts of data. • Ability to develop jobs to read from various source systems such as kafka, databases,API's,files etc. • Experience with tuning Spark jobs for efficient performance including execution time of the job, execution memory, etc. • Sound understanding of various file formats and compression techniques. • Experience with source code management systems such as Github and developing CI/CD pipelines with tools such as Jenkins for data. • Ability to understand deeply the entire architecture for a major part of the business and be able to articulate the scaling and reliability limits of that area; design, develop and debug at an enterprise level and design and estimate at a cross-project level. • Ability to mentor developers and lead projects of medium to high complexity. • Excellent communication and collaboration skills. • Bachelor's degree in Computer Science, related degree, or equivalent practical experience • Data Engineering | 7+ years of designing & developing data pipelines or real-time applications at enterprise scale; specifically Python and/or Scala. • Big Data Ecosystem | 7+ years of hands-on experience with tools and platforms like Spark Streaming, EMR, Kafka. • Cloud | 7+ years of experience in developing Big Data applications in the cloud, preferably AWS. • 4+ years of designing or architecting (design patterns, reliability, and scaling) of new and existing systems experience • 2+ years experience leading data platform projects including engineering mentorship

🏖️ Benefits

• Medical, Dental & Vision Healthcare Plans • New Hire Stipend for Home Office Set-Up • Generous PTO • Refuel - a service based recognition program where employees receive additional paid time away to learn grow and reset • Paid Holidays, Floating Holiday, Volunteer Day, Recharge Day