Technical Lead - Data Engineering

December 12

Apply Now

Receive Emails with Similar Jobs

Bombora

WebsiteLinkedInAll Job Openings

B2B • Programmatic • Data Solutions • Big Data • Intent data

201 - 500 employees

Founded 2014

🤝 B2B

☁️ SaaS

💰 Debt Financing on 2021-04

Description

• Develop and maintain scalable, high-performance ETL and data processing pipelines using Python, Airflow (Composer), and Dataflow. • Provide architectural oversight across engineering teams to ensure that the cloud-native distributed data processing systems are optimized for dynamic scaling, high availability, and parallel execution, leveraging Kubernetes and operational tools to ensure reliability and observability in production. • Design databases, optimize SQL queries, and implement efficient data processing patterns. • Work heavily within GCP (Google Cloud Platform) utilizing services including Composer, BigQuery, Pub/Sub, Dataflow, Kubernetes, and GCS. • Proactively troubleshoot and resolve complex production issues, ensuring system reliability and performance. • Mentor and support team members by sharing technical expertise, providing guidance, and fostering skill development. • Drive engineering excellence by championing code reviews, maintaining coding standards, and implementing best practices. • Stay ahead of emerging technologies and trends, advocating for their adoption where they add value.

Requirements

• 10+ years of commercial software development experience in Python. • 10+ years of SQL experience (BigQuery preferred), including deep knowledge of database design and query optimization. • 5+ years of experience developing systems to process large volumes of data (tens of billions of records), ideally DAGs in Airflow/Composer. • 2+ years of experience in a technical leadership role. • Deep understanding of distributed, parallel data processing techniques and platforms. • Experience mapping business requirements to appropriate technical solutions. • Excellent communication and collaboration skills, with a passion for mentoring and team growth. • Bachelor’s degree in Software Engineering, Data Science, a related field, or equivalent experience. • Ad-tech experience in digital marketing, particularly Audience Delivery and Taxonomy • Experience with data integrations with LiveRamp, TheTradeDesk, OpenX or other ad networks.

Benefits

• Health / Dental / Vision • Flexible Spending / Health Spending Accounts • Flexible Vacation / Paid Holidays / Summer Fridays • Education / Tuition Assistance / Annual Learning Stipend • 401K / Matching • Generous Parental Leave (16 weeks primary/12 secondary) • Commuter Benefits • On Demand Learning (Udemy) • Team Lunches / Outings / Events (Yes! We found a way to do virtually!)