Manager - Lead Data Engineer

May 23, 2023

Apply Now

Receive Emails with Similar Jobs

Badal.io

WebsiteLinkedInAll Job Openings

GCP • DevOps • Data • ML • DevSecOps

11 - 50

Description

• Manage a team who works closely with backend engineers, product managers, and analysts• Provide leadership and contribute to the definition, development, integration, test, documentation, and support across multiple platforms• Serve as a process expert and provide architectural leadership to Jr engineers as needed• Work closely with technical leads and client teams to fully demonstrate the benefits of GCP technology• Introduce clients to data architecture and analytics best practices• Solve some of the most challenging, high-scale data, and IoT problems (banking, telco, energy, retail, etc.).• Write high-quality and testable batch and real-time data pipelines• Work with Data Scientists to design pipelines that improve their productivity and enable them to implement their ideas• Support clients in troubleshooting issues in their test and/or production environments and identifying root causes and solutions

Requirements

• Mentoring and helping the team build technical capability• Ability to effectively communicate data insights and negotiate options at senior management levels• Experience in leading significant project steps and communicating progress/approach with technical/non-technical peers/clients and leaders• GCP experience ( for junior candidates, or exceptional talent with other cloud experience, we will provide training programs)• Experience in large-scale, secure, and high-availability solutions in a Cloud environment, such as GCP.• Experience with one Dataflow or Spark• Experience with orchestration frameworks such as Airflow, Kubeflow, Azkaban, etc.• Extensive programming experience in Python, Java and/or Scala.• Good understanding of modern data architecture• Good understanding of GCP services such as IAM, and Google Cloud Storage buckets• Experience with business intelligence tools like QuickSight, Looker and Data Studio• Technical writing experience; preparing and presenting technical material to a variety of audiences.• Experience in working in or with, Agile delivery teams.

Benefits

• Flexible vacation policy. • Three weeks of vacation, plus we are closed over the winter holidays (+ ~1 week)• One team-building event each quarter• Great health benefits with a $1500-$3000 HSA/WSA• Certification opportunities. We will pay for your GCP certification as well as other relevant training and certifications• Learning opportunities. We work across different industries, technologies and roles and will work with you to help you explore your interests.• Blogging, open source, meetups and conference opportunities. We will provide a platform and time for you to pursue your ideas• Our organization values action over politics, and our management team is made up of engineers who thrive on achieving tangible results.