Senior Principal Data Engineer - Team Lead

December 12

Apply Now

Receive Emails with Similar Jobs

Nerdery

WebsiteLinkedInAll Job Openings

Digital Business Transformation • Strategy • Innovation • Experience Design • Software Engineering

201 - 500 employees

Founded 2003

☁️ SaaS

Description

• Oversees and accountable for the entire data lifecycle of complex, large-scale GCP data projects, encompassing data ingestion, transformation, aggregation, storage, management, governance, data science, machine learning, and AI, with a strong emphasis on Data and MLOps principles. • Leads and mentors a high-performing client team specializing in GCP data solutions and ML and AI solutions • Owns the technical review process, providing consistent feedback and guidance to project team members. • Manages the delivery process, proactively identifying and mitigating complex challenges within the GCP environment and documenting key architectural decisions. • Recommends and justifies modern architectural strategies, focusing on GCP services and best practices, to shape clients' technical roadmaps aligning to the data architectures like Mesh, Fabric, Hub and Lakehouse (including integration of BQ with Iceberg) • Partners with development leads, serving as the lead GCP data architect for multiple software engineering squads. • Fosters collaboration as the primary technical liaison between engineering and other project disciplines (Design, QA, Project Management, Strategy, Product, etc.) within GCP data projects. • Actively participates in internal leadership within the GCP data domain, contributing to strategic direction, supporting key initiatives, and upholding coding best practices within the Google Cloud ecosystem. • Communicates complex technical concepts effectively to diverse audiences with varying levels of technical expertise. • Evaluates the technical skills of prospective candidates, focusing on GCP data expertise, and provides recommendations to hiring managers, including designing and conducting technical assessments. • Offers ad-hoc technical support and mentorship to other practitioners within the GCP data domain. • Contributes to sales efforts by providing technical expertise on GCP solutions, developing estimates, and creating reusable estimation templates. • Champions Nerdery's GCP data expertise by actively sharing knowledge and insights through publishing articles, blog posts, whitepapers.

Requirements

• Bachelor's or Master's degree in Computer Science, a related field like Math or Statistics. • 15+ years of data engineering development experience. • 8+ years of experience in data architecture, demonstrating familiarity with modern data architectures including - Data Mesh, Data Hub, Data Lakehouse and Data Fabric. • Proven track record of successfully leading and delivering multi-million dollar projects. • Extensive experience architecting solutions on Google Cloud Platform (GCP), with deep knowledge of services like Big Query, GCS, Dataflow, Dataproc, Pub/Sub, Composer, Cloud SQL, IAM, Catalog, Dataflow (or Apache Beam), Composer (or Apache Airflow), dataplex, Vertex AI, CCAI, DialogFlow, Reccomendsations AI, BQ ML and others • Experience with Hybrid data architectures including on-premise and GCP, and other cloud (and leveraging Big Query Omini is a plus) • Experience on Terraform and Cloud Build • Exceptional verbal and visual communication skills, with the ability to explain complex technical concepts to diverse audiences. • Strong systems architecture experience. • Demonstrated ability to improve team quality and effectiveness. • Thorough understanding of the software development lifecycle and iterative development methodologies. • A proactive approach to leveraging AI tools to enhance delivery efficiency.