Senior Data Architect
November 8, 2024
Description
• Manage data platform architecture on the Databricks platform. • Design and organize data platforms, including databases and data structures, data storage, access, loading, and pipeline design. • Collaborate with data stewards and data engineers on solution design. • Develop and maintain physical data models for the Databricks platform. • Manage metadata in data catalog tools, such as Collibra. • Ensure adherence to data curation standards and guidelines for medallion certification framework and required architecture. • Ensure the platform and platform design meet required security and compliance guidelines, including PII management. • Provide oversight to data curation teams, ingestion engineers and data engineers, including code review and data model design review to ensure adherence to standards and best practices.
Requirements
• Bring 6 + years of experience in data engineering, data modeling, and ETL/ELT. • Have experience as a senior engineer, including conducting code reviews. • Have hands-on experience with six or more of the following: • Design and implementation of logical and physical data models. • Data modeling tools, such as Erwin or ER/Studio. • Databricks / Spark. • Lakehouse architecture and medallion data organization. • ETL/ELT development, monitoring, pipelining and orchestration. • Python/ PySpark , Scala or similar programming language. • Data quality guidelines and testing frameworks. • Creating technical design documents and data flow diagrams. • CI/CD pipelines. • Agile sprints. • Git and version control.
Benefits
• Bonus Program • Pension and Retirement Plans • Medical, Dental and Vision Coverage • Paid Time Off • Paid Parental Leave • Support for Community Involvement
Apply NowSimilar Jobs
October 11, 2024
Senior Data Engineer at Mozilla, focusing on analytics and data modeling for informed decisions.
December 12, 2023
