Senior Data Engineer

June 24

Apply Now

Receive Emails with Similar Jobs

Zeals Co., Ltd.

WebsiteLinkedInAll Job Openings

AI • Communication Design • Digital Transformation • Conversational Commerce

201 - 500

Description

• Design, develop, and optimize data pipelines to ingest data into our data lakehouse • Implement and manage ETL processes using Google Cloud Composer, Dataproc, and dbt • Develop data transformations within a medallion architecture (bronze, silver, gold layers) • Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements • Implement data quality checks and monitoring • Monitor and optimize the performance of BigQuery datasets and queries • Document processes, designs, and architectural decisions • Design and develop a read-optimized data warehouse layer • Troubleshoot daily reporting pipelines • Conducting code reviews and providing mentorship to junior engineers

Requirements

• 5+ years of experience in data engineering or related roles • Strong analytical skills with the ability to manipulate and interpret complex datasets • Proficiency in SQL and experience with databases such as MySQL and BigQuery • Experience in both Python and Scala is preferred • Knowledge of dbt is a must • Experience with data platforms like Airflow, Dataproc, Great Expectations • Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams • Demonstrated ability to work independently and manage multiple projects simultaneously • English proficiency is a must. Conversational Japanese is nice to have

Benefits

• 10 days paid holidays during the first year • Weekend off • National holidays • Summer and winter break