Online Data Engineer

October 7

Apply Now

Receive Emails with Similar Jobs

The Home Depot

WebsiteLinkedInAll Job Openings

retail • home improvement • customer service

10,000+

💰 Debt Financing on 2007-07

Description

• The Online Data Engineer teams translate business requirements and build infrastructure for customer data. • Acquire datasets and develop algorithms for actionable information. • Build, test, and maintain database pipeline architectures. • Create data validation methods and analysis tools. • Develop APIs to retrieve data. • Prepare and manipulate data using Hadoop or equivalent MapReduce platform. • Effectively communicate insights and recommendations to both technical and non-technical leaders. • Develops algorithms to transform data into useful, actionable information. • Participate in large data analytics project teams.

Requirements

• Must be 18 years of age or older. • Must be legally permitted to work in the United States. • Preferred Qualifications: • Masters in a quantitative field (Analytics, Computer Science, Math, Physics, Statistics, etc.) or relevant work experience. • Demonstrated knowledge developing and testing ETL jobs/pipelines, configuring orchestration, automated CI/CD, writing automation scripts, and supporting the pipelines in production. • Experience in high-level programming languages such as Python. • Experience defining and capturing metadata and rules associated with ETL processes. • Experience building Batch and Streaming pipelines. • Experience writing analytical SQL queries. • Ability to stitch and maintain data from multiple sources. • Ability to use JavaScript, Front-end development frameworks (React, Nucleus), and QA apps (Retina, KPI Shield, Alert Goose). • Ability to produce tags for site data. • Ability to code in Python, Google BigQuery to stitch and enrich the raw data from multiple sources. • Ability to use PySpark, AirFlow, and DataProc to engineer and automate data flows pipelines. • Ability to optimize the pipelines run time and lower the cost on slots/storage consumption. • Ability to prioritize requests and manage a product roadmap. • Strong verbal and written communications skills at all levels.