Senior Software Engineer - Data

October 11

Apply Now

Receive Emails with Similar Jobs

Yahoo

WebsiteLinkedInAll Job Openings

innovation • internet • technology • advertising • media

10,000+

💰 $4.8M Series B on 1995-11

Description

• Design, build and launch efficient & reliable data pipelines to move and transform data at scale • Build real time data ingestion pipelines that are capable of processing 100s of thousands of events per second • Interact with data analysts, product owners/managers and other engineers to understand business problems, technical requirements to deliver data solutions • Deliver data with highest quality through rigorous checks • Have excellent data modeling skills to understand the nuances of various dimension and metric types in the warehouse • Design workflows to ingest, load, present and publish new data sets for various use cases • Lead data investigations to troubleshoot data issues and drive resolution

Requirements

• BS/MS in Computer Science or a related major, or equivalent experience • 5+ years of Java and/or Python development experience • 3+ years experience in ETL design using Big Data stack environments (Hadoop, MapReduce, Pig, Hive, Oozie, Apache Beam, Airflow, etc.), implementation and maintenance • Experience with Google Cloud Platform (BigQuery, Dataproc, Composer, Dataflow, GCS, etc.) • Experience or familiarity with real time processing tools: Kafka, PubSub, Storm, Spark streaming • Experience with schema design and dimensional data modeling • Comfortable at writing complex SQL queries • Strong data mindset with a deep appreciation for analyzing data to identify product gaps and enhancements to improve and maintain data quality • Excellent communication and problem-solving skills • Takes initiative and is a team player

Benefits

• healthcare • 401K savings plan • company holidays • vacation • sick time • parental leave • employee assistance program