Senior Data Engineer

December 3, 2024

Apply Now

Receive Emails with Similar Jobs

OfferUp

WebsiteLinkedInAll Job Openings

C2C marketplace • mobile commerce • e-commerce • local commerce • engineering

201 - 500 employees

Founded 2011

🏪 Marketplace

🛒 Retail

👥 B2C

💰 Secondary Market on 2021-08

Description

• Be the technical lead on the team, owning the architecture of the data solutions, and the data platform. • Lead the team by example, mentor other engineers and help them with their growth. • Drive engineering best practices, set standards and propose larger projects which may require cross-team collaboration. • Design and develop applications to process large amounts of critical information in batch and near real-time to power user-facing features. • Influence technical direction for the company, leveraging your prior experiences and helping evaluate emerging technologies and approaches. • Help bring engineering maturity to a growing team that is at the center of a lot of critical initiatives for the company

Requirements

• 5+ years of professional software development experience • Strong ability in distributed systems for processing large scale data processing • Ability to communicate technical information effectively to technical and non-technical audiences • Proficiency in SQL and Python • Experience leveraging open source data infrastructure projects, such as Apache Spark, Airflow, Kafka, Flink, Samza, Avro, Parquet, Hadoop, Hive, HBase, Phoenix, Presto or Druid • Experience building scalable data pipelines and real-time data streams • Experience building software in AWS or a similar cloud environment • Experience with AWS services like Kinesis, Firehose, Lambda, Sagemaker is a big plus • Experience with GCP services like BigQuery, Cloud Functions is a big plus • Computer Science or Engineering degree required, Masters degree preferred • Excellent communication skills, both written and spoken (fluency in English required)