Senior Data Engineer

6 days ago

Apply Now

Receive Emails with Similar Jobs

DRW

WebsiteLinkedInAll Job Openings

trading • technology • research • négociation • technologie

1001 - 5000 employees

💸 Finance

💳 Fintech

₿ Crypto

Description

• Design and build an innovative data platform used by Traders, Quantitative Researchers, and Back-Office personnel • Determine appropriate data sources and implement processes to onboard new data sources • Develop data solutions to address the needs of various DRW trading teams • Monitor data ingestion pipelines and quality to ensure stability and reliability

Requirements

• 7+ years of experience working with modern data technologies and/or building data-intensive distributed systems • Expert level skills in Java/Scala or Python with a proven ability to output high-quality, maintainable, code • Strong familiarity with SQL and Bash • Experience leveraging and building cloud-native technologies for scalable data processing. • Prior experience with both batch and streaming systems and an understanding of the limitations those paradigms impose • Experience with an array of data processing technologies (e.g. Flink, Spark, Polars, Dask, etc.) • Experience with an array of data storage technologies (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.) • Experience with an array of data formats and serialization systems (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.) • Experience managing complex data ETL Pipelines (e.g. Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.) • Prior experience dealing with schema governance and schema evolution • Prior experience developing data quality control processes to detect data gaps or inaccuracies • A desire to mentor less experienced team-members and champion both engineering best-practices and high code-quality standards. • Strong technical problem-solving skills • Proven ability to work in an agile, fast-paced environment, prioritize multiple tasks and projects, and efficiently handle the demands of a trading environment

Benefits

• Group medical, pharmacy, dental and vision insurance • 401k (with discretionary employer match) • Short and long-term disability • Life and AD&D insurance • Health savings accounts • Flexible spending accounts