Software Engineer - Data Platform

18 hours ago

Apply Now

Receive Emails with Similar Jobs

Bot Auto

WebsiteLinkedInAll Job Openings

11 - 50

Description

• At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks. • We are seeking a highly skilled and motivated Software Engineer to design, build, and evolve our hybrid-Cloud data plane. • The ideal candidate will be a strong hands-on coder with foundational skills in large-scale data storage systems and data extraction & transformation pipelines. • Design and implement data infrastructure including data lakehouse systems. • Manage core Data storage, including Relational Databases, NoSQL databases, and Realtime DB. • Create a robust data collection pipeline to seamlessly transfer substantial data. • Build Data Lakehouse and Dashboard to support decision making. • Work with the infrastructure team to deploy and manage the data platform. • Engage in full-stack projects using a variety of technologies. • Build Robust Metadata system and Scenario/Case Mining. • Develop a versatile data serving SDK and API server to support training and simulation jobs.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related field. • Strong problem-solving skills and attention to detail. • Excellent communication and collaboration abilities. • Ability to work in a fast-paced, dynamic environment. • Proven track record of python production-level development (at least 3+ years). • Strong background in building modern data infrastructure including data lake (such as S3, delta lake & databricks, AWS Lake formation, Glue Catalog and etc), distributed computing framework (Spark, Presto & Athena and etc), and Business Intelligence Infrastructure (Tableau, Looker, Superset and etc) • Strong background in data engineering & data science including data modeling, data warehouse, pipeline, reporting tools, and analytics • Experienced in Full-stack development, e.g. React, Flask • Experienced in managing core data store (such as relational database and document store) • Familiarity with data privacy and security • Familiarity with data retention and cost control • Familiarity with cloud infrastructure, e.g. AWS, GCP, K8s, Iac • Nice to have experience with streaming data pipeline, e.g. Kafka, Kinesis • Nice to have experience developing with C++ • Ability to adapt quickly to emerging technologies.