Staff Software Engineer - AI Data Infrastructure

March 26

🔔 Pennsylvania – Remote

Although this job is listed in Pennsylvania, this company may be open to hiring remote in other states.

⏰ Full Time

🔴 Lead

🧑‍💻 Full-stack Engineer

Apply Now

Receive Emails with Similar Jobs

Stack AV

WebsiteLinkedInAll Job Openings

Stack AV is a company that is revolutionizing the transportation industry through its autonomous trucking solutions, driven by advanced artificial intelligence. The company focuses on developing AI-powered autonomous systems to enhance safety, reliability, and efficiency in trucking operations. Stack AV is committed to addressing the challenges of the trucking industry by designing smart solutions to improve supply chain intelligence, business outcomes, and delivery speed. Safety is a core principle, and the company leverages cutting-edge AI, machine learning, and cloud technologies to innovate within the industry.

51 - 200 employees

🚗 Transport

🤖 Artificial Intelligence

📋 Description

• About Stack: • Stack is developing revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. • About the Role: • The AI Data Infrastructure sits at the heart of Stack’s machine learning and data engineering worlds. • Responsibilities: • Architectural Design: Design and oversee the architecture of the data platform, ensuring scalability, reliability, and performance. • Data Management: Ensure efficient storage, retrieval, data quality, consistency, and governance across the platform. Develop and implement strategies for data lifecycle management, including archiving and purging. • Collaboration: Collaborate with cross-functional teams to understand data requirements and design appropriate solutions. • Technology Stack: Stay updated with the latest technologies and trends in data engineering, making recommendations for new tools and best practices. • Performance Optimization: Identify and resolve performance bottlenecks in data processing and storage. • Promote Engineering Excellence: Set a culture of engineering excellence within the team and work closely with the management and customer teams to balance between speed of delivery and quality of engineering artifacts.

🎯 Requirements

• Education: Degree in Computer Science or related field • 5+ years of professional software development experience. • Expert level development skills with Python and SQL • Strong experience with Big Data technologies (data warehouses, data lakes, orchestration, etc) • Experience building data platforms used by other developers • Experience implementing near real-time data pipelines for applications, BI analytics, and ML pipelines. • Expert level working knowledge of Data Lake technologies, data storage formats (Parquet, Iceberg) and query engines (Trino) and associated concepts for building optimized solutions at scale. • Experience in designing data streaming and event-based data solutions (Kafka, Kinesis, SQS/SNS or the like) • Experience with data pipelines tools (Flink, Spark or like) and orchestration tools such as Airflow or Flyte and data transformation tools such as SQLMesh or DBT.