Senior Software Engineer - Query Engine

March 13

Apply Now

Receive Emails with Similar Jobs

Dremio

WebsiteLinkedInAll Job Openings

Dremio is an innovative company that offers educational resources and certifications through Dremio University, providing courses and badges in data analytics and product development. It aims to empower professionals in the tech and data field by offering specialized training for roles such as Data Analyst and Data Engineer, ultimately enhancing their skills and career prospects.

Data Analytics • Big Data • Self-Service Data • SQL • NoSQL

201 - 500 employees

Founded 2015

📚 Education

🤝 B2B

☁️ SaaS

📋 Description

• We are seeking a talented and motivated Senior Software Engineer to join our Datalake team within the Query Engine organization. • In this role, you will focus on enhancing our query engine with a particular emphasis on the Iceberg table format and efficient scans of various file formats. • This is an exciting opportunity to contribute to cutting-edge technology in the big data ecosystem. • Designing and implementing features for Dremio’s query engine with a focus on the Iceberg table format • Optimizing file scan operations for various file formats, including Parquet, Avro and others • Collaborating with members of the query planning and query execution teams to ensure seamless integration of features across the code stack • Working with and contributing to open-source projects like Apache Iceberg, Parquet and Arrow • Maintaining and enhancing compliance with the Iceberg table format specification • Conducting performance tuning and benchmarking to enhance query execution speed • Understanding and reasoning about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment • Participating in code reviews and providing constructive feedback to peers

🎯 Requirements

• B.S., M.S. or PhD in Computer Science or in a related technical field • 5+ years of software engineering experience, with a focus on database systems, query execution or related fields • Strong programming skills in an object oriented language such as Java or C++ • Understanding of database internals, query planning, distributed systems, concurrency control, data replication, and storage systems • Familiarity with cloud object stores, such as AWS S3, ADLS or GCS. • Interested and motivated to be part of a fast-moving startup with a fun and accomplished team • Desire to learn: You can stand your ground as well as be mentored by your teammates