Principal Data Engineer

October 21

Apply Now

Receive Emails with Similar Jobs

Authentica Solutions

WebsiteLinkedInAll Job Openings

Education • Special Education • Data an AI • Modern Data Estate for Education • Exceptional Learning

11 - 50

Description

• Lead engineering organization with primary responsibility over data platform. • Shape next iteration of data platform. • Guide existing engineering team in designing, developing, and maintaining Education Intelligence Platform. • Ensure scalability, reliability, and performance of platform. • Construct, manage, and enhance fault-tolerant data infrastructure. • Collaborate with engineering and product teams to execute product goals. • Develop and manage scalable data pipelines handling terabytes of data.

Requirements

• Minimum of 10 years hands-on experience with Python and related data libraries (e.g. Pandas, Data Frames) • Practical expertise in ETL/ELT technologies and methodologies. • Minimum of 3 years hands-on experience using Databricks • Proven experience in data wrangling and cleaning across structured, semi-structured, and unstructured data formats. • Solid design and development background in modern technologies such as API management, REST/API integration, Containers, and Micro services. • Experience in designing or working with data warehouses, including an understanding of associated data flows. • Exceptional communication skills, both written and verbal. English fluency is required to effectively communicate with our clients and other key stakeholders both internal and external. • Familiarity or experience with orchestration tools. • Knowledge or hands-on experience with streaming platforms and real-time data pipeline systems such as Apache Kafka, Azure Event Hubs, and similar platforms. • Education Sector experience.