Data Engineer

3 days ago

Apply Now

Receive Emails with Similar Jobs

Authentica Solutions

WebsiteLinkedInAll Job Openings

Education • Special Education • Data an AI • Modern Data Estate for Education • Exceptional Learning

11 - 50

Description

• Play a key role in designing and maintaining the Education Intelligence Platform. • Ensure scalability, reliability, and performance of the platform. • Construct, manage, and enhance fault-tolerant data infrastructure. • Collaborate with engineering and product teams to execute on product goals. • Develop fault-tolerant, scalable data pipelines. • Develop data ingestion, processing, and transformation techniques. • Assist in construction of control plane infrastructure. • Conduct POCs to validate new tools and services. • Troubleshoot production data quality issues. • Stay abreast of industry standards.

Requirements

• Minimum of 2 years hands-on experience with Python and related data libraries (e.g. Pandas, Data Frames) • Practical expertise in ETL/ELT technologies and methodologies. • Prior experience using Databricks • Proven experience in data wrangling and cleaning across structured, semi-structured, and unstructured data formats. • Solid design and development background in modern technologies such as API management, REST/API integration, Containers, and Micro services. • Experience in designing or working with data warehouses, including an understanding of associated data flows. • Exceptional communication skills, both written and verbal. • English fluency is required to effectively communicate with our clients and other key stakeholders both internal and external. • A background in Education and/or Ed Tech is nice to have. • Hands-on experience with data streaming technology like Databricks DLT. • Certifications from Databricks. • Experience using Azure, AWS, or GCP, especially from a DevOps or Data engineering perspective. • Experience building multi-tenant systems. • Experience with OAuth. • Knowledge of privacy concerns related to user data.