Automation Data Engineer

16 hours ago

Apply Now

Receive Emails with Similar Jobs

DeepOpinion

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Machine Learning • Deep Learning • Natural Language Processing • Opinion Mining

11 - 50

💰 Seed Round on 2022-03

Description

• As an Automation Data Engineer you will gain hands-on experience in a dynamic and collaborative environment • Work on real-world data challenges and contributing to our mission of leveraging data for impactful insights and innovation • Develop and maintain automations on DeepOpinion Studio and Apache Airflow to deliver robust results • Manage external data sources and integrations into automations for high data quality and integrity • Develop and maintain data storage services for automation data to optimise automation reliability • Monitor, maintain, and optimise existing data pipelines to ensure data integrity and performance • Develop monitoring of workspaces to ensure proactive service continuity • Develop dashboards to monitor customer usage insights to maximise customer value • Access historical execution data via API and build dashboards for data flow statistics • Maintain the solution delivery development environments • Upgrade the solution delivery tool stack to enhance efficiency and performance • Continuously identify opportunities for improving data processes and drive initiatives to enhance data quality and usability

Requirements

• Currently pursuing a bachelor’s or master’s degree in Computer Science, Engineering, Information Technology, or a related field • Proficiency in software development and programming languages like Python is essential • Proficient in developing data pipelines and automations using Apache Airflow or equivalent • Experience with developing data visualisation and dashboards • Strong problem-solving skills and the ability to communicate complex technical concepts to non-technical stakeholders • Proven track record of managing multiple tasks and delivering high-quality work on time • Enthusiasm for learning new technologies and staying current with industry trends