Data Engineer

September 6

Apply Now

Receive Emails with Similar Jobs

Blue Orange Digital

WebsiteLinkedInAll Job Openings

Your strategic data partner.

Node • web development • React/Redux • Spark • sparkml

51 - 200

💰 $700k Corporate Round on 2022-04

Description

• Work with Databricks, Spark, Python, and other data orchestration and ETL tools to build high-performance data pipelines. • Work with data teams to help design, build, and deploy data platforms in the cloud (Azure, AWS, GCP) and automate their operation. • Work with Azure DevOps, Azure Pipelines, Terraform, CloudFormation, and other Automation and infrastructure tools to build robust systems. • Provide leadership in applying software development principles and best practices, including continuous integration, continuous delivery/deployment, and managing infrastructure such as code and automated testing across multiple software applications. • Support heterogeneous technology environments, including both Windows and Linux systems. • Develop reusable, automated processes, and custom tools. • And other requests as directed by your manager.

Requirements

• BA/BS degree in Computer Science or a related technical field, or equivalent practical experience. • Excellent verbal and written English communication. • At least 3 years of experience building and supporting data platforms; exposure to data technologies like Databricks, Azure Data Factory, Airflow MS Fabric. • Advanced level Python, SQL, and Bash scripting. • Experience designing and building robust CI/CD pipelines. • Comfortable with Docker, configuration management, and monitoring tools. • Knowledge of best practices related to security, performance, and disaster recovery. • Experience working in cloud environments, at a minimum, experience in Azure or AWS. • Enjoys collaborating with other engineers on architecture and sharing designs with the team.