Data Engineer

November 10

Apply Now

Receive Emails with Similar Jobs

Vikasietum Tecknology

WebsiteLinkedInAll Job Openings

Product Ideation to Development • UI/UX Consulting • Digital Transformation • Legacy Modernization • DevOps & Cloud Adoption

11 - 50

Description

• Our Data Engineers are highly skilled in creating data pipelines for ingest, transformation and storage of data, usually at scale, and are familiar with standing-up analytics clusters. • This role involves using modern agile technical practices - including Continuous Integration and Deployment, TDD, and XP - to deliver timely and pragmatic solutions, as well as helping others to do their jobs in a more effective way. • Responsibilities include working with clients to determine data processing needs, creation of highly available data pipelines, delivery of software using agile practices, automation of data infrastructure, and mentoring client team members.

Requirements

• Significant experience working on data pipelines, platforms and projects. • Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP, Azure). • Strong background in at least one programming language, Python or Scala preferable. • Working with a variety of databases, data warehouses and distributed file systems in production environments. • Strong experience in SQL and data modelling. • Exposure with data processing at scale. • Knowledge about GDPR and data security. • Working with source control and infrastructure as code (Git/Github, Terraform, ansible etc.) and CI/CD tools. • Understanding and being able to support data scientists or business intelligence teams - in data prep, mentoring and support functions. • Strong collaboration and communication skills, including the ability to communicate effectively while working remotely with globally distributed teams.