Data Engineer

2 days ago

Apply Now

Receive Emails with Similar Jobs

Centrilogic

WebsiteLinkedInAll Job Openings

Agile & DevOps • Application Management • Managed Cloud • Public Cloud • Private Cloud

51 - 200

💰 Private Equity Round on 2018-06

Description

• Data Engineer to work with 70+ software, data and DevOps engineers. • Guide and assist clients’ data modernization journey. • Contract opportunity for ambitious missions - clients creating innovative products. • Responsible for consulting with clients on cloud-first strategies. • Provide thought leadership on process and technical matters. • Mentor and educate client’s teams on latest approaches, tools, and skills.

Requirements

• Experience using Microsoft Azure in Data Engineering, such as Azure Data Factory, Databricks, Data Lake, and Synapse. • Strong understanding and some delivery experience with Data Mesh, Delta Lake, and Lakehouse Architecture are nice to have. • Understanding of security and corporate governance issues related with cloud-first data architecture, as well as accepted industry solutions. • Experience in enabling continuous delivery for development teams using scripted cloud provisioning and automated tooling. • Strong knowledge of Kafka and Spark and extensive experience using them in a production environment. • Strong knowledge of Confluent Platform and Confluent Cloud. • Strong knowledge of Scala or Python. • Strong knowledge of securing Azure Platforms, such as RBAC, Key Vault, and Azure Security Center. • Strong knowledge in Infrastructure as Code (IaC) experience using Terraform, PowerShell, Bash, and ARM Templates; Experience working with Agile development teams. • Sound business judgment and demonstrated leadership. • Willing to learn and grow in the space of Data & AI • Nice to have: Hands-on experience with machine learning, data science, and AI frameworks like TensorFlow, PyTorch. • Hand-on experience with applying generative AI, vector databases, and RAG models in creative and innovative ways. • Understanding of Data Governance and Data Quality practices and tools • Hands-on experience with Data Governance or data cataloging tools such as Purview, Collibra, Unity Catalog or Atlan.