Senior Data Engineer - Python, Pyspark, Databricks

October 20, 2024

Apply Now

Receive Emails with Similar Jobs

Exusia

WebsiteLinkedInAll Job Openings

Exusia is a management consulting firm specializing in AI, Cloud, Data Engineering, and Digital Solutions. Formed in 2012, Exusia is dedicated to facilitating digital transformation worldwide with headquarters in Miami, Florida, and operations in Asia, UK, and South Africa. The company offers services in digital transformation, mergers and acquisitions, data monetization, cloud modernization, self-service, and regulatory compliance, aiming to help businesses scale revenues, increase client satisfaction, and reduce expenditures and risks.

Strategy • Analytics • Data Engineering • Cloud • Business Intelligence

201 - 500 employees

🤖 Artificial Intelligence

📋 Description

• Full-time job to work with Exusia's clients to design, develop and maintain large scale data engineering solutions. • The right candidates will also get a chance to work across the entire data landscape including Data Governance, Metadata Management and will work closely with client stakeholders to capture the requirements, design and implement Analytical reporting, Compliance and Data Governance solutions. • Work with business stakeholders to gather and analyze business requirements, building a solid understanding of the Data Analytics and Data Governance domain. • Document, discuss and resolve business, data and reporting issues within the team, across functional teams, and with business stakeholders. • Should be able to work independently and come up with solution design. • Build optimized data processing and data governance solutions using the given toolset. • Provide hands on technical leadership and work on multiple projects if required. • Collaborate with delivery leadership to deliver projects on time adhering to the quality standards. • Contribute to talent recruitment, competency building and providing mentorship to junior resources for these skills.

🎯 Requirements

• Must have strong Data Warehousing / Data Engineering background • Strong conceptual understanding of Data Management & Data Governance principles • Experience working with multiple databases like Oracle/SQL Server/Other DBs • Exposure to Microsoft Azure storage and compute services and should have hands on experience with Databricks on Azure • Hands-on experience using Python and Pyspark and should have completed min 2 projects • Hands-on experience using Databricks and should be fluent with Pyspark & Spark SQL • Exposure to Delta lake • Exposure to BFSI domain and Data Governance is a big plus • Exposure to Java & Scala • Understanding of data governance tools like ASG & Collibra is an added advantage • Exposure to cloud platforms like AWS, Azure & GCP