Azure Data Engineer, Azure Databricks & Pyspark

5 days ago

Apply Now

Receive Emails with Similar Jobs

MediaRadar, Inc.

WebsiteLinkedInAll Job Openings

ad sales intelligence and sales enablement

201 - 500

Description

• 12 month contract Azure Data Engineer (Azure Databricks & PySpark). • We’re hiring a talented Azure Data Engineer enthusiast to work in our platform to help ensure that our data quality is flawless. • You will be working with a passionate team of engineers to solve challenging problems and ensure that we can deliver the best data to our customers, on-time. • You will be using the latest cloud data lake technology to build robust and reliable data pipelines.

Requirements

• BS or MS in Computer Science or equivalent experience. • 4 + years of experience in Databricks/Apache Spark with Azure data storage solutions handling large datasets. • Expert in SQL and Spark SQL, including advanced analytical queries. • Proficiency in Python (data structures, algorithms, object-oriented programming, using API’s) and familiarity with PySpark. • Experience working with Databricks Delta tables, unity catalog, Dataframe API, read and write from/to various data sources and data formats. • Experience with both Batch and streaming data pipeline. • Knowledge of Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL is a plus. • Understanding of PostgreSQL and MS SQL. • Experience working in a fast-paced environment. • Experience in an Agile software development environment. • Ability to work with large datasets and perform data analysis. • Worked on migration project to build Unified data platform. • Experience working with JIRA, Azure DevOps CI/CD pipelines.

Benefits

• This is a 12 month contract position, 40 working hours per week and not benefits eligible. • The base salary range for this position is $100,000-$120,000. • A final compensation offer will ultimately be based on the candidate's location, skill level and experience. • If you need assistance or an accommodation, you may contact us at careers@mediaradar.com