Senior Data Engineer

March 6, 2023

Apply Now

Receive Emails with Similar Jobs

Mactores

WebsiteLinkedInAll Job Openings

Big Data • Machine Learning • Consulting • Research • Internet of Things

51 - 200

Description

• pySpark Data Engineer with 4 years of experience in Data Engineering. • Work with business leads, analysts, and data scientists to build data products that empower better decision-making. • Write efficient code in Spark, Apache Beam technologies. • Collaborate with engineering and business teams to build better data products and services. • Explore new technologies and learn new techniques to solve business problems creatively. • Deliver projects along with the team collaboratively and manage updates to customers on time.

Requirements

• 4 to 7 years of experience in Apache Spark. • 2+ years of experience in writing ETL jobs using pySpark, and SparkSQL. • 2+ years of experience in SQL queries and stored procedures. • Deep understanding of all Dataframe API with all the transformation functions supported by Spark 2.7+. • Prior experience in working on AWS EMR, Apache Airflow, Certifications - AWS Certified Big Data – Specialty Cloudera or Hortonworks Certified Big Data Engineer, and understanding of DataOps Engineering is preferred.

Benefits

• Casual and fun office environment that steers clear of rigid "corporate" culture • Collaboration with multiple teams to build better data products and services • Opportunity to explore new technologies and learn new techniques to solve business problems creatively • Committed to providing equal opportunities in all employment practices • 10 Core Leadership Principles to drive how they work • Recruitment process is structured around three distinct stages