Senior Big Data Engineer - Airflow and Oozie

4 days ago

Apply Now

Receive Emails with Similar Jobs

Rackspace Technology

WebsiteLinkedInAll Job Openings

IT as a Service • Multi-Cloud • Managed Hosting • Managed AWS/Azure/Google Cloud Platform/OpenStack/Alibaba • Managed Private Cloud for VMware/Microsoft/OpenStack

5001 - 10000 employees

Founded 1998

☁️ SaaS

Description

• Seeking a highly skilled and experienced Senior Big Data Engineer. • Background in developing batch processing systems, with experience in Oozie, Apache Hadoop, Airflow, and public cloud technologies, especially GCP. • Work in remote environment, requiring excellent communication skills and problem-solving abilities.

Requirements

• Bachelor's degree in Computer Science, software engineering or related field of study. • Experience with managed cloud services and understanding of cloud-based batch processing systems are critical. • Proficiency in Oozie, Airflow, Map Reduce, Java. • Strong programming skills with Java (specifically Spark), Python, Pig, and SQL. • Expertise in public cloud services, particularly in GCP. • Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce. • Familiarity with BigTable and Redis. • Experienced in Infrastructure and Applied DevOps principles in daily work. • Proven experience in engineering batch processing systems at scale.

Benefits

• Variable compensation in the form of bonuses, commissions, or discretionary payments. • Based on company and/or individual performance and may change at any time. • Additional benefits offered, visit benefits link.