Cloud Data Engineer - Architect, AWS/Azure, Ab Initio

October 2

Apply Now

Receive Emails with Similar Jobs

Rackspace Technology

WebsiteLinkedInAll Job Openings

IT as a Service • Multi-Cloud • Managed Hosting • Managed AWS/Azure/Google Cloud Platform/OpenStack/Alibaba • Managed Private Cloud for VMware/Microsoft/OpenStack

5001 - 10000

Description

• Collaborate with customers to design and deliver efficient, scalable data solutions. • Leverage AWS services (S3, EMR, Athena, Glue) or equivalent cloud platforms for data storage and processing. • Work with cutting-edge technologies and tools to build, optimize, and maintain large-scale data processing frameworks on the cloud.

Requirements

• Proficiency with AbInitio product suite, including experience in PDL, Meta-programming, Conduct>It, Express>It, and GDE-based development. • Implement and maintain CI/CD pipelines using tools like Jenkins and GitHub. • Work with schedulers such as Apache Airflow to automate workflows and data pipelines. • Automate tasks and processes using Python, shell scripting, and other relevant programming languages. • Develop, troubleshoot, and optimize PL/SQL queries for complex data workflows. • Work extensively on Big Data platforms like Hadoop and Hive to process large datasets. • Drive the development of large-scale, self-service enterprise data frameworks. • Exposure to open table formats like Iceberg is highly desirable.