Senior Data Operations Engineer

November 20

Apply Now

Receive Emails with Similar Jobs

Cloudera

WebsiteLinkedInAll Job Openings

Big Data • Cloud Computing • machine learning • cloud • Analytics

1001 - 5000

💰 $4.1M Venture Round on 2013-01

Description

•Maintain, upgrade, and expand Cloudera’s enterprise Hadoop cluster, ensuring it meets business-critical needs. •Collaborate with end users and internal technical teams (Engineering, Support, and Field) to address cluster issues and implement improvements. •Optimize the use of cloud services (public and/or private) to improve operational efficiency and reduce infrastructure costs. •Monitor and tune the performance of Hadoop clusters and jobs, particularly Hadoop MapReduce/Spark routines, to ensure high availability and efficiency. •Support and manage Hadoop services, including HDFS, Hive, Impala, and Spark. •Implement and refine DevOps practices to simplify and standardize deployments, ensuring reliable operation of applications across their lifecycle. •Ensure the reliability of data pipelines and critical applications through continuous monitoring and improvements. •Provide on-call and occasional weekend support as needed to maintain system stability and performance.

Requirements

•Strong expertise in Cloudera Manager and the broader Hadoop ecosystem •Solid Linux OS administration and troubleshooting skills •Proven ability to diagnose and resolve issues in complex, unfamiliar systems •Working knowledge of SQL for querying and data management tasks •Familiarity with containerization technologies like Docker and Kubernetes •Excellent collaboration and communication skills for cross-functional teamwork •Proficiency in programming languages, especially Python and Bash shell scripting (optional) •Experience with technologies such as Solr, Spark, Kafka, and Yarn (optional) •Exposure to cloud platforms like AWS, Azure, Google Cloud, or OpenShift (optional) •Experience with configuration management tools like SaltStack (optional) •Familiarity with continuous integration (CI) tools like Jenkins (optional)

Benefits

•Generous PTO Policy •Support work life balance with Unplugged Days •Flexible WFH Policy •Mental & Physical Wellness programs •Phone and Internet Reimbursement program •Access to Continued Career Development •Comprehensive Benefits and Competitive Packages •Paid Volunteer Time •Employee Resource Groups