Senior Data Engineer

November 13

Apply Now

Receive Emails with Similar Jobs

Cloudera

WebsiteLinkedInAll Job Openings

Big Data • Cloud Computing • machine learning • cloud • Analytics

1001 - 5000

💰 $4.1M Venture Round on 2013-01

Description

• Collaborate with Data Architects, Operational Architects, and Data Analysts to understand the data and operational requirements across different business units. • Partner with data owners to ensure seamless, reliable data ingestion. • Develop and implement data transformations to enrich and provision data, following established specifications and standards. • Create real-time, near real-time, and point-in-time data flows to meet the operational demands of business systems. • Implement monitoring processes to track data quality and ensure the reliability of data services.

Requirements

• 5+ years of experience as a Data Engineer • Strong communication skills, both written and verbal • Proficient in coding with SQL, scripting languages, Python, SPARK, and Java • Experience with ETL, Business Intelligence, and Data Processing • Proven track record of contributing to the architecture and implementation of reliable data pipelines • Experience building data models using industry best practices (e.g., Kimball, Inmon) • Hands-on experience with Hadoop technologies, including at least one of Impala, Hive, Kafka, MapReduce, or Spark • Ability to monitor critical data pipelines for quality and resolve any issues effectively • Experience with Apache Airflow or Apache NiFi (optional) • Expertise in optimizing data storage using HDFS/Parquet/Avro, Kudu, or HBase (optional) • Experience developing data engineering processes to support AI/ML use cases (optional)

Benefits

• Generous PTO Policy • Support work life balance with Unplugged Days • Flexible WFH Policy • Mental & Physical Wellness programs • Phone and Internet Reimbursement program • Access to Continued Career Development • Comprehensive Benefits and Competitive Packages • Paid Volunteer Time • Employee Resource Groups