Data Engineer

November 8

Apply Now

Receive Emails with Similar Jobs

McAfee

WebsiteLinkedInAll Job Openings

1001 - 5000

💰 Private Equity Round on 1991-09

Description

• We are looking for a skilled Data Engineer to join our team of experts. • Responsible for developing, maintaining, and optimizing our data warehouse, data pipeline, and data products. • Support multiple stakeholders to ensure an optimal data delivery architecture. • Design and implement data solutions using industry best practices. • Design, build and maintain batch or real-time data pipelines in production. • Maintain and optimize the data infrastructure required for data extraction, transformation, and loading. • Perform ETL, ELT operations and administration of data and systems securely. • Monitor and maintain data pipelines proactively to ensure high service availability. • Apply subject matter expertise in PySpark and big data in developing scalable pipelines. • Work with Data Scientists and ML Engineers to optimize data solutions. • Automate data workflows such as data ingestion, aggregation, and ETL processing. • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures. • Monitor data systems performance and implement optimization strategies.

Requirements

• Previous working experience with PySpark, data pipelines, and tools like Databricks and Snowflake is a must. • Excellent problem-solving skills and ability to learn through scattered resources. • Thorough understanding of the responsibilities and duties of a data engineer, as well as established industry standards/best practices and documentation guidelines. • Outstanding communication skills, and the ability to stay self-motivated and work with teams globally. • Experience with cloud-based data technologies. • 3-5 years of experience with distributed systems utilizing tools such as Spark or Kafka. • Working experience in Agile Scrum environments. • Experience with source control tools such as Git.

Benefits

• Bonus Program • Pension and Retirement Plans • Medical, Dental and Vision Coverage • Paid Time Off • Paid Parental Leave • Support for Community Involvement