Big Data Engineer
September 18
Description
• Design, build, and optimize data pipelines to support business initiatives. • Collaborate with the internal business stakeholders to improve data engineering and analytics capabilities. • Optimize algorithms and work on complex SQL queries for data solutions. • Work within an AWS environment, particularly EMR , to manage and process large data sets. • Use Python, Java, or Scala for development, alongside test-driven development practices. • Build and maintain unit tests to ensure code quality.
Requirements
• 3-6 years of hands-on experience in data engineering. • Strong expertise in Python (or Java/Scala ), with proven coding proficiency. • Advanced experience in SQL , specifically for structuring complex queries. • Experience building data pipelines (not ETL) and optimizing algorithms. • Knowledge of AWS EMR and working in a big data environment. • Familiarity with Spark and test-driven development.
Apply NowSimilar Jobs
September 16
Design data infrastructure for National University’s data management needs.
September 13
Arbi Arredobagno
51 - 200
Data Architect at Argano driving data architecture design and implementation.
September 10
Bestow
201 - 500
Data engineer building scalable data solutions for Bestow's insurance technology platform.