Data Engineer - Remote

3 days ago

Apply Now

Receive Emails with Similar Jobs

Availity

WebsiteLinkedInAll Job Openings

1001 - 5000

💰 Secondary Market on 2021-07

Description

• Develop a scalable cloud data platform and pipelines. • Ensure best practices around data pipelines, metadata management, data quality, data governance, data privacy. • Build AWS Infrastructure for Big Data Processing. • Optimize cloud resource usage to minimize costs while maintaining reliability. • Participate in coding best practices and code reviews.

Requirements

• In-depth understanding of Spark framework, scripting (Python, Bash, node.js) • Experience with SQL, Java, Scala • Experience working with big data (100 gigs or more) • Experience with AWS Terraform • Experience building workflows with Airflow • Firm understanding of unit testing • Knowledge of AWS services and data engineering tools, specifically AWS EMR • In-depth understanding of GIT or other distributed version control systems • Excellent communication skills • Collaborative attitude • Strong technical, process, and problem-solving proficiency • Experience with SQL and relational database systems (Oracle, SQL Server) • Experience with Linux • 4+ years of development experience with big data technologies (nice to have) • 4+ years using Apache Spark (nice to have) • Experience with cloud computing platforms (AWS, Azure, Google Cloud) (nice to have) • Familiarity with standard data science toolkits (R, Python) (nice to have) • Relevant certifications (AWS Certified Developer - Associate, AWS Certified Solutions Architect - Associate) (nice to have)

Benefits

• Competitive salary • Bonus structure • Generous HSA company contribution • Healthcare, vision, dental benefits • 401k match program • Unlimited PTO for salaried associates + 9 paid holidays • Hourly associates start at 19 days of PTO • Reimbursement of up to $250/year for gym memberships, racing events, weight management programs • Education reimbursement • Paid Parental Leave for both moms and dads • Opportunities to engage with community organizations