Data Engineer

4 days ago

Apply Now

Receive Emails with Similar Jobs

Availity

WebsiteLinkedInAll Job Openings

1001 - 5000

💰 Secondary Market on 2021-07

Description

• Reporting to the Manager, Software Engineering • Deliver on-time, high-quality solutions that meet business objectives • Work closely with Engineering, Data Scientists, and business/technical teams to deliver secure, reliable, fault-tolerant, scalable, quality, and efficient outcomes • Develop a scalable and resilient cloud data platform and data pipelines • Ensure industry best practices around data pipelines, metadata management, data quality, data governance, and data privacy • Build highly scalable AWS Infrastructure to enable Big Data Processing • Optimize cloud resource usage to minimize costs while maintaining system reliability • Participate in coding best practices and code reviews

Requirements

• In-depth understanding of Spark framework, scripting languages (e.g., Python, Bash, node.js) • Experience working with big data and large datasets (100 gigs or more) • Experience with AWS Terraform • Experience building workflows with Airflow • Firm understanding of unit testing • In-depth knowledge of AWS services and data engineering tools • Excellent communication • Strong technical, process, and problem-solving proficiency • Must have experience with SQL and relational database systems (e.g., Oracle, SQL Server) • Must have experience with Linux • 4+ years of development experience with big data technologies (Nice to Have) • 4+ years using Apache Spark (Nice to Have) • Experience with cloud computing platforms (e.g., AWS, Azure, Google Cloud) (Nice to Have) • Experience with Software Development Life Cycle (Nice to Have) • Familiarity with standard data science toolkits, such as R and Python (Nice to Have)

Benefits

• Competitive salary • Bonus structure • Generous HSA company contribution • Healthcare, vision, dental benefits • 401k match program that you can take advantage of on day one • Unlimited PTO for salaried associates + 9 paid holidays • Hourly associates start at 19 days of PTO and go up from there with all the same holiday benefits • Reimburse up to $250/year for gym memberships, participation in racing events, weight management programs, etc. • Education reimbursement • Paid Parental Leave for both moms and dads, birth and adoptive parents • Community engagement opportunities