Senior Data Engineer

September 12

Apply Now

Receive Emails with Similar Jobs

PrizePicks

WebsiteLinkedInAll Job Openings

Spectator Sports

201 - 500

Description

• Enhance existing Core Data platforms and develop new integrations • Demonstrated expertise in developing real-time and batch frameworks for data ingestion pipelines • Design and implement complex data pipelines and transformation logic in Python, GO • Work closely with DevOps, architects, and engineers to ensure success of the Core Data platform • Guide teams in implementing and maintaining comprehensive monitoring, alerting, and documentation practices • Design and oversee Infrastructure as Code (IaC) solutions • Develop and manage CI/CD pipelines to automate deployment of data solutions • Experience in designing and automating data governance processes

Requirements

• 5+ years of experience in a data Engineering, or data-oriented software engineering role creating and pushing end-to-end data engineering pipelines. • 2+ years of experience acting as technical lead and providing mentorship and feedback to junior engineers. • Extensive experience building and optimizing cloud-based data streaming pipelines and infrastructure. • Extensive experience exposing real-time predictive model outputs to production-grade systems leveraging large-scale distributed data processing and model training. • Experience in most of the following: • SQL/NoSQL databases/warehouses: Postgres, BigQuery, BigTable, Materialise etc • Replication Services: Data Stream, Hevo, Data Proc etc. • Scripting languages: SQL, Python, Go, Rust. • Cloud platform services in GCP and analogous systems: Cloud Storage, Cloud Compute Engine, Cloud Functions, Kubernetes Engine etc. • Code version control: Git • Data pipeline and workflow tools: Prefect, Airflow, Cloud Composer, Serverless Framework. • Monitoring and Observability platforms: Datadog, ELK stack. • Infrastructure as Code platforms: Terraform, Google Cloud Deployment Manager, Ansible. • Other platform tools such as Redis, FastAPI, and Streamlit. • Excellent organizational, communication, presentation, and collaboration experience with organizational technical and non-technical teams

Benefits

• Company-subsidized medical, dental, & vision plans • 401(k) plan with company match • Long-term incentives and bi-annual bonus • Uncapped PTO to encourage a healthy work/life balance (2-week MINIMUM required!) • Generous paid leave programs, including 16-week paid parental leave and disability benefits • Workplace flexibility and modern work schedules focused on getting the job done, not hours clocked • Company-wide in-person events and team outings • Lifestyle enhancement program • Company equipment provided (Windows & Mac options) • Annual performance reviews with opportunities for growth and career development