Machinify, Inc.
Machine Learning • Deep Learning • Large-scale Data Processing • Cluster Computing • Real-time predictions
51 - 200
💰 $10M Series A on 2018-10
Senior Data Engineer
June 13, 2023
Machinify, Inc.
Machine Learning • Deep Learning • Large-scale Data Processing • Cluster Computing • Real-time predictions
51 - 200
💰 $10M Series A on 2018-10
Description
• Independently understand all aspects of a business problem including those unrelated to their area of expertise, weigh pros and cons of different approaches and suggest ones likely to succeed • Work with a cross-functional organization including engineering, delivering, subject-matter experts, product managers, as well as platform engineers to deliver a scalable framework. • Map the customer data into Machinify canonical form. Identify and ingest noncanonical fields and generalize the process to a minimal level of customization. • Proactively design and adapt the canonical form to suit changing query patterns and needs. • Ultimately own data availability and quality for the Data Science organization.
Requirements
• Deep experience as a hands-on Data Engineer building production data pipelines • Experience managing the delivery of complex data • Experience in ETL orchestration and workflow management tools with a strong preference for Apache Airflow • Experience in Spark or other distributed computing frameworks • SQL and Python • Advanced SQL performance tuning • Kubernetes and building Docker images • AWS & GCP • Experience working with APIs to collect or ingest data • Manage SLA for all pipelines in allocated areas of ownership • Streaming technologies like kafka , spark streaming etc • ELK stack , Grafana etc
Benefits
• Meaningful equity • Excellent healthcare • Flexible time off • Other benefits and perks
Apply Now
