IT as a Service • Multi-Cloud • Managed Hosting • Managed AWS/Azure/Google Cloud Platform/OpenStack/Alibaba • Managed Private Cloud for VMware/Microsoft/OpenStack
September 7
IT as a Service • Multi-Cloud • Managed Hosting • Managed AWS/Azure/Google Cloud Platform/OpenStack/Alibaba • Managed Private Cloud for VMware/Microsoft/OpenStack
• Build a reusable, and reliable code for stream and batch processing systems at scale. • This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark. • Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc.
• Experience with GCP managed services and understanding of cloud-based batch processing systems are critical. • Proficiency in Oozie, Airflow, Map Reduce, Java • Strong programming skills with Java (specifically Spark), Python, Pig, and SQL • Expertise in public cloud services, particularly in GCP. • Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce • Familiarity with BigTable and Redis • Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes. • Ability to tackle complex challenges and devise effective solutions. Use critical thinking to approach problems from various angles and propose innovative solutions. • Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals. • Proven experience in engineering batch processing systems at scale. • Hands-on experience in public cloud platforms, particularly GCP. Additional experience with other cloud technologies is advantageous.
Apply NowAugust 29
Senior Data Engineer managing data infrastructure at Liven.
August 27
Develop and maintain software systems for analyzing medical data to drive healthcare improvements.
July 27
Build end-to-end data solutions for companies utilizing 5X's core data stack.
July 23
Develop data-driven strategies and implementations for insurance companies.