Senior Data Engineer

October 5

Apply Now

Receive Emails with Similar Jobs

Kpler

WebsiteLinkedInAll Job Openings

Energy Markets • Intelligence • Transparency • SaaS • Big Data

201 - 500

Description

• At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors. • Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 500 experts from 35+ countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success. • The Market Data team is responsible for the ingestion, filtering, enrichment, and distribution of externally sourced data. This data is coming from thousands of sources related to maritime trade, and is critical to the business processing entities in Kpler, so they can provide a live and accurate picture of the global trade to our customers.

Requirements

• Have at least 8 years of experience as a Software Engineer, including significant hands-on experience with using Python in production, especially with Spark, or Kafka. • Have worked with ML, OCR and NLP models integrated as part of complex production pipelines • Have experience with DevOps and Infrastructure as Code practices, especially on AWS. • Have experience with Data Processing Orchestration (Airflow). • Are fluent in English and have experience working in an international environment.