Data Engineer
Yesterday
Description
• Work with the Engineering Manager and other Data Engineers/Data Analysts to drive opportunities to take advantage of the data platform. • Engineer and build effective, efficient, and sustainable data pipelines in cloud-based technologies. • Identify and solve big data, throughput, streaming, and batch processing challenges. • Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, and redesigning infrastructure for greater scalability. • Work collaboratively with your team to ensure you are always using the best tech for the problem you are solving. • Design and implement patterns for data flow across the business. • Ensure data security and risk management across Shippit. • Interact with AWS, Snowflake, dbt, Python, TypeScript, and Kafka to positively impact • Bring software engineering expertise combined with a data perspective to the team. • Collaborate with squads to maximise the use of the data they produce
Requirements
• At least 2-5 years of experience in a data engineering or technically oriented data role. • Strong background in Computer Science, Informatics, Information Systems, or another quantitative field. • Experience in developing, deploying, and operating scalable data pipelines. • Excellent collaboration and communication skills to work effectively within a cross-functional team, including an excellent understanding of English. • Proficient in analysing large-scale data sets using a range of cloud-based technologies. • Broad understanding of the data engineering lifecycle from ETL/ELT, pipeline build, and data visualisation. • Familiarity with NoSQL-based technologies. • Knowledge of Kafka and Kubernetes with a strong approach to Data Engineering. • Hands-on experience with Terraform or Infrastructure as a Code. • Enjoy analysing complex problems to find simple solutions. • Prior experience utilising open-source solutions for data loading and transformation. • A sense of responsibility for the customer you serve: Product and Analytics teams.
Benefits
• Genuine Flexibility and Fully Remote - you don't need to choose between work and a personal life. • Increased Annual Leave & Birthday Leave - receive increased annual leave and celebrate your birthday • Enrich your Life - travel and explore the world through the flexibility to temporarily work anywhere, yes anywhere in the world for up to 2 weeks of the year. • Fuel your Growth Journey - Unlocking your potential with development opportunities that have commercial opportunities.
Apply Now