Senior Data Engineer

2 days ago

Apply Now

Receive Emails with Similar Jobs

Cybernetic Controls Ltd

WebsiteLinkedInAll Job Openings

recruitment • remotehiring • offshore recruitment • remote jobs • work from home

51 - 200

Description

At Cybernetic Controls Limited (CCL), we provide innovative digital solutions. •Our client is seeking a Senior Data Engineer to join our fast-growing team. •The candidate will work on ETL and development tasks. •Build out new pipelines combining structured data sources with PySpark.

Requirements

Excellent Python and PySpark programming •Excellent understanding of ETL processes within Amazon Web Services (AWS) •Apache Spark, AWS Glue, Athena, S3, Step Functions, Lake Formation •Software development lifecycle best practices •Test-driven development •Serverless computing (AWS Lambda, API Gateway, SQS, SNS, EventBridge, S3, etc.) •SQL and NoSQL database design and management (DynamoDB, MySQL) •Strong SQL coding skills (Spark-SQL, Presto SQL, MySQL, etc.) •Infrastructure as code (CloudFormation) •Experience in Shell Scripting (preferably Linux) •Version control with Git/Github •Agile principles, processes and tools •Excellent written and verbal communication skills. •Designing, deploying and managing complex production data pipelines •Strong experience with Amazon Web Services (AWS) •5 years’ work in data engineering field •At least 2 years' experience with PySpark and AWS data tools

Benefits

Competitive salary package •Private healthcare contribution •Annual pay review •Regular team socials •Working within a culture of innovation and collaboration •Opportunity to play a key role in a pioneering growth company •Company Laptop will be provided