Senior Data Engineer

November 11

Apply Now

Receive Emails with Similar Jobs

Vitesse PSP Limited

WebsiteLinkedInAll Job Openings

Global Domestic Payments • API Integration • Global FX • Treasury and Remittance • Global Domestic Collections

51 - 200

💰 Series B on 2022-02

Description

•Join a growing Product and Technology team which has more than double in size in the last 12 month. •Help architect and build a robust, secure and scalable data architecture to support real-time observability and reporting. •Design and construction of data engineering solutions on AWS, as well as data service APIs. •Support key internal and external stakeholders requiring access to real-time and curated data. •Become a subject matter expert of the data generated by Vitesse and our ELT pipelines. •Drive data architecture strategy and Terraform deployment. •Experience building complex data frameworks in early-stage businesses. •Preferred technology experience: AWS, Airflow, Databricks, GitHub, Great Expectations, PyTest, Kafka, Mosaic AI, Terraform, Tableau.

Requirements

•Experience with data pipeline orchestration tools such as Airflow, Luigi, or similar •Experience with version control systems and CI/CD best practices using GitHub Actions •Knowledge of data governance, privacy regulations (e.g., GDPR), and security best practices •Proficiency with SQL and experience with distributed data processing tools such as Apache Spark •Strong understanding of relational and NoSQL databases (e.g., PostgreSQL, MongoDB, Impala, Cassandra) •Experience with cloud infrastructure (Docker and Kubernetes, Terraform) •Experience in AWS platform architecture and cloud services •A collaborative team member with Agile experience •Familiarity with stream processing technologies either Kafka or Kinesis •Nice to have •Experience with machine learning frameworks and pipelines. •Experience with Delta Live Tables •Familiarly with Great Expectations •Experience of search optimisers (ElasticSearch/Lucene), REST alternatives (GraphQL, AsyncAPI etc.), data science kits (Jupyter, Anaconda)

Benefits

•25 days Holiday per year (increasing by 1 day per years' service, up to 30 days) + Bank Holidays •Hybrid working arrangements – minimum 2 days in the office, Tuesday - Thursday •Contributory pension scheme •Enhanced Parental leave •Cycle to Work Scheme •Private Medical Insurance with AXA •Unlimited access to therapy sessions through our partner, Oliva •Discounted Gym membership through Gympass •Financial Coaching with Octopus Wealth •2 days of volunteering leave per year •Sabbatical after 5 years’ service •Life Assurance - MetLife (UK employees only) •Ongoing Learning and Development to support you reach your career goals