Data Engineer (Senior/Staff) - Colombia

August 26

Apply Now

Receive Emails with Similar Jobs

CivicScience

WebsiteLinkedInAll Job Openings

We power the world's opinions and share them with the decision-makers that care.

marketing solutions • market research • big data • data mining • brand tracking

51 - 200

💰 $15M Seed Round on 2021-08

Description

• Serve as the data advocate for CivicScience data engineering efforts, maintaining responsibility for development data pipelines, ETL, internal and third-party database systems, and business intelligence technology • Implement and support a platform that can provide performant, real-time access to PB-scale datasets • Extend the data platform to enhance scale, resiliency, and functionality • Practice good technical hygiene, including clean code, clear documentation, and participation in internal reviews • Work on hands-on coding challenges, collaborating with engineers, DevOps, UX, data science, and product managers • Monitor the evolving space of big data platforms and plan to evolve data storage and processes over time.

Requirements

• 5+ years of hands-on experience with software development focused on big data processing, data modeling, data pipelines, performance, and scalability • 3+ year experience with AWS • Fluency in Python, Java, and or Scala, along with expert-level skills SQL • Design and operational experience with RDBMS, NoSQL databases, as well as BigQuery or Snowflake; Maria DB and/or DynamoDB, a plus • Development experience with Apache Spark, Flink, AWS EMR, and/or Apache Pig; Apache Kafka, Google Pub/Sub, and/or AWS Kinesis, a strong plus • Hands-on experience with software containerization, such as Docker and Kubernetes • Excellent oral and written communication skills with English proficiency at B1 level • Positive and proactive attitude, intellectual curiosity, and motivation to find creative solutions for complex problems.

Benefits

• Professional services stipend • Unlimited PTO • Educational opportunities • Travel opportunities