Big Data Lead

November 10

Apply Now
Logo of Demandbase

Demandbase

marketing • account-based marketing • B2B marketing • B2B sales • company-targeted advertising

501 - 1000 employees

Founded 2010

🤝 B2B

🤖 Artificial Intelligence

💰 $175M Debt Financing on 2023-02

Description

• To help us go to the next level we are looking to onboard a hands-on SME in leveraging big data tech to solve the most complex data issues. • You will spend almost half of time with hands-on coding. • It involves large scale text data processing, event driven data pipelines, in-memory computations, optimization considering CPU core to network IO to disk IO. • You will be using cloud native services in AWS and GCP.

Requirements

• 7+ years of hands-on experience in Software Development with a focus on big data and large data pipelines. • Minimum 3 years of experience to build services and pipelines using Python. • Expertise with a variety of data processing systems, including streaming, event, and batch (Spark, Hadoop/MapReduce). • Understanding of at least one NoSQL stores like MongoDB, Elasticsearch, HBase. • Understanding of how data models, sharding and data location strategies for distributed data stores in large scale high-throughput and high-availability environments and their effect in non-structured text data processing. • Experience with running scalable & high available systems with AWS or GCP. • Good to have: Experience with Docker / Kubernetes • Exposure with CI/CD • Knowledge of Crawling/Scraping

Benefits

• Entire Work From Home • Birthday Leave • Remote Work

Apply Now

Similar Jobs

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or lior@remoterocketship.com