Big Data Engineer

February 27

Apply Now
Logo of MGID

MGID

MGID is a global leader in native advertising, providing cutting-edge solutions for advertisers and publishers to drive revenue growth. As a pioneer in the field, MGID offers an all-in-one platform for monetization, audience acquisition, and engagement, reaching up to a billion people globally each month. The company is committed to redefining digital media and aiding brands in generating meaningful engagement with consumers through high-quality creatives and programmatic advertising strategies.

Native advertising • paid content distribution • audience development • website traffic management • advertising

501 - 1000 employees

Founded 2008

💰 Venture Round on 2009-11

📋 Description

• Collaborate with Data Scientists, Data Analysts, and other stakeholders to understand data needs and develop solutions. • Design, develop, and optimize PySpark applications for processing and analyzing large sets of structured and unstructured data. • Monitor and evaluate data to ensure accuracy and integrity, troubleshoot and debug PySpark code. • Build and maintain data pipelines for ingesting, processing, and storing data, optimizing for performance and scalability. • Develop and maintain data visualization dashboards and reports to enable insights and decision-making. • Create and maintain tools and libraries for efficient data processing. • Stay up-to-date with industry trends and new technologies to continuously improve data processing capabilities.

🎯 Requirements

• Proven experience in developing and optimizing PySpark applications. • Strong knowledge of distributed computing principles and concepts. • Practical experience working with large datasets using technologies such as Hadoop, Spark, ClickHouse. • Proficiency in programming languages such as Python, SQL. • Experience with Linux/Unix command-line interface. • Familiarity with data visualization and dashboarding tools. • Strong communication skills and ability to work effectively in a remote team environment. • Excellent problem-solving skills and attention to detail. • Will be a plus: Bachelor’s or Master’s degree in Computer Science or a related field. • Practical experience with ClickHouse. • Practical experience with stream processing and messaging systems such as Kafka. • Practical experience with NoSQL databases (for example MongoDB), especially Aerospike. • Knowledge of AdTech domain — understanding of online advertising, RTB. • Familiarity with containerization technologies such as Docker and Kubernetes, cloud computing platforms. • Familiarity with data governance and security best practices. • Knowledge of machine learning concepts and frameworks.

Apply Now

Discover 100,000+ Remote Jobs!

Join now to unlock all jobs

Discover hidden jobs

We scan the internet everyday and find jobs not posted on LinkedIn or other job boards.

Head start against the competition

We find jobs as soon as they're posted, so you can apply before everyone else.

Be the first to know

Daily emails with new job openings straight to your inbox.

Choose your membership

Loved by 10,000+ remote workers
🎉$6 / week

Cancel anytime

MOST POPULAR
🥳$18 / month
$24
Save 25% vs weekly

Cancel anytime

BEST VALUE
🥰$54 / year
$216
Save 75% vs monthly

Cancel anytime

Wall of Love

Frequently asked questions

We use powerful scraping tech to scan the internet for thousands of remote jobs daily. It operates 24/7 and costs us to operate, so we charge for access to keep the site running.

Of course! You can cancel your subscription at any time with no hidden fees or penalties. Once canceled, you’ll still have access until the end of your current billing period.

Other job boards only have jobs from companies that pay to post. This means that you miss out on jobs from companies that don't want to pay. On the other hand, Remote Rocketship scrapes the internet for jobs and doesn't accept payments from companies. This means we have thousands more jobs!

New jobs are constantly being posted. We check each company website every day to ensure we have the most up-to-date job listings.

Yes! We’re always looking to expand our listings and appreciate any suggestions from our community. Just send an email to Lior@remoterocketship.com. I read every request.

Remote Rocketship is a solo project by me, Lior Neu-ner. I built this website for my wife when she was looking for a job! She was having a hard time finding remote jobs, so I decided to build her a tool that would search the internet for her.

Why I created Remote Rocketship

Choose your membership

Loved by 10,000+ remote workers
🎉$6 / week

Cancel anytime

MOST POPULAR
🥳$18 / month
$24
Save 25% vs weekly

Cancel anytime

BEST VALUE
🥰$54 / year
$216
Save 75% vs monthly

Cancel anytime

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or lior@remoterocketship.com