Data Engineer - Web Scraping

Yesterday

Apply Now

Receive Emails with Similar Jobs

YipitData

WebsiteLinkedInAll Job Openings

YipitData is a company that specializes in providing accurate, timely insights on over 1,000 companies by analyzing billions of data points every day. They offer detailed research to help investors make smarter decisions and assist companies in increasing market share, sales, and customer base. YipitData delivers alternative data through a range of datasets, including receipt data, card data, web data, and publicly reported earnings. This data is used to track market trends, consumer behavior, and product categories, enabling businesses to gain transparency into performance metrics. Their services cater to investors, companies, and data partners, with a strong focus on accuracy and near real-time data delivery.

201 - 500 employees

💸 Finance

🏢 Enterprise

📋 Description

• YipitData is the leading market research and analytics firm for the disruptive economy. • Analyze billions of alternative data points every day to provide accurate insights on various sectors. • Design, refactor, and maintain web scrapers that power critical reports across the organization. • Contribute to resilient and efficient data ingestion processes supporting multiple business units.

🎯 Requirements

• Effective communication in English with both technical and non-technical stakeholders. • 4+ years of experience with web scraping frameworks (e.g., Selenium, Playwright, or Puppeteer). • Strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics. • Expertise in advanced fingerprinting and evasion strategies (e.g., browser fingerprint spoofing, request signature manipulation). • Deep experience managing cookies, headers, session states, and proxy rotations, including the deployment of both residential and data center proxies. • Experience with logging, metrics, and alerting to ensure high availability. • Troubleshooting skills to optimize scraper performance for efficiency, reliability, and scalability.

🏖️ Benefits

• We care about your personal life and we mean it. We offer vacation time, parental leave, team events, learning reimbursement, and more! • Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics. Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust.