Director of Software Engineering, Node.js - Web Scraping Expert

2 days ago

🏄 California – Remote

Although this job is listed in California, this company may be open to hiring remote in other states.

⏰ Full Time

🔴 Lead

🔙 Backend Engineer

Apply Now

Receive Emails with Similar Jobs

PortPro

WebsiteLinkedInAll Job Openings

PortPro is a privately-owned technology company that specializes in providing advanced operational software solutions tailored for drayage carriers and freight brokerages. Their platform is designed to enhance drayage operations by improving communication, operational efficiency, and customer satisfaction. Utilizing a modern Transportation Management System (TMS), PortPro focuses on helping companies streamline their processes, improve cash flow, boost operational performance, and grow their business. The company's award-winning software supports both asset-based and non-asset based divisions, enabling seamless integration and comprehensive management of drayage trucking and brokerage operations. PortPro is recognized for their customer support and innovative technology offerings that empower clients to achieve greater transparency and efficiency in their operations.

drayage • container tracking • tms • transportation management system • intermodal

51 - 200 employees

🚗 Transport

☁️ SaaS

💰 $12M Series A on 2023-01

📋 Description

• We are seeking a Director of Software Engineering with deep expertise in Node.js development and large-scale web scraping. • This role will lead the engineering team, designing and optimizing high-performance, distributed web scraping systems. • The ideal candidate has extensive experience in handling anti-bot measures, data pipeline optimization, and scalable cloud-based architectures.

🎯 Requirements

• 10+ years of experience in software engineering, with at least 5+ years in web scraping and large-scale data extraction. • Strong hands-on expertise in Node.js, Puppeteer, Playwright, Cheerio, Selenium, and headless browser automation. • Extensive experience in handling CAPTCHAs, IP rotation, session management, and anti-bot evasion techniques. • Deep knowledge of proxy management (residential, datacenter, rotating, and VPNs). Experience with NoSQL/SQL databases (MongoDB, PostgreSQL, Redis, Elasticsearch, etc.). • Familiarity with data processing frameworks (Kafka, RabbitMQ, Spark, Airflow, etc.). Strong experience with CI/CD, containerization (Docker, Kubernetes), and cloud deployment (AWS/GCP/Azure). • Proven track record of scaling engineering teams and leading complex projects. • Strong problem-solving and debugging skills, especially for scraping challenges and performance bottlenecks. • Excellent communication and stakeholder management skills. • Passion for mentorship, team development, and continuous learning.