DALTIX - Retail Data that Works
Price monitoring • Business Analytics • Data Analytics • Retail Data • Product monitoring
Senior Tech Lead - Data Collection Team
December 12
Airflow
Android
AWS
DNS
Docker
Grafana
GraphQL
JavaScript
Kubernetes
Node.js
Prometheus
Puppeteer
Python
SQL
TCP/IP
Terraform
DALTIX - Retail Data that Works
Price monitoring • Business Analytics • Data Analytics • Retail Data • Product monitoring
Description
•Architect and innovate sophisticated systems that scrape data reliably at scale •Lead technical direction and evolution of web scraping platform •Guide and inspire enthusiastic team in retail data domain •Develop talent and foster a culture of innovation •Solve complex issues with robust solutions •Drive team towards operational excellence •Collaborate with engineers, data scientists, and business teams •Articulate the value and impact of team's work
Requirements
•5+ years of senior professional experience in large-scale web scraping with JavaScript, Node.js, Puppeteer and Playwright •2-3 years of modern Python experience, with a focus on data wrangling; or equivalent experience in SQL •Professional experience reverse engineering Android apps and their APIs •Deep knowledge of how modern websites work (SPAs, GraphQL, Ajax, Service Workers, headers, cookies, JWTs, websockets, caching etc.) •Advanced knowledge of TCP/IP, TLS, HTTP/2, QUIC, DNS, WAF, web browser internals, OAuth flows •Seasoned knowledge of bypassing leading anti-bot systems (Cloudflare, Akamai, Imperva, PerimeterX, Datadome) •Experience with third party proxy providers •3+ years of senior-level experience in SRE/DevSecOps/Platform Engineering/Sysadmin ideally on AWS •Experience running on-call teams providing 7 day operational cover •Excellent verbal and written English skills
Benefits
•Competitive salary •Flexible working conditions •Annual company events •Health+travel benefits
Apply NowSimilar Jobs
December 8
Join GridGain's Remote Cloud Team as a Senior Software Engineer. Develop and enhance Java and Angular solutions for cloud-based data management tools.
December 7
As a Senior/Principal Software Engineer, develop software solutions for BforeAI's technology. You will maintain existing tools and work closely with diverse global teams.
🇵🇹 Portugal – Remote
💵 $60k - $90k / year
🔥 Funding within the last year
💰 Non Equity Assistance on 2024-02
⏰ Full Time
🟠 Senior
🧑💻 Full-stack Engineer
December 6
As a Senior Software Engineer at Zendesk, develop AI-powered solutions for customer experience. Collaborate with engineers to deliver high-quality products at scale.
December 6
Join Kevel as a Senior Software Engineer. Work remotely to develop ad serving solutions.
November 28
Join QuintoAndar as a Senior Software Engineer, working on AI/ML real estate tech solutions.