Staff Software Engineer - Cloud Systems Architect

March 21

Apply Now

Receive Emails with Similar Jobs

Zyte

WebsiteLinkedInAll Job Openings

Zyte is a company specialized in providing web data extraction solutions that are now powered by AI. They offer a range of products including the Zyte API, which handles ban management, AI scraping, and proxy solutions for seamless web data collection. Additionally, Zyte provides scalable cloud hosting for Scrapy spiders, enabling efficient management and automation of web scraping tasks. Zyte caters to a diverse set of industries, providing data for e-commerce, news, AI, job postings, real estate, and more, while emphasizing legal compliance in their operations. With a focus on streamlined and cost-effective data extraction services, Zyte supports businesses in accelerating their data projects and enhancing data-driven decision-making.

Web crawling • Web scraping • Scraping • Scrapy • Data Science

201 - 500 employees

Founded 2015

🔌 API

🤖 Artificial Intelligence

🛍️ eCommerce

💰 $3M Debt Financing on 2021-12

📋 Description

• About Us • At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 240 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data • For more than a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web. • About the Job • This role combines hands-on engineering with strategic leadership, focusing on delivering key indicators responsible for user happiness and efficient business operation. The product you will be owning is a cost-efficient, highly scalable, high-availability system, responsible for hosting and running tens of thousands of jobs simultaneously. You are expected to be a product-focused engineer, ready to radically improve the product in an always changing environment. • We're looking for candidates who can design and build cloud systems, not just operate or maintain them. • About the Team • The Scrapy Cloud team, comprises developers, data engineers, and product managers focused on building a high-performance, scalable platform. We prioritize practical engineering and collaboration, fostering a culture of innovation and continuous improvement.

🎯 Requirements

• Experience in designing and executing experiments, ranging from load testing and performance testing, all the way to evaluate performance of hardware components and do some basic statistical analysis. • Understanding of the modern RDBMS architecture, concepts and troubleshooting strategies. • You are strong in either Java or Python, better yet, in both. • Fixing a broken build of a cross-language application should not be an issue for you. Finding your way around integrating CPython with C libraries and Java will definitely come handy. • If you know HBase and Mesos that’s a huge plus for us. • Proficiency in Linux internals, including namespaces, containerization options and their tradeoffs, process management, file and directory management, memory management is crucial. • Ability to benchmark and integrate commodity server hardware by both cloud and bare metal providers. • Good presentation and mentoring skills. • We're looking for candidates who can design and build cloud systems, not just operate or maintain them. This role is best suited for those who: • Have experience beyond using or managing Kubernetes/OpenShift and are comfortable designing cloud infrastructure. • Have worked with load testing, hardware profiling, or program benchmarking. • Have expertise beyond high-level web frameworks like Spring Boot, Django, Jersey, or Vert.x. • Have experience developing cloud solutions rather than primarily working as a solution architect for pre-built technologies.

🏖️ Benefits

• Become part of a self-motivated, progressive, multi-cultural team. • Have the freedom and flexibility to work from where you do your best work. • Work with cutting-edge open-source technologies and tools. • 35 days paid holidays