Automation Engineer

2 days ago

Apply Now
Logo of INV Technologies

INV Technologies

INDUSTRIAL ROBOTICS β€’ R & D(ELECTRONICS β€’ EMBEDDED SYSTEMS β€’ AUTOMOBILES) β€’ INDUSTRIAL AUTOMATION

11 - 50

Description

β€’ Create crawlers for each source URL by using Python modules [scrapy, selenium, requests, BeautifulSoup, and splash] β€’ Create and maintain scrapy pipelines and middlewares to manage the output from the crawlers. β€’ Create crawlers for all types of websites irrespective of the technical roadblocks. β€’ Manage the crawlers to overcome technical challenges like IP ban, geolocation ban, captcha, and bot blocking services. β€’ Write SQL queries to manage database operations using Python modules like sqlalchemy β€’ Deploy the python scripts/crawlers to Linux based AWS servers

Requirements

β€’ Strong hands-on experience in Python programming β€’ Good experience with scraping libraries such as Requests, BeautifulSoup, Selenium and Scrapy. β€’ Proven 3+ experience working on web development frameworks such as Flask/Django/FastAPI/Tornado/Pandas β€’ Knowledge of building APIs and services using REST. β€’ Experience with any RDBMS and strong SQL knowledge. β€’ Clear with Object-oriented concepts. β€’ Excellent troubleshooting skills. β€’ Proficient understanding of code versioning tools like git. β€’ Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3 β€’ Understanding of fundamental design principles behind a scalable application. β€’ Familiar with UI frameworks like Angular/ReactJS β€’ Strong unit test and debugging skills. β€’ Strong knowledge of data engineering platforms such as Airflow. β€’ Experience with the Google Cloud β€’ Docker β€’ Agile and Scrum. β€’ Even better if have worked in Jira and confluence. β€’ Experience with ETL β€’ Celery β€’ Excellent interpersonal skills and ability to work with a diverse team

Apply Now

Similar Jobs

October 10

Allegion

10,000+

Support global manufacturing strategy at Allegion through automation and process innovation.

October 10

Allegion

10,000+

Engineer supporting global manufacturing strategy at Allegion, enhancing safety and efficiency.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or lior@remoterocketship.com