Senior Python ETL Developer

2 days ago

Apply Now

Receive Emails with Similar Jobs

Lean Tech

WebsiteLinkedInAll Job Openings

Development • Logistics • Automation • Software • Education

501 - 1000 employees

🤝 B2B

🎯 Recruitment

☁️ SaaS

Description

• Design and implement robust and scalable data pipelines using Python • Develop and maintain data integrations with various company platforms and services via APIs and web scrapers • Utilize web scraping tools and libraries such as BeautifulSoup, Scrapy, or Selenium to extract the required information • Centralize data from multiple sources into the company's databases for unified access and analysis • Automate ETL processes to manage unstructured data and decision logic • Ensure data integrity and efficient processing using pandas and other relevant Python libraries • Optimize data models in Snowflake to enhance performance and efficiency • Implement monitoring systems for data pipelines and incorporate feedback mechanisms • Collaborate with cross-functional teams to gather requirements and deliver solutions aligned with business objectives.

Requirements

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field • 3+ years of experience in data engineering with a focus on data integration and process automation • Advanced proficiency in Python, including experience with data manipulation and analysis using pandas • Experience with Snowflake for data storage and processing • Strong experience with API development and integration • Proficiency in web scraping tools and libraries such as BeautifulSoup, Scrapy, or Selenium • Intermediate experience with AWS services (EC2, RDS) for managing data solutions and scaling models • Strong knowledge of DevOps practices, including deployment, versioning, and monitoring of data pipelines • Intermediate knowledge of Docker and familiarity with microservices architecture and containerization technologies • Excellent problem-solving skills and ability to work with cross-functional teams • Understanding of the ethical considerations and safety measures in automated systems.

Benefits

• Professional development opportunities with international customers • Collaborative work environment • Career path and mentorship programs that will lead to new levels.