Data Engineer

5 hours ago

Apply Now

Receive Emails with Similar Jobs

Particle41

WebsiteLinkedInAll Job Openings

Application Development • DevOps • Data Science

51 - 200 employees

☁️ SaaS

🤖 Artificial Intelligence

🏢 Enterprise

Description

• Data Engineer • Particle41 is seeking a Data Engineer to design, build, and maintain data pipelines and infrastructure. • Collaborate with cross-functional teams for efficient data delivery on impactful projects.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related field. • Proven experience as a Data Engineer, with a minimum of 3 years of experience. • Proficiency in Python programming language. • Experience with database technologies such as SQL (e.g., MySQL, PostgreSQL) and NoSQL (e.g., MongoDB) databases. • Strong understanding of Programming Libraries/Frameworks and technologies such as Flask, API frameworks, datawarehousing/lakehouse, principles, database and ORM, data analysis databricks, pandas, Spark, Pyspark, Machine learning, OpenCV, scikit-learn. • Utilities & Tools: logging, requests, subprocess, regex, pytest • ELK stack, Redis, distributed task queues • Strong understanding of data warehousing/lakehousing principles and concurrent/parallel processing concepts. • Familiarity with at least one cloud data engineering stack (Azure, AWS, or GCP) and the ability to quickly learn and adapt to new ETL/ELT tools across various cloud providers. • Familiarity with version control systems like Git and collaborative development workflows. • Competence in working on Linux OS and creating shell scripts. • Solid understanding of software engineering principles, design patterns, and best practices. • Excellent problem-solving and analytical skills, with a keen attention to detail. • Effective communication skills, both written and verbal, and the ability to collaborate in a team environment. • Adaptability and willingness to learn new technologies and tools as needed.