October 31
Airflow
Amazon Redshift
Apache
Cassandra
Cloud
Distributed Systems
ElasticSearch
ETL
Google Cloud Platform
Grafana
HBase
JavaScript
MariaDB
MongoDB
MySQL
NoSQL
Postgres
Prometheus
Python
RDBMS
Tableau
Go
ā¢ Join Dev.Pro - a US-based outsourcing software development company that has been delivering exceptional software experience to clients since 2011. ā¢ We invite a talented, organized, and reliable Data Engineer to join our team and play an important role in building a project that connects the art market with the digital-first financial ecosystem. ā¢ Work with a global leader in artwork tokenization and blockchain-secured provenance, using your skills to contribute to innovative projects at the crossroads of the blockchain and art industries. ā¢ Engage in an exciting blockchain-related project transforming the art market ā¢ Work within a unique business domain that collaborates with world-class brands ā¢ Join a dynamic no-legacy startup and contribute to building processes, tools, and products from scratch
ā¢ 4+ years of experience in data engineering, encompassing data extraction, transformation, and migration. ā¢ Advanced experience with data extraction from unstructured files and legacy systems. ā¢ Proven expertise in migrating data from file-based storage systems to cloud storage solutions, ideally on Google Cloud Platform. ā¢ Proficiency with relational databases, specifically MariaDB or MySQL, as well as cloud-native solutions such as Google Cloud Storage, Google BigQuery, and optionally Snowflake or Amazon Redshift. ā¢ Strong programming skills in Python, with a focus on data manipulation, automation, and re-implementing custom tools. ā¢ Extensive experience with ETL/ELT pipeline development and workflow orchestration tools (e.g., Apache Airflow, Luigi, Google Dataflow, Prefect). ā¢ Hands-on experience with batch processing frameworks and real-time data processing frameworks. ā¢ Experience with data pipeline development using programming languages, including batch processing implementation. ā¢ In-depth understanding of data modeling, data warehousing, and best practices for designing scalable data architectures. ā¢ Practical experience in developing or re-engineering data mastering tools for the purpose of data cleaning, standardization, and preparation. ā¢ Expertise in RDBMS functionalities, such as stored procedures, triggers, partitioning, indexes, and structural changes. ā¢ Ability to handle Personally Identifiable Information (PII) data within pipelines and data storage systems. ā¢ Experience with NoSQL databases, such as MongoDB, Cassandra, or HBase. ā¢ Experience with monitoring tools such as Prometheus, Grafana, and CloudWatch to oversee data pipelines and systems. ā¢ Knowledge of best practices in database management, performance optimization, data security, and ensuring consistency across distributed systems. ā¢ Ability to critically evaluate data architecture and provide strategic recommendations for infrastructure improvements. ā¢ Upper-Intermediate+ English level ā¢ Familiarity with JavaScript for maintaining or enhancing legacy systems and cross-functional integration. ā¢ Experience with ElasticSearch for indexing and querying large datasets. ā¢ Proficiency with analytical tools such as Tableau, Power BI, Looker, or similar platforms for data visualization and insights generation. ā¢ Interest or background in the art industry, particularly related to digital asset management and tokenization. ā¢ Demonstrated ability to collaborate in cross-functional teams and contribute to multidisciplinary projects. ā¢ Experience with PostgreSQL and understanding its application in data engineering environments. ā¢ Knowledge of specific services related to data engineering, including key metrics and business processes relevant to the industry domain. ā¢ Experience with MLOps tools and practices to streamline machine learning deployment and operations. ā¢ Basic understanding of existing machine learning models and algorithms.
ā¢ Get 30 paid rest days per year to use as holidays/vacation/other on the desired and requested dates ā¢ 5 sick leave days, up to 60 days of medical leave, and up to 6 days of leave per year due to family reasons (i.e., wedding/funeral/baby birth) ā¢ Get a health insurance package fully compensated by Dev.Pro ā¢ Join fun online activities and team-building events ā¢ Get continuous remote HR, payroll support, and overtime coverage ā¢ Join English/Polish lessons ā¢ Grow your expertise with mentorship support and DP University
Apply NowOctober 24
10,000+
Data Engineer designing and maintaining scalable data pipelines at Infosys Consulting.
šµš± Poland ā Remote
š° Post-IPO Equity on 2008-07
ā° Full Time
š” Mid-level
š Senior
š° Data Engineer
October 7
10,000+
Data Engineer to enhance data-driven decision-making at Radiometer.
August 15
51 - 200
Build and maintain efficient data pipelines for Captiv8's influencer marketing platform.