Intermediate Data Engineer

19 hours ago

Apply Now

Receive Emails with Similar Jobs

Dev.Pro

WebsiteLinkedInAll Job Openings

JavaScript • Node.js • .NET • Java • C++

501 - 1000

Description

• Join Dev.Pro - a US-based outsourcing software development company that has been delivering exceptional software experience to clients since 2011. • We invite a talented, organized, and reliable Data Engineer to join our team and play an important role in building a project that connects the art market with the digital-first financial ecosystem. • Work with a global leader in artwork tokenization and blockchain-secured provenance, using your skills to contribute to innovative projects at the crossroads of the blockchain and art industries. • Engage in an exciting blockchain-related project transforming the art market • Work within a unique business domain that collaborates with world-class brands • Join a dynamic no-legacy startup and contribute to building processes, tools, and products from scratch

Requirements

• 4+ years of experience in data engineering, encompassing data extraction, transformation, and migration. • Advanced experience with data extraction from unstructured files and legacy systems. • Proven expertise in migrating data from file-based storage systems to cloud storage solutions, ideally on Google Cloud Platform. • Proficiency with relational databases, specifically MariaDB or MySQL, as well as cloud-native solutions such as Google Cloud Storage, Google BigQuery, and optionally Snowflake or Amazon Redshift. • Strong programming skills in Python, with a focus on data manipulation, automation, and re-implementing custom tools. • Extensive experience with ETL/ELT pipeline development and workflow orchestration tools (e.g., Apache Airflow, Luigi, Google Dataflow, Prefect). • Hands-on experience with batch processing frameworks and real-time data processing frameworks. • Experience with data pipeline development using programming languages, including batch processing implementation. • In-depth understanding of data modeling, data warehousing, and best practices for designing scalable data architectures. • Practical experience in developing or re-engineering data mastering tools for the purpose of data cleaning, standardization, and preparation. • Expertise in RDBMS functionalities, such as stored procedures, triggers, partitioning, indexes, and structural changes. • Ability to handle Personally Identifiable Information (PII) data within pipelines and data storage systems. • Experience with NoSQL databases, such as MongoDB, Cassandra, or HBase. • Experience with monitoring tools such as Prometheus, Grafana, and CloudWatch to oversee data pipelines and systems. • Knowledge of best practices in database management, performance optimization, data security, and ensuring consistency across distributed systems. • Ability to critically evaluate data architecture and provide strategic recommendations for infrastructure improvements. • Upper-Intermediate+ English level • Familiarity with JavaScript for maintaining or enhancing legacy systems and cross-functional integration. • Experience with ElasticSearch for indexing and querying large datasets. • Proficiency with analytical tools such as Tableau, Power BI, Looker, or similar platforms for data visualization and insights generation. • Interest or background in the art industry, particularly related to digital asset management and tokenization. • Demonstrated ability to collaborate in cross-functional teams and contribute to multidisciplinary projects. • Experience with PostgreSQL and understanding its application in data engineering environments. • Knowledge of specific services related to data engineering, including key metrics and business processes relevant to the industry domain. • Experience with MLOps tools and practices to streamline machine learning deployment and operations. • Basic understanding of existing machine learning models and algorithms.

Benefits

• Get 30 paid rest days per year to use as holidays/vacation/other on the desired and requested dates • 5 sick leave days, up to 60 days of medical leave, and up to 6 days of leave per year due to family reasons (i.e., wedding/funeral/baby birth) • Get a health insurance package fully compensated by Dev.Pro • Join fun online activities and team-building events • Get continuous remote HR, payroll support, and overtime coverage • Join English/Polish lessons • Grow your expertise with mentorship support and DP University