Intermediate Data Engineer

October 31

Apply Now
Logo of Dev.Pro

Dev.Pro

JavaScript ā€¢ Node.js ā€¢ .NET ā€¢ Java ā€¢ C++

501 - 1000

Description

ā€¢ Join Dev.Pro - a US-based outsourcing software development company that has been delivering exceptional software experience to clients since 2011. ā€¢ We invite a talented, organized, and reliable Data Engineer to join our team and play an important role in building a project that connects the art market with the digital-first financial ecosystem. ā€¢ Work with a global leader in artwork tokenization and blockchain-secured provenance, using your skills to contribute to innovative projects at the crossroads of the blockchain and art industries. ā€¢ Engage in an exciting blockchain-related project transforming the art market ā€¢ Work within a unique business domain that collaborates with world-class brands ā€¢ Join a dynamic no-legacy startup and contribute to building processes, tools, and products from scratch

Requirements

ā€¢ 4+ years of experience in data engineering, encompassing data extraction, transformation, and migration. ā€¢ Advanced experience with data extraction from unstructured files and legacy systems. ā€¢ Proven expertise in migrating data from file-based storage systems to cloud storage solutions, ideally on Google Cloud Platform. ā€¢ Proficiency with relational databases, specifically MariaDB or MySQL, as well as cloud-native solutions such as Google Cloud Storage, Google BigQuery, and optionally Snowflake or Amazon Redshift. ā€¢ Strong programming skills in Python, with a focus on data manipulation, automation, and re-implementing custom tools. ā€¢ Extensive experience with ETL/ELT pipeline development and workflow orchestration tools (e.g., Apache Airflow, Luigi, Google Dataflow, Prefect). ā€¢ Hands-on experience with batch processing frameworks and real-time data processing frameworks. ā€¢ Experience with data pipeline development using programming languages, including batch processing implementation. ā€¢ In-depth understanding of data modeling, data warehousing, and best practices for designing scalable data architectures. ā€¢ Practical experience in developing or re-engineering data mastering tools for the purpose of data cleaning, standardization, and preparation. ā€¢ Expertise in RDBMS functionalities, such as stored procedures, triggers, partitioning, indexes, and structural changes. ā€¢ Ability to handle Personally Identifiable Information (PII) data within pipelines and data storage systems. ā€¢ Experience with NoSQL databases, such as MongoDB, Cassandra, or HBase. ā€¢ Experience with monitoring tools such as Prometheus, Grafana, and CloudWatch to oversee data pipelines and systems. ā€¢ Knowledge of best practices in database management, performance optimization, data security, and ensuring consistency across distributed systems. ā€¢ Ability to critically evaluate data architecture and provide strategic recommendations for infrastructure improvements. ā€¢ Upper-Intermediate+ English level ā€¢ Familiarity with JavaScript for maintaining or enhancing legacy systems and cross-functional integration. ā€¢ Experience with ElasticSearch for indexing and querying large datasets. ā€¢ Proficiency with analytical tools such as Tableau, Power BI, Looker, or similar platforms for data visualization and insights generation. ā€¢ Interest or background in the art industry, particularly related to digital asset management and tokenization. ā€¢ Demonstrated ability to collaborate in cross-functional teams and contribute to multidisciplinary projects. ā€¢ Experience with PostgreSQL and understanding its application in data engineering environments. ā€¢ Knowledge of specific services related to data engineering, including key metrics and business processes relevant to the industry domain. ā€¢ Experience with MLOps tools and practices to streamline machine learning deployment and operations. ā€¢ Basic understanding of existing machine learning models and algorithms.

Benefits

ā€¢ Get 30 paid rest days per year to use as holidays/vacation/other on the desired and requested dates ā€¢ 5 sick leave days, up to 60 days of medical leave, and up to 6 days of leave per year due to family reasons (i.e., wedding/funeral/baby birth) ā€¢ Get a health insurance package fully compensated by Dev.Pro ā€¢ Join fun online activities and team-building events ā€¢ Get continuous remote HR, payroll support, and overtime coverage ā€¢ Join English/Polish lessons ā€¢ Grow your expertise with mentorship support and DP University

Apply Now

Similar Jobs

Built byĀ Lior Neu-ner. I'd love to hear your feedback ā€” Get in touch via DM or lior@remoterocketship.com