Data Engineer

October 25

Apply Now

Receive Emails with Similar Jobs

Allata

WebsiteLinkedInAll Job Openings

Strategic Advisory Services • Transformational Program Management • Emerging Technology • Custom Software • Cloud

201 - 500

Description

• Allata is an IT company dedicated to strategy, architecture, and enterprise-level application development. • We aim to be strategic advisors for our clients. • We provide Data Analytics, Advanced Integrations, Product Launch, Experience Design, Support, Cloud, DevOps, Software Development. • We are actively seeking an experienced Data Engineer with a strong proficiency in Data Bricks and Delta Live Tables. • The successful candidate will play a vital role in elevating our client's current data ecosystem and solutions. • The primary objectives will involve migrating existing data pipelines and crafting new data products to support enterprise analytics.

Requirements

• Expert level knowledge of using Data Bricks and Delta Live Tables along with SQL and Python to write complex, highly-optimized queries across large volumes of data. • Experience designing and building dimensional models. • Expertise in building and maintaining data pipelines with tools such as Data Bricks, DLT (preferred, DBT, Matillion, AWS Glue, Azure DataFactory, Fivetran. • Experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient and distributed data pipelines. • Experience with the medallion architecture • Expertise in cloud data lake such as Data Bricks Lakehouse, Azure Storage, AWS S3 • Expertise in cloud data warehouses like Snowflake (preferred), Redshift, BigQuery. • Knowledge of batch and streaming data processing techniques. • Understanding of the Data Lifecycle Management process to collect, access, use, store, transfer, delete data. • Experience with applying DevOps principles to data projects and familiarity with tools and concepts such as Git, infrastructure as code, and CICD. • Knowledge or experience in architectural best practices in building data lakes. • Experience with DBT • Experience with BI Tools and in deploying and maintaining data models (Power BI, Tableau, Qlik, etc). • Obsession for service observability, instrumentation, monitoring and alerting. • Experience with big data technologies (Python, Spark, Data Lake, Delta Lake, Hive, Azure DataLake Storage Gen 2). • Experience configuring, connecting, and maintaining cloud platforms and services to extend capabilities of data platforms. • Experience working with distributed teams and clients. • Knowledge of Agile and SDLC concepts, practices, and techniques. • Proactive Analytical attitude, strong sense of self-motivation, organization, attention to detail and analytical skills. • Strong English communication skills, both written and spoken.