Tech Minds Agency
Tech Minds Agency is a creative IT solutions provider that specializes in helping businesses and individuals leverage technology for growth and success. They offer a diverse range of services including website creation, mobile app development, digital marketing, and training in various technical skills. Their mission is to navigate the evolving tech landscape, enabling clients to enhance their online presence and achieve their business goals. With a focus on personalized service and staying ahead of tech trends, Tech Minds Agency aims to empower its clients through innovative solutions and expert support.
Principal Data Engineer
April 2
Tech Minds Agency
Tech Minds Agency is a creative IT solutions provider that specializes in helping businesses and individuals leverage technology for growth and success. They offer a diverse range of services including website creation, mobile app development, digital marketing, and training in various technical skills. Their mission is to navigate the evolving tech landscape, enabling clients to enhance their online presence and achieve their business goals. With a focus on personalized service and staying ahead of tech trends, Tech Minds Agency aims to empower its clients through innovative solutions and expert support.
📋 Description
• We are seeking a dynamic and highly skilled Principal Data Engineer who has extensive experience building enterprise scale data platforms and lead these foundational efforts. • This role demands someone who not only possesses a profound understanding of the data engineering landscape but is also at the forefront of their game. • The ideal candidate will contribute significantly to platform development with diverse skillset while also being very hands-on coding and actively shaping the future of our data ecosystem. • As a principal engineer, you will be responsible for ideation, architecture, design and development of new enterprise data platform. • You will collaborate with other cloud and security architects to ensure seamless alignment within our overarching technology strategy. • Architect and design core components with a microservices architecture, abstracting platform, and infrastructure intricacies. • Create and maintain essential data platform SDKs and libraries, adhering to industry best practices. • Design and develop connector frameworks and modern connectors to source data from disparate systems both on-prem and cloud. • Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices while keeping costs in check. • Architect and design the best security patterns and practices. • Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data. • Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions. • Design and develop advanced analytics and machine learning capabilities on the data platform. • Design and develop observability and data governance frameworks and practices. • Stay up to date with the latest data engineering trends, technologies, and best practices. • Drive the deployment and release cycles, ensuring a robust and scalable platform.
🎯 Requirements
• 15+ of proven experience in modern cloud data engineering, • broader data landscape experience and exposure • solid software engineering experience. • Prior experience architecting and building successful enterprise scale data platforms in a green field environment. • Proficiency in building end to end data platforms and data services in GCP. • Proficiency in tools and technologies: BigQuery, Cloud Functions, Cloud Run, Dataform, Dataflow, Dataproc, SQL, Python, Airflow, PubSub. • Experience with Microservices architectures - Kubernetes, Docker and Cloud Run. • Experience building Symantec layers. • Proficiency in architecting and designing and development experience with batch and real time streaming infrastructure and workloads. • Solid experience with architecting and implementing metadata management including data catalogues, data lineage, data quality and data observability for big data workflows. • Hands-on experience with GCP ecosystem and data lakehouse architectures. • Strong understanding of data modeling, data architecture, and data governance principles. • Excellent experience with DataOps principles and test automation. • Excellent experience with observability tooling: Grafana, Datadog. • Nice to have: Experience with Data Mesh architecture. • Experience building Semantic layers for data platforms. • Experience building scalable IoT architectures.
Apply NowSimilar Jobs
February 11
As a Principal Consultant in Data Engineering, you'll interface with clients and internal teams to gather and analyze data requirements.
January 24
Seeking a Staff Data Engineer to oversee data architecture and pipelines at a leading SaaS platform.
August 27, 2024
Cummins Inc.
10,000+ employees
Lead data engineering and analytics solutions at Cummins.
🇮🇳 India – Remote
🔥 Funding within the last year
💰 $75M Grant on 2024-07
⏰ Full Time
🔴 Lead
🚰 Data Engineer
Discover 100,000+ Remote Jobs!
Wall of Love
Frequently asked questions
We use powerful scraping tech to scan the internet for thousands of remote jobs daily. It operates 24/7 and costs us to operate, so we charge for access to keep the site running.
Of course! You can cancel your subscription at any time with no hidden fees or penalties. Once canceled, you’ll still have access until the end of your current billing period.
Other job boards only have jobs from companies that pay to post. This means that you miss out on jobs from companies that don't want to pay. On the other hand, Remote Rocketship scrapes the internet for jobs and doesn't accept payments from companies. This means we have thousands more jobs!
New jobs are constantly being posted. We check each company website every day to ensure we have the most up-to-date job listings.
Yes! We’re always looking to expand our listings and appreciate any suggestions from our community. Just send an email to Lior@remoterocketship.com. I read every request.
Remote Rocketship is a solo project by me, Lior Neu-ner. I built this website for my wife when she was looking for a job! She was having a hard time finding remote jobs, so I decided to build her a tool that would search the internet for her.