Principal Data Engineer

November 10

Apply Now

Receive Emails with Similar Jobs

Software Mind

WebsiteLinkedInAll Job Openings

IT Outsourcing • Custom Application Services • Nearshore Teams • Offshore Teams • Software Development

1001 - 5000

💰 Private Equity Round on 2020-12

Description

• Develop and maintain Clarasight’s data architecture strategy • Own Clarasight’s data warehouse – the backend of our B2B SaaS platform • Work directly with customers on data ingest and reporting requirements • Manage the process of data ingestion into Clarasight’s data warehouse • Establish an enterprise ETL technical architecture for ingestion of all third party and customer data feeds • Perform data cataloging analytics on source data including data provided by clients and determine business rules for data ingestion • Write requirements for and then implement ETL and data pipelines including exception-handling protocols and processes • Perform continuous improvement of ETL processes • Build core datasets • Implement manual and automated data quality management • Define and uphold SLAs • Become a subject matter expert in travel and expense data • Collaborate with Software Development, Data Scientists, Product Management, and Customer Success • Democratize compliant and secure access to data through self-serve channels • Establish data governance policies and procedures • Monitor and troubleshoot data infrastructure issues • Manage the planning, implementation and testing of Continuity of Business and Disaster Recovery for Clarasight’s data warehouse • Provide technical leadership and share knowledge, for instance, through code reviews, pairing, ADRs, and presentations

Requirements

• 5+ years of data architecture, data modeling, data warehousing concepts, methodologies, and best practices • Experience working directly with customers • Experience scaling and re-architecting data platforms and infrastructure through orders of magnitude of growth and scaling data volume • Experience working on data infrastructure-focused engineering teams building a data lake or data warehouse from scratch • Experience with state-of-the-art ETL tools, techniques and processes • Experience with AWS and cloud-based data services • RDBMS; SQL; query optimization; performance troubleshooting • Familiarity with DBT or SQLMesh • Familiarity with several data warehousing platforms like Google Big Query, Snowflake, MemSQL (SQL Store), Apache Ignite, Redshift, Databricks • 0 to 1 startup experience • Exceptional common sense and the ability to manage ambiguity

Benefits

• Flexible employment and remote work • International projects with leading global clients • International business trips • Non-corporate atmosphere • Language classes • Internal & external training • Private healthcare and insurance • Multisport card • Well-being initiatives