Senior Data Solutions Architect

2 days ago

Apply Now

Receive Emails with Similar Jobs

Carbon60

WebsiteLinkedInAll Job Openings

Managed Hosting Services • Disaster Recovery Services • Managed Cloud Hosting Services • Cloud Assessment & Migration • Enterprise Wordpress & Drupal Hosting

51 - 200

💰 Private Equity Round on 2019-01

Description

• Provide deep technical expertise and leadership across a range of cloud data technologies. • Act as the go-to person for driving tool selection, resolving complex engineering issues, and guiding best practices during engagements. • Lead the design and implementation of data platforms to meet customers' business requirements. • Lead whiteboard design sessions with internal and external team members. • Identify and communicate technical risks as they emerge over the course of a project. • Work closely with Principal Consultants to extract project requirements during technical discovery sessions, define deliverables to meet those requirements, and break down those deliverables into a technical roadmap. • Lead teams of data engineers to execute project roadmaps. • Provide guidance on technical tasks, priorities, and technical assistance when needed. • Manage scope within customer engagements. • Identify changing requirements as they arise, determine their impact on scope, and ensure all stakeholders are aware and agree with the changes. • Maintain a close working relationship with the customer, as a "Trusted Advisor". • Set clear expectations, challenge assumptions, solicit feedback, and take ownership of project deliverables. • Establishing credibility and building impactful relationships with our customers. • Design and Delivery of Complex ETL/ELT processes, large-scale batch and real-time stream processing solutions, and optimizing data and schemas Data Lakes using native cloud tools or leveraging 3rd party platforms (for example Snowflake or Databricks) • End-to-end data solutions from ingestion pipelines, cataloging, analysis, and sharing insights (for example reports, dashboards, ML forecasts/predictions, etc.) • Migrations and transformations of data services such as relational databases, NoSQL databases, and Data Warehouses (heterogeneous and homogeneous) • Designing, building, training, and optimizing AI/ML solutions • Designing and integrating MLOps solutions to support model lifecycle automation.

Requirements

• 5+ years of experience in public cloud environments (AWS preferred). • 5+ years of developing code using Python, Java, or Scala languages • Experience building complex data engineering pipelines and ETL/ELT tasks • Experience with relational databases (for example Oracle, SQL Server, MySQL, Postgres, MariaDB) or managed cloud RDBMS services (such as Amazon Aurora) • Experience with NoSQL databases such as MongoDB, Cassandra, CouchDB, ElasticSearch, Neo4j, DynamoDB, BigTable, etc. • Experience building batch processing and real-time processing systems. • Experience building Data Warehouses and Data Lakes • Experience with 3+ of the following: - Building real-time streaming solutions leveraging technologies such as: Kafka, Kinesis, Pub/Sub messaging, event buses, or Spark Streaming - Designing and implementing analytics and BI solutions such as MicroStrategy, Tibco, Qlikview, or Tableau - Building AI/ML solutions, including operations such as ongoing training, optimizations, and model deployments. - Designing, implementing, training, and optimizing ML and AI models - Building solutions leveraging caching systems (for example Redis) and object stores (for example Amazon S3, Amazon Glacier, etc.) • Proven ability to discuss and design solutions using concepts such as data lineage, data quality gates, data anonymization, data governance, data security, data replication, data caching, data lifecycle management, data catalogs, and networking • Understanding of requirements and impacts from compliance frameworks such as HIPAA, PCI, GDPR, PIPEDA, etc. • Strong communication and presentation skills, written and verbal • Experience writing technical documentation • Experience in technical mentoring • Experience working in a customer-facing delivery role in a consulting or professional services environment

Benefits

• Competitive compensation package • Retirement Savings Matching Program (RRSP) • Access to the latest tech • Partnership with Perkopolis Discounts • Flexibility & Time Off • Remote first work environment • Flexible work hours & location • Paid parental leave options • Health & Wellness • Employer paid health & dental premiums • Partnership with GreenShield+ Counselling • Mental Health provider • $500 in Health Care Spending Account annually • Growth & Development • Udemy access for skills development • Peer recognition rewards