Lead Data Engineer

October 3

Apply Now

Receive Emails with Similar Jobs

Ryan Specialty

WebsiteLinkedInAll Job Openings

Property • Casualty • Transportation • Professional Liability • E&O

1001 - 5000

Description

• Provide technical leadership in data architecture and engineering • Collaborate with solution stakeholders to align data solutions with business objectives • Mentor less experienced data engineers and team members • Explore and implement new technologies and practices in data engineering • Manage and enhance complex SSIS packages for data integration and ETL processes • Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory • Develop and optimize Databricks notebooks for big data processing in Azure Databricks • Implement and manage data storage solutions using Delta Parquet files in Azure Data Lake Storage • Integrate and configure Profisee Master Data Management tools within Azure • Set up and manage Change Data Capture processes for real-time data synchronization in Azure • Implement data cataloging, classification, and lineage using Azure Purview • Enhance and support Tableau reporting solutions • Drive automation and process optimization using Azure services and scripting

Requirements

• BA/BS degree in a technical field • Demonstrated technical leadership and experience in collaborating with business analysts, data analysts, IT teams, and other stakeholders • Experience in implementing innovative data solutions and staying abreast of the latest trends in data engineering • Expertise in SQL Server Management, Azure Data Factory Development, Databricks Engineering, Delta Parquet File Management, and SQL Server Integration Services • Proficiency in Profisee MDM Integration, Change Data Capture implementation, and data quality and governance with Azure Purview • Proven experience in Tableau and BI Reporting, and strong skills in Automation and Process Optimization • Intellectual curiosity with a strong drive to learn • Critical thinker with an open mind to innovative solutions • High emotional intelligence • Exceptional communication skills • Strong collaboration and relationship building skills • Ability to navigate ambiguity • Highly structured in execution • Skilled at simplifying complex environments

Benefits

• Paid time off for company holidays • Vacation • Sick and personal days • Paid parental leave • Mental health services • Comprehensive and best-in-class benefits package