Full Stack Data Engineer - Azure

6 days ago

Apply Now

Receive Emails with Similar Jobs

Shuvel

WebsiteLinkedInAll Job Openings

11 - 50

Description

• Purpose in Digital: develop innovative member experiences leveraging latest technologies in open source and Cloud. • Work with backend data processing technologies like Databricks/Apache Spark and Cloud computing technologies/Azure Data Platform. • Build end-to-end capabilities and maintain optimal data pipeline architecture. • Create infrastructure for optimal extraction, transformation, and loading of data from various data sources. • Use analytics for making decisions and achieving better outcomes for the business. • Collaborate with cross-functional teams and analyze data migration and integration strategies. • Query and analyze data sets to discover patterns and deliver insights. • Integrate source systems with information management solutions for automated migration processes. • Create proof-of-concepts for solutions under consideration.

Requirements

• Strong hands-on experience leading design thinking as well as the ability to translate ideas to clearly articulate technical solutions. • Bachelor’s degree in computer science, information systems, or other technology-related field or equivalent number of years of experience. • Advanced hands-on experience implementing and supporting large scale data processing pipelines and migrations using technologies (eg. Azure Services, Python programming) • Significant hands-on experience guiding technical teams as a mentor while leading collaboration with multiple teams across the organization. • Significant hands-on experience with Azure services such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage (ADLS Gen2), Azure SQL, and other data sources. • Significant hands-on experience designing and implementing reusable frameworks using Apache Spark (PySpark preferred or Java/Scala) • Solid foundation in data structures, algorithms, design patterns and strong analytical and problem-solving skills. • Experience with any of the following Analytics and Information Management competencies: Data Management and Architecture, Performance Management, Information Delivery and Advanced Analytics • Desired Proficiency in collaborative coding practices, such as pair programming, and ability to thrive in a team-oriented environment • The following certifications: Microsoft Certified Azure Data Engineer • Microsoft Certified Azure Solutions Architect • Databricks Certified Associate Developer for Apache 2.4/3.0