Senior Data Engineer

November 5

Apply Now

Receive Emails with Similar Jobs

S&P Global

WebsiteLinkedInAll Job Openings

Analytics • Credit ratings • Finance • Energy & commodities information • Intelligence

10,000+ employees

Founded 1888

💸 Finance

⚡ Energy

Description

• You will be an expert contributor and part of the Rating Organization’s Ingestion Pipelines Engineering Team. • The Data Engineer will support our data department on data initiatives and will ensure optimal data delivery architecture. • Design & Develop “Transformations” aspects using ELT framework to modernize the Ingestion pipelines and build data transformations at scale. • Build processes supporting data transformation, data structures, metadata, dependency and workload management. • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Requirements

• BE, MCA or MS degree in Computer Science or Information Technology • 3+ years of hands-on experience in implementing data lake systems using AWS/Azure cloud technologies such as S3, Databricks, Hive. • 1+ years of Expertise in building application using Data stream processing tool, APIs and DBMS for building ingestion pipeline for Bulk and incremental data loads. • Experience with development frameworks as well as data and integration technologies such Python, Scala • Experience in microservices and API design and implementation, with service-oriented architectures, SOAP and RESTful APIs • Hands-on experience in developing scalable data pipeline using technologies like Data stream processing tools, Databricks, Distributed data processing framework and Scala applying ETL and ELT concepts • Deep Experience with three or more technologies of Java/J2EE, C#, AWS, Distributed data processing framework, Python, Scala, any RDBMS, Data stream processing tools, Informatica, Angular/ReactJS, Databricks, Cloud-native orchestration tools • Experience with Continuous integration and deployment tools like Jenkins and Azure DevOps • Experience working in UNIX/Linux environment including shell scripting • Strong understanding of cloud native architectures, design patterns and best practices • Should be in position to articulate and convert requirements into solution. • Knowledgeable in technology and industry trends with ability to develop and present substantive technical solutions • Knowledge of Agile approaches to software development and able to put key Agile principles into practice to deliver solutions incrementally • Quality first mindset with a strong background and experience developing products for a global audience at scale • Excellent analytical thinking, interpersonal, oral, and written communication skills with strong ability to influence both IT and business partners

Benefits

• Health & Wellness: Health care coverage designed for the mind and body. • Flexible Downtime: Generous time off helps keep you energized for your time on. • Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills. • Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs. • Family Friendly Perks: It’s not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families. • Beyond the Basics: From retail discounts to referral incentive awards—small perks can make a big difference.