Software Engineer - EMR & Apache Spark

November 10

Apply Now

Receive Emails with Similar Jobs

S&P Global

WebsiteLinkedInAll Job Openings

Analytics • Credit ratings • Finance • Energy & commodities information • Intelligence

10,000+ employees

Founded 1860

💸 Finance

🏢 Enterprise

🤖 Artificial Intelligence

Description

• Lead the design and implementation of EMR / Spark workloads using Python, including data access from relational databases and cloud storage technologies. • Ensure performance, security, and reliability; coordinate with application teams to define database design. • Collaborate with cross-functional teams to support data-driven initiatives. • Mentor junior team members and promote best practices. • Oversee SPARK maintenance and troubleshooting. • Drive innovation by evaluating and integrating new technologies. • Produce system design documents and participate in technical walkthroughs. • Perform application and system performance tuning and troubleshoot performance issues. • Effectively interact with global customers, business users, and IT staff.

Requirements

• Bachelor’s degree in computer science, Information Systems, or Engineering, or equivalent work experience. • 8-10 years of IT experience in application support or development. • Strong experience in managing EMR workloads including configurations. • Experience with SPARK and NoSQL-related database technologies. • Experience in working with multi-threaded, high-performance, low-latency messaging systems. • Experience in AWS cloud-based technologies. • Experience using system tools, source control systems, utilities, and third-party products. • Experience with financial applications such as Index/Benchmarks, Asset Management, Portfolio Investment modeling, or trading systems. • Excellent communication skills, with strong verbal and writing proficiencies. • Proficiency in building data analytics solutions on AWS Cloud. • Thorough understanding of replication strategies and implementation of HA protocols for 99.99% uptime. • Experience with implementation of data governance and data lineage. • Proficiency in implementing data models in SQL and NoSQL databases. • Experience with microservice and serverless architecture implementation.

Benefits

• Health care coverage designed for the mind and body. • Generous time off helps keep you energized for your time on. • Access a wealth of resources to grow your career and learn valuable new skills. • Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs. • It’s not just about you. S&P Global has perks for your partners and little ones, too, with some best-in-class benefits for families. • From retail discounts to referral incentive awards—small perks can make a big difference.