Senior Deep Learning Software Engineer - Inference and Model Optimization

October 7

Apply Now

Receive Emails with Similar Jobs

NVIDIA

WebsiteLinkedInAll Job Openings

GPU-accelerated computing • artificial intelligence • deep learning • virtual reality • gaming

10,000+

Description

• Train, develop, and deploy state-of-the generative AI models like LLMs and diffusion models using NVIDIA's AI software stack • Leverage and build upon the torch 2.0 ecosystem to analyze and extract standardized model graph representation for our automated deployment solution • Develop high-performance optimization techniques for inference, such as automated model sharding techniques, efficient attention kernels, and more • Collaborate with teams across NVIDIA to use performant kernel implementations within our automated deployment solution • Analyze and profile GPU kernel-level performance to identify hardware and software optimization opportunities • Continuously innovate on the inference performance to ensure NVIDIA's inference software solutions can maintain and increase its leadership in the market • Play a pivotal role in architecting and designing a modular and scalable software platform to provide an excellent user experience with broad model support and optimization techniques

Requirements

• Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or related field • 5+ years of relevant work or research experience in Deep Learning • Excellent software design skills, including debugging, performance analysis, and test design • Strong proficiency in Python, PyTorch, and related ML tools (e.g. HuggingFace) • Strong algorithms and programming fundamentals • Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment

Benefits

• equity • comprehensive benefits package • opportunities for diversity and equal opportunity