Senior Deep Learning Software Engineer - Inference and Model Optimization

3 days ago

🏄 California – Remote

Although this job is listed in California, this company may be open to hiring remote in other states.

💵 $184k - $356.5k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

Apply Now

Receive Emails with Similar Jobs

NVIDIA

WebsiteLinkedInAll Job Openings

GPU-accelerated computing • artificial intelligence • deep learning • virtual reality • gaming

10,000+ employees

Founded 1993

🤖 Artificial Intelligence

🎮 Gaming

Description

• Train, develop, and deploy state-of-the-generative AI models like LLMs and diffusion models using NVIDIA's AI software stack. • Leverage and build upon the torch 2.0 ecosystem to analyze and extract standardized model graph representation for our automated deployment solution. • Develop high-performance optimization techniques for inference, such as automated model sharding techniques and efficient attention kernels. • Collaborate with teams across NVIDIA to use performant kernel implementations within our automated deployment solution. • Analyze and profile GPU kernel-level performance to identify hardware and software optimization opportunities. • Continuously innovate on the inference performance to ensure NVIDIA's inference software solutions can maintain its leadership in the market. • Play a pivotal role in architecting and designing a modular and scalable software platform to provide an excellent user experience.

Requirements

• Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or related field. • 5+ years of relevant work or research experience in Deep Learning. • Excellent software design skills, including debugging, performance analysis, and test design. • Strong proficiency in Python, PyTorch, and related ML tools (e.g. HuggingFace). • Strong algorithms and programming fundamentals. • Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment.

Benefits

• equity • comprehensive benefits package