Senior AI Software Engineer - GenAI Framework

October 31

Apply Now

Receive Emails with Similar Jobs

NVIDIA

WebsiteLinkedInAll Job Openings

GPU-accelerated computing • artificial intelligence • deep learning • virtual reality • gaming

10,000+

Description

• Develop the GenAI open source NeMo framework and Megatron Core . • Solve large-scale, end-to-end AI training and inference-deployment challenges (data curation, pre-processing, orchestrate and run model training and tuning, model serving). • Work at the intersection of deep learning applications, libraries, frameworks, and the entire software stack. • Performance tuning and optimizations of deep learning framework & software components. • Research, prototype and develop effective AI tools and pipelines.

Requirements

• MS, PhD or equivalent experience in Computer Science, AI, Applied Math, or related field and 5+ years of industry experience. • Experience with AI Frameworks (e.g. PyTorch, JAX), and/or inference and deployment environments (e.g. TRT, ONNX, Triton). • Proficient in Python programming, software design, debugging, performance analysis, test design and documentation. • Consistent record of working effectively across multiple engineering initiatives and improving AI libraries with new innovations. • Solid understanding of deep learning fundamentals and techniques. • Experience with large scale AI training and understanding of compute system concepts (latency/throughput bottlenecks, pipelining, multiprocessing), related performance analysis and tuning. • Prior experience with Generative AI techniques applied to LLM and MM learning (Image, Video, Speech). • Knowledge of GPU/CPU architecture and related numerical software. • Experience with cloud computing (e.g. end-to-end pipelines for AI training and inference on CSP (AWS/Azure/GCP). • Contributions to open source deep learning frameworks.

Benefits

• Equity and benefits