Software Engineer, LLM Inference - Shanghai, Shanghai

NVIDIA has continuously reinvented itself over two decades. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next e ...

NVIDIA has continuously reinvented itself over two decades. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next e ...

NVIDIA has continuously reinvented itself over two decades. · ...

+ As a Senior Member of Technical Staff, you will be a technical leader in Large Language Model (LLM) inference and kernel optimization for AMD GPUs. · + You will play a critical role in advancing high-performance LLM serving by optimizing GPU kernels, inference runtimes, and di ...

Join NVIDIA, a leader in advancing computer graphics, PC gaming, and accelerated computing for over 25 years. As an LLM Inference Software Engineer, you will be at the forefront of innovative AI technology, working on the ground-breaking TRTLLM project. This role offers you the e ...

Join NVIDIA a leader in advancing computer graphics PC gaming and accelerated computing for over 25 years. · You will develop and optimize software solutions to accelerate LLM inference using GPU technology. · ...

We are now looking for Computer Architecture Interns in our group · The NVIDIA Architecture group is looking for world class architects and computer science interns to join and lead our various architecture efforts. A key part of NVIDIA's strength is to innovate in the graphics a ...

AI Vision Processors For Edge Applications · Our solutions make cameras smarter by extracting valuable data from high-resolution video streams. · Job Description · LLM model porting and inference SW framework. · Integrate Amba's LLM SW stack with popular open source framework, li ...

We are now looking for Computer Architecture Interns in our group to innovate in the graphics and parallel computing fields delivering the highest performance in the world for parallel processing algorithms. · ...

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of ...

NVIDIA is developing processor and system architectures that accelerate deep learning and high-performance computing applications. We are looking for an intern deep learning system performance architect to join our AI performance modelling, analysis and optimization efforts. In t ...

NVIDIA is looking for a passionate talent to work in its Compute Developer Technology (DevTech) team. In this role, you will research and develop techniques to GPU-accelerate leading applications in high performance computing fields within machine and deep learning, scientific co ...

+We are seeking a Senior Member of Technical Staff to join our team as a technical leader in Large Language Model (LLM) inference and kernel optimization for AMD GPUs. · +Optimize LLM Inference Frameworks Drive performance improvements in LLM inference frameworks such as vLLM, SG ...

NVIDIA is developing processor and system architectures that accelerate deep learning and high-performance computing applications. We are looking for an intern deep learning system performance architect to join our AI performance modelling, analysis and optimization efforts. In t ...

NVIDIA is developing processor and system architectures that accelerate deep learning and high-performance computing applications. We are looking for an expert deep learning system performance architect to join our AI performance modelling, analysis and optimization efforts. In t ...

We are seeking a talented Machine Learning Kernel Developer to design, develop, and optimize low-level machine learning kernels for AMD GPUs using the ROCm software stack. · Design and implement highly optimized ML kernels (e.g., matrix operations, attention mechanisms) for AMD G ...

NVIDIA is looking for a passionate, world-class computer scientist to work in its Compute Developer Technology (DevTech) team. In this role, you will research and develop techniques to GPU-accelerate leading applications in high performance computing fields within machine and dee ...

NVIDIA is now looking for LLM Train Framework Engineers for the Megatron Core team. · Build and develop open source Megatron Core. · Address extensive AI training and inference obstacles... · ...

NVIDIA is leading company of AI computing. At NVIDIA our employees are passionate about AI HPC VISUAL GAMING Our SA team is more focusing to bring NVIDIA new technology into difference industries We help to design the architecture of AI computing platform analysis the AI and HPC ...

NVIDIA is now looking for LLM Train Framework Engineers for the Megatron Core team. Megatron Core is open-source, scalable, and cloud-native frameworks built for researchers and developers working on Large Language Models (LLM) and Multimodal (MM) foundation model pretraining and ...