-
Data ScienceBoosting CUDA Efficiency with Essential Techniques for New Developers
-
Data Center / CloudNVIDIA Blackwell Platform Sets New LLM Inference Records in MLPerf Inference v4.1
-
Generative AILow Latency Inference Chapter 1: Up to 1.9x Higher Llama 3.1 Performance with Medusa on NVIDIA HGX H200 with NVLink Switch
-
Generative AIDeploy Diverse AI Apps with Multi-LoRA Support on RTX AI PCs and Workstations
-
Top StoriesNVIDIA Launches NIM Agent Blueprints for Generative AI
Recent
![GIF of an image changing in response to the prompt.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/fast-inversion-real-time-editing-featured.gif)
Aug 30, 2024
Fast Inversion for Real-Time Image Editing with Text
Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. They operate by mapping a random sample from a...
8 MIN READ
![An overhead view of a manufacturing line with multiple large robot arms in a cavernous warehouse.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/predictive-maintenance-rapids-factory-featured-960x540.png)
Aug 30, 2024
Accelerating Predictive Maintenance in Manufacturing with RAPIDS AI
The International Society of Automation (ISA) reports that 5% of plant production is lost annually due to downtime. Putting that into a different context,...
12 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/clicoh-package-delivery-960x540.jpg)
Aug 29, 2024
Spotlight: clicOH Accelerates Last-Mile Delivery 20x with NVIDIA cuOpt
Driven by shifts in consumer behavior and the pandemic, e-commerce continues its explosive growth and transformation. As a result, logistics and transportation...
3 MIN READ
![An illustration representing CUDA.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/CUDA-efficiency-960x540.jpg)
Aug 29, 2024
Boosting CUDA Efficiency with Essential Techniques for New Developers
To fully harness the capabilities of NVIDIA GPUs, optimizing NVIDIA CUDA performance is essential, particularly for developers new to GPU programming. This talk...
2 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/NVIDIA-RAPIDS-logo-960x540.png)
Aug 29, 2024
Just Released: RAPIDS 24.08
RAPIDS 24.08 is now available with significant updates geared towards processing larger workloads and seamless CPU/GPU interoperability.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/llama-sunglasses-meadow-960x540.jpg)
Aug 28, 2024
Boosting Llama 3.1 405B Performance up to 1.44x with NVIDIA TensorRT Model Optimizer on NVIDIA H200 GPUs
The Llama 3.1 405B large language model (LLM), developed by Meta, is an open-source community model that delivers state-of-the-art performance and supports a...
7 MIN READ
![GIF shows multiple photos and images selected within the photos according to a prompt, such as "person with glasses" or "tallest cat."](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/3386650_Metropolis_IVA_TAO_5-5_Auto-labeling_v02.gif)
Aug 28, 2024
New Foundational Models and Training Capabilities with NVIDIA TAO 5.5
NVIDIA TAO is a framework designed to simplify and accelerate the development and deployment of AI models. It enables you to use pretrained models, fine-tune...
13 MIN READ
![Decorative image.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/triton-inference-service-featured-960x540.jpg)
Aug 28, 2024
NVIDIA Triton Inference Server Achieves Outstanding Performance in MLPerf Inference 4.1 Benchmarks
Six years ago, we embarked on a journey to develop an AI inference serving solution specifically designed for high-throughput and time-sensitive production use...
8 MIN READ
![Decorative image of a person looking at a laptop with an overlay of the NVIDIA NIM logo.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/nvidia-nim-blueprints-featured-960x540.jpg)
Aug 28, 2024
Build an Enterprise-Scale Multimodal Document Retrieval Pipeline with NVIDIA NIM Agent Blueprint
Trillions of PDF files are generated every year, each file likely consisting of multiple pages filled with various content types, including text, images,...
8 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/nvidia-blackwell-960x540.jpg)
Aug 28, 2024
NVIDIA Blackwell Platform Sets New LLM Inference Records in MLPerf Inference v4.1
Large language model (LLM) inference is a full-stack challenge. Powerful GPUs, high-bandwidth GPU-to-GPU interconnects, efficient acceleration libraries, and a...
13 MIN READ
![Image of an HGX H200](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/HGX-H200-tech-blog-1920x1080-1-960x540.jpg)
Aug 28, 2024
Low Latency Inference Chapter 1: Up to 1.9x Higher Llama 3.1 Performance with Medusa on NVIDIA HGX H200 with NVLink Switch
As large language models (LLMs) continue to grow in size and complexity, multi-GPU compute is a must-have to deliver the low latency and high throughput that...
5 MIN READ
![An illustration depicting AI model deployment steps.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/Multi-LoRA-Support-960x540.jpg)
Aug 28, 2024
Deploy Diverse AI Apps with Multi-LoRA Support on RTX AI PCs and Workstations
Today’s large language models (LLMs) achieve unprecedented results across many use cases. Yet, application developers often need to customize and tune these...
10 MIN READ
Generative AI
![GIF of an image changing in response to the prompt.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/fast-inversion-real-time-editing-featured.gif)
Aug 30, 2024
Fast Inversion for Real-Time Image Editing with Text
Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. They operate by mapping a random sample from a...
8 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/llama-sunglasses-meadow-960x540.jpg)
Aug 28, 2024
Boosting Llama 3.1 405B Performance up to 1.44x with NVIDIA TensorRT Model Optimizer on NVIDIA H200 GPUs
The Llama 3.1 405B large language model (LLM), developed by Meta, is an open-source community model that delivers state-of-the-art performance and supports a...
7 MIN READ
![Decorative image.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/triton-inference-service-featured-960x540.jpg)
Aug 28, 2024
NVIDIA Triton Inference Server Achieves Outstanding Performance in MLPerf Inference 4.1 Benchmarks
Six years ago, we embarked on a journey to develop an AI inference serving solution specifically designed for high-throughput and time-sensitive production use...
8 MIN READ
![Decorative image of a person looking at a laptop with an overlay of the NVIDIA NIM logo.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/nvidia-nim-blueprints-featured-960x540.jpg)
Aug 28, 2024
Build an Enterprise-Scale Multimodal Document Retrieval Pipeline with NVIDIA NIM Agent Blueprint
Trillions of PDF files are generated every year, each file likely consisting of multiple pages filled with various content types, including text, images,...
8 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/nvidia-blackwell-960x540.jpg)
Aug 28, 2024
NVIDIA Blackwell Platform Sets New LLM Inference Records in MLPerf Inference v4.1
Large language model (LLM) inference is a full-stack challenge. Powerful GPUs, high-bandwidth GPU-to-GPU interconnects, efficient acceleration libraries, and a...
13 MIN READ
![Image of an HGX H200](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/HGX-H200-tech-blog-1920x1080-1-960x540.jpg)
Aug 28, 2024
Low Latency Inference Chapter 1: Up to 1.9x Higher Llama 3.1 Performance with Medusa on NVIDIA HGX H200 with NVLink Switch
As large language models (LLMs) continue to grow in size and complexity, multi-GPU compute is a must-have to deliver the low latency and high throughput that...
5 MIN READ
![An illustration depicting AI model deployment steps.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/Multi-LoRA-Support-960x540.jpg)
Aug 28, 2024
Deploy Diverse AI Apps with Multi-LoRA Support on RTX AI PCs and Workstations
Today’s large language models (LLMs) achieve unprecedented results across many use cases. Yet, application developers often need to customize and tune these...
10 MIN READ
![Workflow diagram on a black backgound.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/laika-rag-pipeline-featured-960x540.png)
Aug 27, 2024
Enhancing RAG Applications with NVIDIA NIM
The advent of large language models (LLMs) has significantly benefited the AI industry, offering versatile tools capable of generating human-like text and...
10 MIN READ
![image of a digital human, drug discover and pdf workflow](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/genai-press-ai-workflows-pr-1920x1080-11-960x540.jpg)
Aug 27, 2024
NVIDIA Launches NIM Agent Blueprints for Generative AI
Now available—NIM Agent Blueprints for digital humans, multimodal PDF data extraction, and drug discovery.
1 MIN READ
![An image of solar panels.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/Sustainable-Infrastructure-AI-960x540.jpg)
Aug 26, 2024
LLM Research Rewrites the Role of AI in Safeguarding Sustainable Systems
Large language models (LLMs) are emerging as a tool for safeguarding critical infrastructure systems, such as renewable energy, healthcare, or transportation,...
3 MIN READ
![The word PLAY spelled out in wooden blocks on a blue background with a real hand and finger pressing a play button on a block at the end of the word.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/ai-workbench-windows-featured-960x540.jpg)
Aug 26, 2024
NVIDIA AI Workbench Simplifies Using GPUs on Windows
NVIDIA AI Workbench is a free, user-friendly development environment manager that streamlines data science, ML, and AI projects on your system of choice: PC,...
8 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/abstract-geometric-field.jpg)
Aug 22, 2024
Jamba 1.5 LLMs Leverage Hybrid Architecture to Deliver Superior Reasoning and Long Context Handling
AI21 Labs has unveiled their latest and most advanced Jamba 1.5 model family, a cutting-edge collection of large language models (LLMs) designed to excel in a...
4 MIN READ
AI Foundation Models
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/community-ai-model-graphic-960x540.jpg)
Aug 21, 2024
Mistral-NeMo-Minitron 8B Foundation Model Delivers Unparalleled Accuracy
Last month, NVIDIA and Mistral AI unveiled Mistral NeMo 12B, a leading state-of-the-art large language model (LLM). Mistral NeMo 12B consistently outperforms...
5 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/robot-in-kitchen-nine-scenes-960x540.png)
Jul 29, 2024
Fast-Track Robot Learning in Simulation Using NVIDIA Isaac Lab
Robots need to be adaptable, readily learning new skills and adjusting to their surroundings. Yet traditional training methods can limit a robot’s ability to...
7 MIN READ
![Decorative image of a model with multiple apps.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/05/steerlm-purple-blog-1280x680-1-960x540.jpg)
Jul 26, 2024
Power Text-Generation Applications with Mistral NeMo 12B Running on a Single GPU
NVIDIA collaborated with Mistral to co-build the next-generation language model that achieves leading performance across benchmarks in its class. With a growing...
6 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/abstract-chart-960x540.jpg)
Jun 28, 2024
Transforming Financial Analysis with NVIDIA NIM
In financial services, portfolio managers and research analysts diligently sift through vast amounts of data to gain a competitive edge in investments. Making...
13 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/medical-imaging-sdg-1-960x540.jpg)
Jun 24, 2024
Addressing Medical Imaging Limitations with Synthetic Data Generation
Synthetic data in medical imaging offers numerous benefits, including the ability to augment datasets with diverse and realistic images where real data is...
9 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/Solar_Quicklink-960x540.jpeg)
Jun 10, 2024
SOLAR-10.7B: Optimized Model Tailored Instruction Following, Reasoning, and Mathematical Tasks
Enhance efficiency and performance in instruction-based NLP tasks with SOLAR-10.7B, especially in following instructions, reasoning, and mathematical tasks.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/Breeze_API-NVIDIA-featured-960x540.jpg)
Jun 03, 2024
Breeze-7B: LLM Specialized for Traditional Chinese
The model demonstrates strong performance for tasks such as Q&A, multi-round chat, and summarization in both traditional Chinese and English.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/BGE_APICatalog-NVIDIA-featured-960x540.jpg)
Jun 03, 2024
BGE-M3: Advanced Multilingual Text Retrieval Model
Experience the versatile embedding model designed for multilingual, multi-functional, and multi-granularity text retrieval tasks, excelling in dense,...
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/05/NVIDIA-CodeGemma-foundation-model-960x540.jpeg)
May 30, 2024
Convert Natural Language to Code with CodeGemma
Experience the advanced LLM API for code generation, completion, mathematical reasoning, and instruction following with free cloud credits.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/05/IMG_2317-960x540.png)
May 14, 2024
Generate Text Responses from Visual and Text Inputs with Google's New PaliGemma Model
With free NVIDIA cloud credits, you can start testing the model at scale on the API Catalog.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/05/steerlm-purple-green-graphic-1-960x540.jpg)
May 13, 2024
Regional LLMs SEA-LION and SeaLLM Serve Languages and Cultures of Southeast Asia
At the recent World Governments Summit in Dubai, NVIDIA CEO Jensen Huang emphasized the importance of sovereign AI, which refers to a nation’s capability to...
3 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/04/llm-graphic-960x540.jpg)
Apr 30, 2024
Leverage Mixture of Experts-Based DBRX for Superior LLM Performance on Diverse Tasks
This week’s model release features DBRX, a state-of-the-art large language model (LLM) developed by Databricks. With demonstrated strength in programming and...
3 MIN READ
Simulation / Modeling / Design
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/clicoh-package-delivery-960x540.jpg)
Aug 29, 2024
Spotlight: clicOH Accelerates Last-Mile Delivery 20x with NVIDIA cuOpt
Driven by shifts in consumer behavior and the pandemic, e-commerce continues its explosive growth and transformation. As a result, logistics and transportation...
3 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/warehouse-with-overlay-960x540.png)
Aug 27, 2024
Simplifying Camera Calibration to Enhance AI-Powered Multi-Camera Tracking
This post is the third in a series on building multi-camera tracking vision AI applications. We introduce the overall end-to-end workflow and fine-tuning...
12 MIN READ
![10 coreset representation of a 1K dataset with coresets as smaller and larger stars according to weight.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/cuda-q-big-data-featured-960x540.png)
Aug 26, 2024
CUDA-Q Enabled Resource Reduction for Quantum Clustering Algorithms
Quantum computers can use the quantum properties of superposition, entanglement, and interference to generalize learnings and insights from data. Such quantum...
7 MIN READ
![Still from the MechaBREAK game.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/mechabreak-featured-960x540.jpg)
Aug 20, 2024
Deploy the First On-Device Small Language Model for Improved Game Character Roleplay
At Gamescom 2024, NVIDIA announced our first on-device small language model (SLM) for improving the conversation abilities of game characters. We also announced...
4 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/holoscan-media-video-960x540.jpg)
Aug 14, 2024
Video: Build Live Media Applications for AI-Enabled Infrastructure with NVIDIA Holoscan for Media
NVIDIA Holoscan for Media is a software-defined, AI-enabled platform that enables live video pipelines to run on the same infrastructure as AI. This video...
1 MIN READ
![Decorative image of light fields in green, purple, and blue.](https://developer-blogs.nvidia.com/wp-content/uploads/2023/12/hpc-featured-960x540.jpg)
Aug 08, 2024
Improving GPU Performance by Reducing Instruction Cache Misses
GPUs are specially designed to crunch through massive amounts of data at high speed. They have a large amount of compute resources, called streaming...
11 MIN READ
![Image of a quantum circuit diagram.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/quantumcircuit-1-960x540.png)
Aug 08, 2024
Performant Quantum Programming Even Easier with NVIDIA CUDA-Q v0.8
NVIDIA CUDA-Q (formerly NVIDIA CUDA Quantum) is an open-source programming model for building hybrid-quantum classical applications that take full advantage of...
7 MIN READ
![Decorative image of a profit/loss graph.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/quant-finance-iso-c-plus-plus-featured-960x540.png)
Aug 07, 2024
Profit and Loss Modeling on GPUs with ISO C++ Language Parallelism
The previous post How to Accelerate Quantitative Finance with ISO C++ Standard Parallelism demonstrated how to write a Black-Scholes simulation using ISO C++...
10 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/05/cuda-graphic-960x540.jpg)
Aug 01, 2024
Just Released: CUDA Toolkit 12.6
The release supports GB100 capabilities and new library enhancements to cuBLAS, cuFFT, cuSOLVER, cuSPARSE, as well as the release of Nsight Compute 2024.3.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/HPC_SW_KV-960x540.jpg)
Aug 01, 2024
Just Released: NVIDIA HPC SDK v24.7
The new release delivers support for Ubuntu 24.04, new Fortran interfaces for CUDA Graphs, and a major version NVSHMEM API update. It is the last release to...
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/NVIDIA-Modulus-QL-960x540.jpg)
Jul 30, 2024
Just Released: NVIDIA Modulus v24.07
NVIDIA Modulus 24.07 brings new GNN enhancements and application samples for training with large meshes.
1 MIN READ
![Weather forecasts running multiple simulations over the same forecast horizon.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/energy-trading-featured-960x540.png)
Jul 30, 2024
Empowering Energy Trading with MetDesk and NVIDIA Earth-2
Despite the continuous improvement of weather forecasts over the last few decades, uncertainties due to meteorological measurements and models mean that...
13 MIN READ
Robotics
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/warehouse-with-overlay-960x540.png)
Aug 27, 2024
Simplifying Camera Calibration to Enhance AI-Powered Multi-Camera Tracking
This post is the third in a series on building multi-camera tracking vision AI applications. We introduce the overall end-to-end workflow and fine-tuning...
12 MIN READ
![Decorative image of icons and a molecular structure in green.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/via-microservices-featured-960x540.png)
Jul 29, 2024
Build VLM-Powered Visual AI Agents Using NVIDIA NIM and NVIDIA VIA Microservices
Traditional video analytics applications and their development workflow are typically built on fixed-function, limited models that are designed to detect and...
10 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/robot-in-kitchen-nine-scenes-960x540.png)
Jul 29, 2024
Fast-Track Robot Learning in Simulation Using NVIDIA Isaac Lab
Robots need to be adaptable, readily learning new skills and adjusting to their surroundings. Yet traditional training methods can limit a robot’s ability to...
7 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/isaac-robotics-social-autonomous-docking-nav2-for-ros-1480x830-1-960x540.png)
Jul 18, 2024
Webinar: Improving Robot Uptime Featuring Nav2 Autonomous Docking with NVIDIA Isaac ROS
Join Isaac ROS engineers and the founder of Open Navigation to explore the new Nav2 autonomous docking feature.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/robotic-arm-mechanical-parts-960x540.png)
Jul 11, 2024
Training Sim-to-Real Transferable Robotic Assembly Skills over Diverse Geometries
Most objects in home and industrial settings consist of multiple parts that must be assembled. While human workers typically perform assembly, in certain...
10 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/power-grid-representation-960x540.png)
Jul 11, 2024
Spotlight: Siemens Energy Accelerates Power Grid Asset Simulation 10,000x Using NVIDIA Modulus
The world’s energy system is increasingly complex and distributed due to increasing renewable energy generation, decentralization of energy resources, and...
9 MIN READ
![Decorative image of workflow steps.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/mtmc-e2e-workflow-featured-960x540.png)
Jul 10, 2024
Enhance Multi-Camera Tracking Accuracy by Fine-Tuning AI Models with Synthetic Data
Large-scale, use–case-specific synthetic data has become increasingly important in real-world computer vision and AI workflows. That’s because digital twins...
14 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/Orca-AI-UI-960x540.png)
Jun 25, 2024
AI-Enhanced Navigation Charts Safer Waters for Massive Ships
Maritime startup Orca AI is pioneering safety at sea with its AI-powered navigation system, which provides real-time video processing to help crews make...
5 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/newsletter-isaac-robotics-computex24-3261843-600x338-1.gif)
Jun 24, 2024
Real-Time Vision AI From Digital Twins to Cloud-Native Deployment with NVIDIA Metropolis Microservices and NVIDIA Isaac Sim
As vision AI complexity increases, streamlined deployment solutions are crucial to optimizing spaces and processes. NVIDIA accelerates development, turning...
13 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/image6-960x540.png)
Jun 17, 2024
Closing the Sim-to-Real Gap: Training Spot Quadruped Locomotion with NVIDIA Isaac Lab
Developing effective locomotion policies for quadrupeds poses significant challenges in robotics due to the complex dynamics involved. Training quadrupeds to...
12 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/isaac-robotics-robot-arms.gif)
Jun 17, 2024
Supercharge Robotics Workflows with AI and Simulation Using NVIDIA Isaac Sim 4.0 and NVIDIA Isaac Lab
The era of AI robots powered by physical AI has arrived. Physical AI models understand their environments and autonomously complete complex tasks in the...
11 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/group-working-with-laptop-960x540.jpg)
Jun 14, 2024
Level Up Your Skills with Five New NVIDIA Technical Courses
With AI introducing an unprecedented pace of technological innovation, staying ahead means keeping your skills up to date. The NVIDIA Developer Program gives...
4 MIN READ
Computer Vision / Video Analytics
![GIF of an image changing in response to the prompt.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/fast-inversion-real-time-editing-featured.gif)
Aug 30, 2024
Fast Inversion for Real-Time Image Editing with Text
Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. They operate by mapping a random sample from a...
8 MIN READ
![GIF shows multiple photos and images selected within the photos according to a prompt, such as "person with glasses" or "tallest cat."](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/3386650_Metropolis_IVA_TAO_5-5_Auto-labeling_v02.gif)
Aug 28, 2024
New Foundational Models and Training Capabilities with NVIDIA TAO 5.5
NVIDIA TAO is a framework designed to simplify and accelerate the development and deployment of AI models. It enables you to use pretrained models, fine-tune...
13 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/warehouse-with-overlay-960x540.png)
Aug 27, 2024
Simplifying Camera Calibration to Enhance AI-Powered Multi-Camera Tracking
This post is the third in a series on building multi-camera tracking vision AI applications. We introduce the overall end-to-end workflow and fine-tuning...
12 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/Siggraph24-New-Graphic-VIA-Microservices-Tech-Blog-3364326pn_-1920x1080-1-960x540.png)
Aug 19, 2024
Webinar: Build Visual AI Agents With Generative AI and NVIDIA NIM
Learn how to build high-performance solutions with NVIDIA visual AI agents that help streamline operations across a range of industries.
1 MIN READ
![A GIF of a person using SPICA.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/SPICA-touchscreen-demo.gif)
Aug 12, 2024
Interactive AI Tool Delivers Immersive Video Content to Blind and Low-Vision Viewers
New research aims to revolutionize video accessibility for blind or low-vision (BLV) viewers with an AI-powered system that gives users the ability to explore...
4 MIN READ
![An aerial view of a shark swimming.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/SharkEye-demo.gif)
Aug 06, 2024
​​Real-Time AI Shark Detection is Boosting Beach Safety
California beaches are becoming safer with a new AI-powered shark detection system. Known as SharkEye, the technology identifies sharks near shorelines in real...
2 MIN READ
![Decorative image of icons and a molecular structure in green.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/via-microservices-featured-960x540.png)
Jul 29, 2024
Build VLM-Powered Visual AI Agents Using NVIDIA NIM and NVIDIA VIA Microservices
Traditional video analytics applications and their development workflow are typically built on fixed-function, limited models that are designed to detect and...
10 MIN READ
![Three CT scan segments on a black background.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/monai-vista3d-nim-featured.jpg)
Jul 26, 2024
Computed Tomography Organ and Disease Segmentation Using the NVIDIA VISTA-3D NIM Microservice
Over 300M computed tomography (CT) scans are performed globally, 85M in the US alone. Radiologists are looking for ways to speed up their workflow and generate...
9 MIN READ
![An illustration representing an AI model.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/visual-ai-agent-960x540.png)
Jul 17, 2024
Develop Generative AI-Powered Visual AI Agents for the Edge
An exciting breakthrough in AI technology—Vision Language Models (VLMs)—offers a more dynamic and flexible method for video analysis. VLMs enable users to...
9 MIN READ
![Decorative image of workflow steps.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/mtmc-e2e-workflow-featured-960x540.png)
Jul 10, 2024
Enhance Multi-Camera Tracking Accuracy by Fine-Tuning AI Models with Synthetic Data
Large-scale, use–case-specific synthetic data has become increasingly important in real-world computer vision and AI workflows. That’s because digital twins...
14 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/abstract-graphic.jpg)
Jun 28, 2024
Introducing DoRA, a High-Performing Alternative to LoRA for Fine-Tuning
Full fine-tuning (FT) is commonly employed to tailor general pretrained models for specific downstream tasks. To reduce the training cost, parameter-efficient...
6 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/05/video-compilation-960x540.png)
Jun 26, 2024
Improving Video Quality with the NVIDIA Video Codec SDK 12.2 for HEVC
NVIDIA Video Codec SDK provides a comprehensive set of APIs for hardware-accelerated video encode and decode on Windows and Linux. The 12.2 release improves...
7 MIN READ
Data Science
![An overhead view of a manufacturing line with multiple large robot arms in a cavernous warehouse.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/predictive-maintenance-rapids-factory-featured-960x540.png)
Aug 30, 2024
Accelerating Predictive Maintenance in Manufacturing with RAPIDS AI
The International Society of Automation (ISA) reports that 5% of plant production is lost annually due to downtime. Putting that into a different context,...
12 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/clicoh-package-delivery-960x540.jpg)
Aug 29, 2024
Spotlight: clicOH Accelerates Last-Mile Delivery 20x with NVIDIA cuOpt
Driven by shifts in consumer behavior and the pandemic, e-commerce continues its explosive growth and transformation. As a result, logistics and transportation...
3 MIN READ
![An illustration representing CUDA.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/CUDA-efficiency-960x540.jpg)
Aug 29, 2024
Boosting CUDA Efficiency with Essential Techniques for New Developers
To fully harness the capabilities of NVIDIA GPUs, optimizing NVIDIA CUDA performance is essential, particularly for developers new to GPU programming. This talk...
2 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/NVIDIA-RAPIDS-logo-960x540.png)
Aug 29, 2024
Just Released: RAPIDS 24.08
RAPIDS 24.08 is now available with significant updates geared towards processing larger workloads and seamless CPU/GPU interoperability.
1 MIN READ
![The word PLAY spelled out in wooden blocks on a blue background with a real hand and finger pressing a play button on a block at the end of the word.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/ai-workbench-windows-featured-960x540.jpg)
Aug 26, 2024
NVIDIA AI Workbench Simplifies Using GPUs on Windows
NVIDIA AI Workbench is a free, user-friendly development environment manager that streamlines data science, ML, and AI projects on your system of choice: PC,...
8 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/rapids-cudf-pandas-acceleration-graphic-1-960x540.png)
Aug 21, 2024
Build Efficient Recommender Systems with Co-Visitation Matrices and RAPIDS cuDF
Recommender systems play a crucial role in personalizing user experiences across various platforms. These systems are designed to predict and suggest items that...
12 MIN READ
![Illustration representing AI Workbench.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/03/ai-workbench-960x540.png)
Aug 20, 2024
Hackathon: Build Groundbreaking Generative AI Projects Using NVIDIA AI Workbench
Hosted by Dell and NVIDIA, demonstrate how AI Workbench can be used to build and deliver apps for a wide range of tasks and workflows.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/Bringing-Confidentiality-to-Vector-Search-with-Cyborg-and-RAPIDS-cuVS-960x540.jpg)
Aug 15, 2024
Bringing Confidentiality to Vector Search with Cyborg and RAPIDS cuVS
In the era of generative AI, vector databases have become indispensable for storing and querying high-dimensional data efficiently. However, like all databases,...
7 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/laptop-data-science-960x540.png)
Aug 09, 2024
RAPIDS cuDF Unified Memory Accelerates pandas up to 30x on Large Datasets
NVIDIA has released RAPIDS cuDF unified memory and text data processing features that help data scientists continue to use pandas when working with larger and...
6 MIN READ
![Decorative image of light fields in green, purple, and blue.](https://developer-blogs.nvidia.com/wp-content/uploads/2023/12/hpc-featured-960x540.jpg)
Aug 08, 2024
Improving GPU Performance by Reducing Instruction Cache Misses
GPUs are specially designed to crunch through massive amounts of data at high speed. They have a large amount of compute resources, called streaming...
11 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/05/cuda-graphic-960x540.jpg)
Aug 01, 2024
Just Released: CUDA Toolkit 12.6
The release supports GB100 capabilities and new library enhancements to cuBLAS, cuFFT, cuSOLVER, cuSPARSE, as well as the release of Nsight Compute 2024.3.
1 MIN READ
![A data curator designed for dataset preparation and enhanced LLM performance.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/llm-nemo-data-curator-featured-960x540.png)
Jul 31, 2024
Curating Custom Datasets for LLM Parameter-Efficient Fine-Tuning with NVIDIA NeMo Curator
In a recent post, we discussed how to use NVIDIA NeMo Curator to curate custom datasets for pretraining or continuous training use cases of large language...
11 MIN READ
Content Creation / Rendering
![GIF of an image changing in response to the prompt.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/fast-inversion-real-time-editing-featured.gif)
Aug 30, 2024
Fast Inversion for Real-Time Image Editing with Text
Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. They operate by mapping a random sample from a...
8 MIN READ
![Still from the MechaBREAK game.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/mechabreak-featured-960x540.jpg)
Aug 20, 2024
Deploy the First On-Device Small Language Model for Improved Game Character Roleplay
At Gamescom 2024, NVIDIA announced our first on-device small language model (SLM) for improving the conversation abilities of game characters. We also announced...
4 MIN READ
![Image showing side by side comparison of person on webcam. Left side has the input with the user gazing off screen, the right side has the user’s background replaced with a scene of mountains and the user’s eyes are focused on the camera.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/maxine-videorequest-featured-960x540.png)
Aug 12, 2024
Elevating Video Communication with the NVIDIA Maxine AI Developer Platform and VideoRequest
Effective video communication is important for everyone who communicates online. For businesses, educators, and content creators, it is vital. NVIDIA Maxine is...
5 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/kitchen-scene-960x540.png)
Jul 31, 2024
Shader Debugging Made Easy with NVIDIA Nsight Graphics
Shaders are specialized programs that run on the GPU that manipulate rays, pixels, vertices, and textures to achieve unique visual effects. With shaders, you...
8 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/street-scene-various-stages-gif.gif)
Jul 29, 2024
Building Spatial Intelligence from Real-World 3D Data Using Deep-Learning Framework fVDB
Generative physical AI models can understand and execute actions with fine or gross motor skills within the physical world. Understanding and navigating in the...
6 MIN READ
![Person looking at image of themself captured by a camera, and then the shot pans to a smaller display which shows their face in a 3D hologram.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/nvidia-maxine-3d-featured.gif)
Jul 29, 2024
Advancing Telepresence and Next-Generation Digital Human Technology with NVIDIA Maxine
At SIGGRAPH 2024 this week, NVIDIA is showcasing the latest advancements in the NVIDIA Maxine AI developer platform, available through NVIDIA AI...
8 MIN READ
![GIF of a tree, excavator, and purple spiky blog moving.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/kaolin-physics.gif)
Jul 25, 2024
Simulate Elastic Objects in Any Representation with NVIDIA Kaolin Library
Recent advancements in generative AI and multi-view reconstruction have introduced new ways to rapidly generate 3D content. However, to be useful for downstream...
2 MIN READ
![Collage of four photos of a car with different colors and roof storage.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/nv-car-config-4-up-featured-960x540.png)
Jul 24, 2024
Developing Product Configurators with OpenUSD
Developers from advertising agencies to software vendors are empowering global brands to deliver hyperpersonalization for digital experiences and visual...
5 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/siggraph24-training-labs_newsletter-content_600x338.png)
Jul 22, 2024
Gets Hands-On Training at SIGGRAPH 2024
Complimentary trainings on OpenUSD, Digital Humans, LLMs and more with hands-on labs for Full Conference and Experience attendees.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/05/three-views-digital-human-1-960x540.jpg)
Jul 18, 2024
Spotlight: UneeQ Revolutionizes Customer Engagement with AI-Powered Digital Human Technology
With the rise of chatbots and virtual assistants, customer interactions have evolved to embrace the versatility of voice and text inputs. However, integrating...
4 MIN READ
![A GIF showing the creation of a building image with diffusion models.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/AECO-blog-heatherwick-gif-600x338-1.gif)
Jul 10, 2024
Understanding Diffusion Models: An Essential Guide for AEC Professionals
Generative AI, the ability of algorithms to process various types of inputs—such as text, images, audio, video, and code—and generate new content, is...
13 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/05/video-compilation-960x540.png)
Jun 26, 2024
Improving Video Quality with the NVIDIA Video Codec SDK 12.2 for HEVC
NVIDIA Video Codec SDK provides a comprehensive set of APIs for hardware-accelerated video encode and decode on Windows and Linux. The 12.2 release improves...
7 MIN READ
Conversational AI
![An illustration depicting AI model deployment steps.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/Multi-LoRA-Support-960x540.jpg)
Aug 28, 2024
Deploy Diverse AI Apps with Multi-LoRA Support on RTX AI PCs and Workstations
Today’s large language models (LLMs) achieve unprecedented results across many use cases. Yet, application developers often need to customize and tune these...
10 MIN READ
![Workflow diagram on a black backgound.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/laika-rag-pipeline-featured-960x540.png)
Aug 27, 2024
Enhancing RAG Applications with NVIDIA NIM
The advent of large language models (LLMs) has significantly benefited the AI industry, offering versatile tools capable of generating human-like text and...
10 MIN READ
![An illustration of a chatbot.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/llm-chatbot-purple-960x540.jpg)
Aug 21, 2024
Practical Strategies for Optimizing LLM Inference Sizing and Performance
As the use of large language models (LLMs) grows across many applications, such as chatbots and content creation, it's important to understand the process of...
2 MIN READ
![Illustration representing AI Workbench.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/03/ai-workbench-960x540.png)
Aug 20, 2024
Hackathon: Build Groundbreaking Generative AI Projects Using NVIDIA AI Workbench
Hosted by Dell and NVIDIA, demonstrate how AI Workbench can be used to build and deliver apps for a wide range of tasks and workflows.
1 MIN READ
![Still from the MechaBREAK game.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/mechabreak-featured-960x540.jpg)
Aug 20, 2024
Deploy the First On-Device Small Language Model for Improved Game Character Roleplay
At Gamescom 2024, NVIDIA announced our first on-device small language model (SLM) for improving the conversation abilities of game characters. We also announced...
4 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/nvidia-tensorrt-model-optimizer-graphic-960x540.jpg)
Aug 15, 2024
NVIDIA TensorRT Model Optimizer v0.15 Boosts Inference Performance and Expands Model Support
NVIDIA has announced the latest v0.15 release of NVIDIA TensorRT Model Optimizer, a state-of-the-art quantization toolkit of model optimization techniques...
5 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/holoscan-media-video-960x540.jpg)
Aug 14, 2024
Video: Build Live Media Applications for AI-Enabled Infrastructure with NVIDIA Holoscan for Media
NVIDIA Holoscan for Media is a software-defined, AI-enabled platform that enables live video pipelines to run on the same infrastructure as AI. This video...
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/Mistral-Large-2407-960x540.jpeg)
Aug 13, 2024
New NIM Available: Mistral Large 2 Instruct LLM
The new model by Mistral excels at a variety of complex tasks including text summarization, multilingual translation and reasoning, programming, question and...
1 MIN READ
![Image of a person standing in front of an AI kiosk in a retail location.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/langchain-retail-ai-featured-960x540.png)
Aug 07, 2024
Building AI Agents with NVIDIA NIM Microservices and LangChain
NVIDIA NIM, part of NVIDIA AI Enterprise, now supports tool-calling for models like Llama 3.1. It also integrates with LangChain to provide you with a...
3 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/monitor-chat-abstract-graphic-1-960x540.png)
Aug 05, 2024
Securing Generative AI Deployments with NVIDIA NIM and NVIDIA NeMo Guardrails
As enterprises adopt generative AI applications powered by large language models (LLMs), there is an increasing need to implement guardrails to ensure safety...
6 MIN READ
![Image of two people sitting in their cubicles with speech recognition visualizations in the background.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/03/asr-parakeet-model-featured-960x540.jpg)
Aug 05, 2024
Developing Robust Georgian Automatic Speech Recognition with FastConformer Hybrid Transducer CTC BPE
Building an effective automatic speech recognition (ASR) model for underrepresented languages presents unique challenges due to limited data resources. In...
9 MIN READ
![A connected grid of AI applications, optimizing RAG pipelines.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/rag-rerank-featured-960x540.png)
Jul 30, 2024
Enhancing RAG Pipelines with Re-Ranking
In the rapidly evolving landscape of AI-driven applications, re-ranking has emerged as a pivotal technique to enhance the precision and relevance of enterprise...
8 MIN READ
Edge Computing
![GIF shows multiple photos and images selected within the photos according to a prompt, such as "person with glasses" or "tallest cat."](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/3386650_Metropolis_IVA_TAO_5-5_Auto-labeling_v02.gif)
Aug 28, 2024
New Foundational Models and Training Capabilities with NVIDIA TAO 5.5
NVIDIA TAO is a framework designed to simplify and accelerate the development and deployment of AI models. It enables you to use pretrained models, fine-tune...
13 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/Siggraph24-New-Graphic-VIA-Microservices-Tech-Blog-3364326pn_-1920x1080-1-960x540.png)
Aug 19, 2024
Webinar: Build Visual AI Agents With Generative AI and NVIDIA NIM
Learn how to build high-performance solutions with NVIDIA visual AI agents that help streamline operations across a range of industries.
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/doca.png)
Aug 14, 2024
Just Released: DOCA 2.8 Software Framework
The new release includes support for Spectrum-X 1.1 RA and new features for AI Cloud Data Centers.
1 MIN READ
![Decorative image of a profit/loss graph.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/quant-finance-iso-c-plus-plus-featured-960x540.png)
Aug 07, 2024
Profit and Loss Modeling on GPUs with ISO C++ Language Parallelism
The previous post How to Accelerate Quantitative Finance with ISO C++ Standard Parallelism demonstrated how to write a Black-Scholes simulation using ISO C++...
10 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/spiral-3d-object-960x540.gif)
Jul 22, 2024
Spotlight: HP 3D Printing Open Sources AI Surrogates for Additive Manufacturing Using NVIDIA Modulus
An open ecosystem for physics-informed machine learning (physics-ML) fosters innovation and AI engineering applications. Physics-ML embeds into the learning...
7 MIN READ
![Image of a city simulation with a 6G network.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/03/nvidia-aerial-ov-digital-twin-featured-960x540.png)
Jul 19, 2024
Boosting AI-Driven Innovation in 6G with the AI-RAN Alliance, 3GPP, and O-RAN
The pace of 6G research and development is picking up as the 5G era crosses the midpoint of the decade-long cellular generation time frame. In this blog post,...
13 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/isaac-robotics-social-autonomous-docking-nav2-for-ros-1480x830-1-960x540.png)
Jul 18, 2024
Webinar: Improving Robot Uptime Featuring Nav2 Autonomous Docking with NVIDIA Isaac ROS
Join Isaac ROS engineers and the founder of Open Navigation to explore the new Nav2 autonomous docking feature.
1 MIN READ
![An illustration representing an AI model.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/visual-ai-agent-960x540.png)
Jul 17, 2024
Develop Generative AI-Powered Visual AI Agents for the Edge
An exciting breakthrough in AI technology—Vision Language Models (VLMs)—offers a more dynamic and flexible method for video analysis. VLMs enable users to...
9 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/07/operating-room-medical-staff-robotic-arms-1-960x540.png)
Jul 03, 2024
Powering the Future of AI-Enabled Medical Devices with NVIDIA Holoscan and RTI Connext
The demand for real-time insights and autonomous decision-making is growing across industries, and healthcare and medical devices are no exception. Relying on...
8 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/abstract-graphic.jpg)
Jun 28, 2024
Introducing DoRA, a High-Performing Alternative to LoRA for Fine-Tuning
Full fine-tuning (FT) is commonly employed to tailor general pretrained models for specific downstream tasks. To reduce the training cost, parameter-efficient...
6 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/Orca-AI-UI-960x540.png)
Jun 25, 2024
AI-Enhanced Navigation Charts Safer Waters for Massive Ships
Maritime startup Orca AI is pioneering safety at sea with its AI-powered navigation system, which provides real-time video processing to help crews make...
5 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/traffic-heat-map-960x540.png)
Jun 18, 2024
Generate Traffic Insights Using YOLOv8 and NVIDIA JetPack 6.0
Intelligent Transportation Systems (ITS) applications are becoming increasingly valuable and prevalent in modern urban environments. The benefits of using ITS...
11 MIN READ
Data Center / Cloud
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/llama-sunglasses-meadow-960x540.jpg)
Aug 28, 2024
Boosting Llama 3.1 405B Performance up to 1.44x with NVIDIA TensorRT Model Optimizer on NVIDIA H200 GPUs
The Llama 3.1 405B large language model (LLM), developed by Meta, is an open-source community model that delivers state-of-the-art performance and supports a...
7 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/nvidia-blackwell-960x540.jpg)
Aug 28, 2024
NVIDIA Blackwell Platform Sets New LLM Inference Records in MLPerf Inference v4.1
Large language model (LLM) inference is a full-stack challenge. Powerful GPUs, high-bandwidth GPU-to-GPU interconnects, efficient acceleration libraries, and a...
13 MIN READ
![Image of an HGX H200](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/HGX-H200-tech-blog-1920x1080-1-960x540.jpg)
Aug 28, 2024
Low Latency Inference Chapter 1: Up to 1.9x Higher Llama 3.1 Performance with Medusa on NVIDIA HGX H200 with NVLink Switch
As large language models (LLMs) continue to grow in size and complexity, multi-GPU compute is a must-have to deliver the low latency and high throughput that...
5 MIN READ
![Decorative image of networking switches.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/spectrum-x-featured-960x540.png)
Aug 27, 2024
Optimize Large-Scale AI Workloads with NVIDIA Spectrum-X
In today’s rapidly evolving technological landscape, staying ahead of the curve is not just a goal—it's a necessity. The surge of innovations, particularly...
5 MIN READ
![An image of solar panels.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/Sustainable-Infrastructure-AI-960x540.jpg)
Aug 26, 2024
LLM Research Rewrites the Role of AI in Safeguarding Sustainable Systems
Large language models (LLMs) are emerging as a tool for safeguarding critical infrastructure systems, such as renewable energy, healthcare, or transportation,...
3 MIN READ
![The word PLAY spelled out in wooden blocks on a blue background with a real hand and finger pressing a play button on a block at the end of the word.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/ai-workbench-windows-featured-960x540.jpg)
Aug 26, 2024
NVIDIA AI Workbench Simplifies Using GPUs on Windows
NVIDIA AI Workbench is a free, user-friendly development environment manager that streamlines data science, ML, and AI projects on your system of choice: PC,...
8 MIN READ
![NVIDIA and Google logos on a black background.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/partner-press-google-io-promo-1920x1080-1-960x540.jpg)
Aug 21, 2024
Google Cloud Run Adds Support for NVIDIA L4 GPUs, NVIDIA NIM, and Serverless AI Inference Deployments at Scale
Deploying AI-enabled applications and services presents enterprises with significant challenges: Performance is critical as it directly shapes user...
6 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/community-ai-model-graphic-960x540.jpg)
Aug 21, 2024
Mistral-NeMo-Minitron 8B Foundation Model Delivers Unparalleled Accuracy
Last month, NVIDIA and Mistral AI unveiled Mistral NeMo 12B, a leading state-of-the-art large language model (LLM). Mistral NeMo 12B consistently outperforms...
5 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/nvidia-hopper-grace-960x540.jpg)
Aug 20, 2024
NVIDIA GH200 Superchip Delivers Breakthrough Energy Efficiency and Node Consolidation for Apache Spark
With the rapid growth of generative AI, CIOs and IT leaders are looking for ways to reclaim data center resources to accommodate new AI use cases that promise...
8 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/holoscan-media-video-960x540.jpg)
Aug 14, 2024
Video: Build Live Media Applications for AI-Enabled Infrastructure with NVIDIA Holoscan for Media
NVIDIA Holoscan for Media is a software-defined, AI-enabled platform that enables live video pipelines to run on the same infrastructure as AI. This video...
1 MIN READ
![](https://developer-blogs.nvidia.com/wp-content/uploads/2024/06/doca.png)
Aug 14, 2024
Just Released: DOCA 2.8 Software Framework
The new release includes support for Spectrum-X 1.1 RA and new features for AI Cloud Data Centers.
1 MIN READ
![Decorative image of two cartoon llamas in sunglasses.](https://developer-blogs.nvidia.com/wp-content/uploads/2024/08/ngc-genai-llama-visual-featured-960x540.jpg)
Aug 14, 2024
How to Prune and Distill Llama-3.1 8B to an NVIDIA Llama-3.1-Minitron 4B Model
Large language models (LLM) are now a dominant force in natural language processing and understanding, thanks to their effectiveness and versatility. LLMs such...
12 MIN READ