Generative AI-powered laptops and PCs are unlocking advancements in gaming, content creation, productivity and development. Today, over 600 Windows apps and games are already running AI locally on more than 100 million GeForce RTX AI PCs worldwide, delivering fast, reliable and low-latency performance.
At Microsoft Ignite, NVIDIA and Microsoft announced tools to help Windows developers quickly build and optimize AI-powered apps on RTX AI PCs, making local AI more accessible. These new tools enable application and game developers to harness powerful RTX GPUs to accelerate complex AI workflows for applications such as AI agents, app assistants and digital humans.
RTX AI PCs Power Digital Humans With Multimodal Small Language Models Meet James, an interactive digital human knowledgeable about NVIDIA and its products. James uses a collection of NVIDIA NIM microservices, NVIDIA ACE and ElevenLabs digital human technologies to provide natural and immersive responses. NVIDIA ACE is a suite of digital human technologies that brings life to agents, assistants and avatars. To achieve a higher level of understanding so that they can respond with greater context-awareness, digital humans must be able to visually perceive the world like humans do.
Enhancing digital human interactions with greater realism demands technology that enables perception and understanding of their surroundings with greater nuance. To achieve this, NVIDIA developed multimodal small language models that can process both text and imagery, excel in role-playing and are optimized for rapid response times.
The NVIDIA Nemovision-4B-Instruct model, soon to be available, uses the latest NVIDIA VILA and NVIDIA NeMo framework for distilling, pruning and quantizing to become small enough to perform on RTX GPUs with the accuracy developers need.
The model enables digital humans to understand visual imagery in the real world and on the screen to deliver relevant responses. Multimodality serves as the foundation for agentic workflows and offers a sneak peek into a future where digital humans can reason and take action with minimal assistance from a user.
NVIDIA is also introducing the Mistral NeMo Minitron 128k Instruct family, a suite of large-context small language models designed for optimized, efficient digital human interactions, coming soon. Available in 8B-, 4B- and 2B-parameter versions, these models offer flexible options for balancing speed, memory usage and accuracy on RTX AI PCs. They can handle large datasets in a single pass, eliminating the need for data segmentation and reassembly. Built in the GGUF format, these models enhance efficiency on low-power devices and support compatibility with multiple programming languages.
Turbocharge Gen AI With NVIDIA TensorRT Model Optimizer for Windows When bringing models to PC environments, developers face the challenge of limited memory and compute resources for running AI locally. And they want to make models available to as many people as possible, with minimal accuracy loss.
Today, NVIDIA announced updates to NVIDIA TensorRT Model Optimizer (ModelOpt) to offer Windows developers an improved way to optimize models for ONNX Runtime deployment.
With the latest updates, TensorRT ModelOpt enables models to be optimized into an ONNX checkpoint for deploying the model within ONNX runtime environments - using GPU execution providers such as CUDA, TensorRT and DirectML.
TensorRT-ModelOpt includes advanced quantization algorithms, such as INT4-Activation Aware Weight Quantization. Compared to other tools such as Olive, the new method reduces the memory footprint of the model and improves throughput performance on RTX GPUs.
During deployment, the models can have up to 2.6x reduced memory footprint compared to FP16 models. This results in faster throughput, with minimal accuracy degradation, allowing them to run on a wider range of PCs.
Learn more about how developers on Microsoft systems, from Windows RTX AI PCs to NVIDIA Blackwell-powered Azure servers, are transforming how users interact with AI on a daily basis.
Most recent headlines
09/12/2024
Dalet, a leading technology and service provider for media-rich organizations, today announced that it has been named an IDC Innovator in the IDC Innovators: ...
19/11/2024
(11:18 AM) Wiesbaden, November 19, 2024. The Supervisory Board of SGL Carbon SE decided in its meeting today to appoint Andreas Klein as Chief Executive Officer...
19/11/2024
The Supervisory Board of SGL Carbon SE decided in its meeting today to appoint A...
19/11/2024
SBS seeks bold new documentaries with Australia Uncovered' call out
19 November, 2024
Media releases
SBS is committing up to $60,000 in development fu...
19/11/2024
During October, audiences in Mexico decreased their streaming usage by 1.1 points compared to the previous month, accounting for 20.4% of TV viewing.
Disclaime...
19/11/2024
In October, changes in the autumn season typically affect television viewing patterns, leading to variations in how people consume video content on TV screens. ...
19/11/2024
Sports and scripted dramas lift broadcast to third consecutive month of growth a...
19/11/2024
NEW YORK Broadcast viewing continued to grow in October, thanks to gains in both sports and drama programming, according to The Gauge, the monthly viewership ...
19/11/2024
SAN DIEGO Sony Electronics has introduced the 28-70mm F2 G Master, its first zoom lens with a constant F2 aperture and the 77th lens in the Sony E-Mount lineup....
19/11/2024
SAN JOSE, Calif. Roku has launched the BET+ Essential ad-supported subscription streaming services on The Roku Channel....
19/11/2024
nxtedition has been selected by BFBS (British Forces Broadcasting Service) to provide its microservices-based production platform, bringing increased efficiency...
19/11/2024
Stornaway.io, the creative technology start-up that turns video into conversations, today announced the release of Stornaway Voyager, an evolution of its popula...
19/11/2024
Test & measurement innovator, Leader Electronics of Europe, has announced that premium provider for worldwide outside broadcasts, TVN LIVE PRODUCTION, has acqui...
19/11/2024
For decades, Berkeley Repertory Theatre has relied on Clear-Com for high-performance communications that ensure precision and coordination during every producti...
19/11/2024
Bitcentral, the premier provider of media solutions for broadcast and digital video, proudly announces the appointment of Bill Bradford to its Board of Director...
19/11/2024
Colombian Television Station Canal 1 Relies on Blackmagic Design from Production...
19/11/2024
New York Production Company Identity Heralds Next Evolution by Welcoming Gloria ...
19/11/2024
Sony Electronics Announces Second-Generation Flagship Alpha 1 II
Brie Clayton November 19, 2024
0 Comments
A Combination of High Resolution, Speed, an...
19/11/2024
The new site expands Harbors dailies capability and includes an HDR grading and screening room
By Matthew Corrigan
Published: November 19, 2024
The new si...
19/11/2024
Ancora suggested Ciena, a networking systems and software company, as a possible suitor. Harmonic chairman Patrick Gallagher sits on the boards of both companie...
19/11/2024
ST. PAUL, Minn. Twin Cities PBS (TPT) said it will premiere Broadcast Wars, an original documentary about local broadcast news in Minneapolis-St. Paul. The pr...
19/11/2024
NEW YORK Nielsen has reached an expanded multiyear agreement for local TV measurement with Charlotte, North Carolina-based station group American Spirit Media....
19/11/2024
BRYAN-COLLEGE STATION, Texas The College of Performance, Visualization and Fine Arts at Texas A&M University has selected Sony Electronics and its equipment and...
19/11/2024
Calls for Harmonic to seek a possible buyer mounted as Ancora Holdings Group and Romanesque Capital Management urged the pay TV technology provider to maximize ...
19/11/2024
Actually Useful AI Video Effects Explained
Kelsey Brannan November 18, 2024
0 Comments
There are so many AI video generator tools out there, and while...
19/11/2024
OpenDrives Introduces Atlas Professional, A New Mid-Tier Data Management Feature...
19/11/2024
The appointment reflects Space42s commitment to building a dynamic market enviro...
19/11/2024
19 Nov 2024
GSMA brings M360 Eurasia to Tashkent in partnership with Beeline Uz...
19/11/2024
IMG Digital Trends Report Released: Second Screen Gives Way to Both Screens? By Ken Kerschbaumer, Editorial Director
Tuesday, November 19, 2024 - 10:31 am
...
19/11/2024
SVG Sit-Down: IMG Digital's Francois Westcombe on Personalization and Unders...
19/11/2024
National Lacrosse League Launches NLL , a Direct-to-Consumer Streaming Service f...
19/11/2024
SVG All-Stars: Rob Hedrick, Senior Director, Production, NHRA The former Oklahoma storm chaser is innovating sports television in ways he never dreamed By Bran...
19/11/2024
Pac-12 Conference Taps Octagon to Lead Media Rights Strategy Conference has commitments from Boise State, Colorado State, Fresno State, Gonzaga, San Diego State...
19/11/2024
2024 Sports Broadcasting Hall of Fame: Tommy Roy, a Passion for Sports and Story...
19/11/2024
Dolby Creator Talks Podcast: Mixing Live Sports in Atmos with Glenn Stilwell By Ken Kerschbaumer, Editorial Director
Tuesday, November 19, 2024 - 2:26 pm
P...
19/11/2024
Sky unveils official trailer for 2024 Christmas special Bad Tidings' starri...
19/11/2024
Back to All News
Netflix and Red Chillies Entertainment Bring a One-of-a-Kind B...
19/11/2024
Back to All News
Netflix Confirms Its Commitment to T rki ye's Creative Ind...
19/11/2024
Back to All News
From Colombia to the World: How One Hundred Years of Solitude ...
19/11/2024
Back to All News
Netflix and Most Valuable Promotions' Jake Paul vs Mike Ty...
19/11/2024
Back to All News
Netflix Showcases New and Returning International Series and Films
(From L to R) Monika Shergill (Netflix Vice President of Content, India),...
19/11/2024
Back to All News
Netflixs Squid Game: Unleashed Arrives December 17
Entertainment
19 November 2024
Global
Link copied to clipboard
Squid Game: Unleashed, ...
19/11/2024
Back to All News
Top 10 Week of Nov. 11: Jake Paul vs. Mike Tyson' Has Kno...
19/11/2024
Scripps Research scientists make annual Highly Cited Researchers list Featured scientists represent a wide range of fields including chemistry, microbiology, im...
19/11/2024
The U.S. Department of Energy oversees national energy policy and production. As...
19/11/2024
Blindboy Boatclub interrogates the legacy of early Irish Christianity in Blindbo...
19/11/2024
Generative AI-powered laptops and PCs are unlocking advancements in gaming, content creation, productivity and development. Today, over 600 Windows apps and gam...
19/11/2024
NVIDIA and Microsoft today unveiled product integrations designed to advance ful...
18/11/2024
(Photo by Suzanne Cordeiro/Shutterstock for Sundance Film Festival)
By Patty Consolazio
If you find it difficult on any level to justify Russia's war on U...
Generative AI-powered laptops and PCs are unlocking advancements in gaming, content creation, productivity and development. Today, over 600 Windows apps and games are already running AI locally on more than 100 million GeForce RTX AI PCs worldwide, delivering fast, reliable and low-latency performance.
