NVIDIA Opens Omniverse Portals With Generative AIs for 3D and RTX Remix
03/01/2023
Animators, creators and developers can use new AI-powered tools to reimagine 3D environments, simulations and the metaverse - the 3D evolution of the internet.
Based on the Universal Scene Description (USD) framework, the NVIDIA Omniverse platform - which enables the development of metaverse applications - is expanding with Blender enhancements and a new suite of experimental generative AI tools for 3D artists.
In a special address at CES, NVIDIA announced these features, as well as Omniverse preinstallation on NVIDIA Studio laptops and thousands of new, free USD assets to help accelerate adoption of 3D workflows.
NVIDIA Studio 3D creators Jeremy Lightcap, Edward McEvenue, Rafi Nizam, Jae Solina, Pekka Varis, Shangyu Wang, Ashley Goldstein collaborate across multiple 3D design tools, time zones and RTX systems with Omniverse.
Plus, a new release for Blender, now available in the Omniverse Launcher, is bringing 3D generative AI capabilities to Blender users everywhere. A new panel lets Blender users easily transfer shape keys and rigged characters. The challenge of reattaching a rigged character's head can now be solved with a one-button operation from Omniverse Audio2Face - an AI-enabled tool that automatically generates realistic facial expressions from an audio file.
Another new panel for scene optimization lets users create USD scenes within their multi-app 3D workflows more easily and in real time.
In addition, Audio2Face, Audio2Gesture and Audio2Emotion - generative AI tools that enable instant 3D character animation - are getting performance updates that make it easier for developers and creators to integrate into their current 3D pipelines.
Creators can generate facial expressions from an audio file using Audio2Face; realistic emotions ranging from happy and excited to sad and regretful with Audio2Emotion; and realistic upper-body movement using Audio2Gesture. These audio-to-animation tools are game-changers for 3D artists, eliminating the need to perform tedious, manual tasks.
AI-assisted creator tools are expanding to even more communities of creative and technical professionals. When NVIDIA Canvas was introduced, it empowered artists to seamlessly generate landscapes and iterate on them with simple brushstrokes and AI. Coming soon, all RTX users will be able to download an update to Canvas that introduces 360 surround images to create and conceptualize panoramic environments and beautiful images. The AI ToyBox, which features extensions derived from NVIDIA Research, enables creators to generate 3D meshes from 2D inputs.
Omniverse's powerful AI tools simplify complex tasks. Creators of all levels can tap into these resources to produce high-quality outputs that meet the growing demands for content and virtual worlds in the metaverse.
The demand for 3D skills is skyrocketing, but learning 3D can be pretty scary to some, and definitely time consuming, said Jae Solina, aka JSFilmz. But these new platform developments not only let creatives and technical professionals continue to work in their favorite 3D tools, but also supercharge their craft and even use AI to assist them in their workflows.
Omniverse Launcher, the portal to download Omniverse content and reference applications, has also been made available to system builders so they can preinstall it, enabling optimized, out-of-the-box experiences for 3D creators on NVIDIA Studio-validated laptops. GIGABYTE and AORUS will be the first laptops launching in 2023 with Omniverse Launcher preinstalled, expanding platform access to a growing number of 3D content creators.
NVIDIA RTX Remix is a free modding platform, built on Omniverse, that enables modders to quickly create and share #RTXON mods for classic games, each with full ray tracing, enhanced materials, NVIDIA DLSS 3 and NVIDIA Reflex. Its release in early access is coming soon. The jaw-dropping Portal with RTX was built with RTX Remix, and to demonstrate how easy it is for modders to turn RTX ON in their mods, we shared RTX Remix with the original creator of Portal: Prelude, an unofficial Portal prequel released in 2008.
Omniverse users can also access thousands of new, free USD assets, including a USD-based NVIDIA RTX Winter World Minecraft experience, and learn to create their own NVIDIA SimReady assets for complex simulation building. Using Omniverse, creators can supercharge their existing workflows using familiar tools such as Autodesk Maya, Autodesk 3ds Max, Blender, Adobe Substance 3D Painter, and more with AI, simulation tools and real-time RTX-accelerated rendering.
All types of 3D creators can take advantage of these new tools to push the boundaries of 3D simulation and virtual world-building. Users can reimagine digital worlds and animate lifelike characters with new depths of creativity through the bridging of audio-to-animation tools, generative AI and the metaverse.
Latest Omniverse Platform Updates The latest updates within Omniverse include:
Early access for the Unity Omniverse Connector is now available.
Blender alpha release, now available in the Omniverse Launcher, enables users to repair geometry, generate automatic UVs and decimate high-resolution CAD data to more usable polycounts.
Audio2Face, Audio2Emotion and Audio2Gesture updates better enable instant, realistic animation of characters, now available in Omniverse Audio2Face and Omniverse Machinima.
NVIDIA Canvas is coming soon to the Omniverse Launcher with new capabilities that enable the creation of 360-degree landscapes with simple brushstrokes. Users can import the environments into 3D apps to test different settings and lighting.
AI
LINK: | https://blogs.nvidia.com/blog/2023/01/03/omniverse-creators-generative... |
See more stories from nvidia |
Most recent headlines
02/01/2025
TV Tech's Top 20 Streaming Stories of 2024
Streaming media's impact on the media and entertainment industry continued to widen in 2024, as more sports rights moved to streaming platforms and the rapi...
02/01/2025
Gray Television is Now Officially Gray Media, Inc.
ATLANTA The board of directors for Gray Television Inc. has unanimously voted to change the company's name to Gray Media, Inc. effective Jan. 1....
02/01/2025
Saving the past of TV and film for the future
Official television and film archives exist to preserve the history and creativity of media. But even these formal institutions do not contain everything that h...
02/01/2025
Rich Welsh appointed SMPTE president
Welsh succeeds Renard Jenkins, who has reached the end of his two-year tenure in the role By Jenny Priestley Published: January 2, 2025 Welsh succeeds Ren...
02/01/2025
Creator Economy Isn't Really Like Film/Show Entertainment
Creator Economy Isn't Really Like Film/Show Entertainment Andy Marken January 1, 2025 0 Comments Come on Barry, you're good at this sort of s...
02/01/2025
Blackmagic Design Announces New Lower Price for Blackmagic Pocket Cinema Camera 4K!
Blackmagic Design Announces New Lower Price for Blackmagic Pocket Cinema Camera ...
02/01/2025
Hollywood Lighting Hacks: Big Looks, Tiny Budget
Hollywood Lighting Hacks: Big Looks, Tiny Budget Sean Alami January 1, 2025 0 Comments Discover how to create stunning Hollywood-style lighting using ...
02/01/2025
RT UNVEILS NEW YEAR SLATE WITH NEW ENTERTAINMENT, LIVE SPORTING ACTION AND GROUND-BREAKING DOCUMENTARIES
A fresh start to 2025 with new faces, familiar voices and plenty of Irish music ...
02/01/2025
GeForce NOW Rings in the New Year With 14 New Games
GeForce NOW is kicking off 2025 by delivering 14 games to the cloud this month, with two available to stream this week so members can get started on their New Y...
01/01/2025
How newsrooms can adapt to evolving audience demands
Marcy Lefkovitz, Dalet SVP product innovation, details the findings of the companys report into the future of newsrooms, including leveraging AI, optimising mul...
31/12/2024
Inside the Archives: Spotlighting Sundance-Supported Alums in the 2025 Sundance Film Festival Program
Rashad Frett shares a moment with Michelle Satter at the 2023 Directors Lab. Pho...
31/12/2024
What's Ahead in 2025? OWC's Larry O'Connor Offers Some Bold Predictions
What's Ahead in 2025? OWC's Larry O'Connor Offers Some Bold Predicti...
31/12/2024
Blackmagic Design Announces New Features for Blackmagic Cloud
Blackmagic Design Announces New Features for Blackmagic Cloud Brie Clayton December 31, 2024 0 Comments New thumbnail icon view, clip metadata inspect...
31/12/2024
5 Features in DaVinci Resolve You're Not Using (But You Should Be)
5 Features in DaVinci Resolve You're Not Using (But You Should Be) Kasia Jarco December 31, 2024 0 Comments In this video we are going to talk abo...
31/12/2024
NFL Christmas Day Games on Netflix Average Over 30 Million Global Viewers
Back to All News NFL Christmas Day Games on Netflix Average Over 30 Million Global Viewers Entertainment 31 December 2024 Global Link copied to clipboard ...
31/12/2024
Squid Game' Season 2 Smashes Top 10 Records as Millions Worldwide Take Part in Fan Activations and Experiences
Back to All News Squid Game' Season 2 Smashes Top 10 Records as Millions W...
30/12/2024
21 Years of Media Development: Lessons, Challenges and Change
Leaving Thomson after 21 years, former Managing Director David Quin reflects on a career spent navigating the shifting sands of global media development. From r...
30/12/2024
Release Rundown: The 100 Sundance-Supported Projects Released in 2024
[Pictured: a still from Love Lies Bleeding, one of the 100 Sundance-supported titles that opened to wider audiences in 2024]...
30/12/2024
Digital Domain Creates Groundbreaking VFX for Venom: The Last Dance, Bringing Klyntar and Knull to Life
Digital Domain Creates Groundbreaking VFX for Venom: The Last Dance, Bringing ...
30/12/2024
Internet Giant GMP Builds Tokyo Virtual Event Space with URSA Broadcast G2
Internet Giant GMP Builds Tokyo Virtual Event Space with URSA Broadcast G2 Brie Clayton December 30, 2024 0 Comments Blackmagic URSA Broadcast G2 and ...
30/12/2024
Renderboxes launches Photon, a no-compromise transportable high-performance workstation for creative professionals
Renderboxes launches Photon, a no-compromise transportable high-performance work...
30/12/2024
Shinobi II Monitor Supports Canon, Sony, Nikon - Touch to Focus with New Feature Update
Shinobi II Monitor Supports Canon, Sony, Nikon - Touch to Focus with New Feature...
30/12/2024
In a Groundbreaking Agreement, VEON and Starlink to Bring Starlink Direct-to-Cell Satellite Connectivity to Kyivstar Customers
30 Dec 2024 In a Groundbreaking Agreement, VEON and Starlink to Bring Starlink ...
30/12/2024
Research Galore From 2024: Recapping AI Advancements in 3D Simulation, Climate Science and Audio Engineering
The pace of technology innovation has accelerated in the past year, most dramati...
29/12/2024
Gyeongnam Culture and Arts Foundation Invests in Ikegami...
Gyeongnam Culture and Arts Foundation (GCAF), an active promotor of cultural and artistic diversity, has chosen Ikegami UHK-X700 camera chains for integration i...
27/12/2024
2024 in Review: Streaming Into Deals and Turmoil
After starting 2024 with hopes that the transition to streaming might finally produce a more stable, profitable businesses, the media and entertainment industry...
27/12/2024
TV Tech's Top Regulatory Stories of 2024
Broadcasters ended the year with hopes and fears about how the federal government will regulate the TV industry in 2025. While the incoming Trump administration...
27/12/2024
Have You Heard? 5 AI Podcast Episodes Listeners Loved in 2024
NVIDIA's AI Podcast gives listeners the inside scoop on the ways AI is transforming nearly every industry. Since the show's debut in 2016, it's gar...
26/12/2024
M&E Not Ready to Fully Embrace AI in 2024
Talking about artificial intelligence in 2024 is akin to talking about the internet in 1994 everyone's excited about it and thinks it will have an enormous ...
26/12/2024
Netflix NFL Christmas Gameday Reaches 65 Million US Viewers
Back to All News Netflix NFL Christmas Gameday Reaches 65 Million US Viewers Entertainment 26 December 2024 GlobalUnited States Link copied to clipboard U...
26/12/2024
Check Out All the Must-See Trailers From Netflix's NFL Christmas Gameday Live
Back to All News Check Out All the Must-See Trailers From Netflix's NFL Chr...
26/12/2024
Beyonc Delivers Epic Gift of a Halftime Performance + "Beyonc Bowl" Is Coming to Netflix Soon!
Back to All News Beyonc Delivers Epic Gift of a Halftime Performance "Beyonc...
26/12/2024
Get in the Game With Squid Game' Season 2 Complete Coverage Guide
Back to All News Get in the Game With Squid Game' Season 2 Complete Coverage Guide Entertainment 26 December 2024 Global Link copied to clipboard Are...
26/12/2024
Cheers to 2024: GeForce NOW Recaps Year of Ultimate Cloud Gaming
This GFN Thursday wraps up another incredible year for cloud gaming. Take a look back at the top games and new features that made 2024 a standout for GeForce NO...
24/12/2024
PARTICIPATE AT SERIES MANIA FORUM 2025
The National Film and Video Foundation (NFVF) is calling for applications from South African film and television filmmakers to be part of the NFVF's delegat...
24/12/2024
FCC Fines Paramount Global $244,952 for Emergency Alert Violations
WASHINGTON, D.C. The Federal Communications Commission Enforcement Bureau said Paramount Global is being fined $244,952 for violations of emergency alerting rul...
24/12/2024
Streamer Carnegie Hall+ Features Holiday Programming and Music
NEW YORK Carnegie Hall's video-streaming channel, Carnegie Hall+, said it will celebrate the holiday season by offering a wide selection of holiday-themed o...
24/12/2024
PlayersTV Acquires Cloud Media Center
LOS ANGELES PlayersTV, an athlete and fan-owned media company, has announced the acquisition of Cloud Media Center, an AI-driven sports adtech and media distrib...
24/12/2024
The Best Playlists of 2024
The Best Playlists of 2024 The top playlists we created in 2024, from dad rock to dembow. By Tara Bellucci December 23, 2024 Image by Kelly Davidson Tak...
24/12/2024
From Generative to Agentic AI, Wrapping the Year's AI Advancements
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
23/12/2024
Broadcast and the IT industry: an inevitable evolution?
At IBC2024, Grass Valley CTO Ian Fletcher told attendees at GV Forum that broadcast is now an IT industry. During our discussions at the show, TVBEurope heard v...
23/12/2024
Cracking creation: Fun facts from Wallace & Gromit: Vengeance Most Fowl
According to co-director Nick Park, the production team embraced technology to help create the iconic duos latest adventure By Jenny Priestley Published: Dec...
23/12/2024
Mapping the great wave: how Lux Aeterna produced data-centric visuals for Tsunami: Race Against Time
VFX house Lux Aeterna used wave height data from the National Oceanic & Atmosphe...
23/12/2024
DAZN acquires Australia's Foxtel in $2.2 billion deal
We are committed to supporting and investing in Foxtel's television and streaming services, across both sports and entertainment, using our world-leading te...
23/12/2024
Looking back at 2024: the industry trends that stood out
From AI to IP, the cloud to virtual production, key industry executives take a look back at some of the biggest trends that impacted the media and entertainment...
23/12/2024
BOOST GRAPHICS THE SPECIALIST INTERNATIONAL GRAPHICS SUBS...
Boost Graphics, the specialist international graphics and virtual production subsidiary of EMG / Gravity Media, the leading force in production and content & me...
23/12/2024
LucidLink Earns TPN Gold Certification to Advance Secure...
LucidLink, the leading storage collaboration platform revolutionizing how global teams work, proudly announces its achievement of the prestigious Trusted Partne...
23/12/2024
Mediagenix Welcomes Bruno Langlais as Business Developmen...
Mediagenix, a leader in software solutions for content strategy, content value management, and content scheduling, announces the appointment of Bruno Langlais a...
23/12/2024
NextGen TV Live Spanish Captions Debut on PMVG Test Bed S...
WCTEPublic Media Venture Group (PMVG) has announced that it is now providing real-time translation of closed captioning from English to Spanish on PMVG's Ne...