Reality Reimagined: NVIDIA Introduces fVDB to Build Bigger Digital Models of the World
29/07/2024
fVDB is built on top of OpenVDB, the industry-standard library for simulating and rendering sparse volumetric data such as water, fire, smoke and clouds.
Generative physical AI, such as autonomous vehicles and robots that inhabit the real world, need to have spatial intelligence - the ability to understand and operate in 3D space.
Capturing the large scale and super-fine details of the world around us is essential. But converting reality into a virtual representation to train AI is hard.
Raw data for real-world environments can be collected through many different techniques, like neural radiance fields (NeRFs) and lidar. fVDB translates this data into massive, AI-ready environments rendered in real time.
Building on a decade of innovation in the OpenVDB standard, the introduction of fVDB at SIGGRAPH represents a significant leap forward in how industries can benefit from digital twins of the real world.
Reality-scale virtual environments are used for training autonomous agents. City-scale 3D models are captured by drones for climate science and disaster planning. Today, 3D generative AI is even used to plan urban spaces and smart cities.
fVDB enables industries to tap into spatial intelligence on a larger scale and with higher resolution than ever before, making physical AI even smarter.
The framework builds NVIDIA-accelerated AI operators on top of NanoVDB, a GPU-accelerated data structure for efficient 3D simulations. These operators include convolution, pooling, attention and meshing, all of which are designed for high-performance 3D deep learning applications.
AI operators allow businesses to build complex neural networks for spatial intelligence, like large-scale point cloud reconstruction and 3D generative modeling.
fVDB is the result of a long-running effort by NVIDIA's research team and is already used to support NVIDIA Research, NVIDIA DRIVE and NVIDIA Omniverse projects that require high-fidelity models of large, complex real-world spaces.
Key Advantages of fVDB
Larger: 4x larger spatial scale than prior frameworks
Faster: 3.5x faster than prior frameworks
Interoperable: Businesses can fully tap into massive real-world datasets. fVDB reads VDB datasets into full-sized 3D environments. AI-ready and real-time rendered for building physical AI with spatial intelligence.
More powerful: 10x more operators than prior frameworks. fVDB simplifies processes by combining functionalities that previously required multiple deep-learning libraries.
fVDB will soon be available as NVIDIA NIM inference microservices. A trio of the microservices will enable businesses to incorporate fVDB into OpenUSD workflows, generating AI-ready OpenUSD geometry in NVIDIA Omniverse, a development platform for industrial digitalization and generative physical AI applications. They are:
fVDB Mesh Generation NIM - Generates digital 3D environments of the real world
fVDB NeRF-XL NIM - Generates large-scale NeRFs in OpenUSD using Omniverse Cloud APIs
fVDB Physics Super-Res NIM - Performs super-resolution to generate an OpenUSD-based, high-resolution physics simulation
Over the past decade, OpenVDB, housed at the Academy Software Foundation, has earned multiple Academy Awards as a core technology used throughout the visual-effects industry. It has since grown beyond entertainment to industrial and scientific uses, like industrial design and robotics.
NVIDIA continues to enhance the open-source OpenVDB library. Four years ago, the company introduced NanoVDB, which added GPU support to OpenVDB. This delivered an order-of-magnitude speed-up, enabling faster performance and easier development, and opening the door to real-time simulation and rendering.
Two years ago, NVIDIA introduced NeuralVDB, which builds machine learning on top of NanoVDB to compress the memory footprint of VDB volumes up to 100x, allowing creators, developers and researchers to interact with extremely large and complex datasets.
fVDB builds AI operators on top of NanoVDB to unlock spatial intelligence at the scale of reality. Apply to the early-access program for the fVDB PyTorch extension. fVDB will also be available as part of the OpenVDB GitHub repository.
Dive deeper into fVDB in this technical blog and watch how accelerated computing and generative AI are transforming industries and creating new opportunities for innovation and growth in NVIDIA founder and CEO Jensen Huang's two fireside chats at SIGGRAPH.
See notice regarding software product information.
Most recent headlines
09/12/2024
Dalet Named an IDC Innovator in Media and Entertainment
Dalet, a leading technology and service provider for media-rich organizations, today announced that it has been named an IDC Innovator in the IDC Innovators: ...
09/11/2024
Dalet Expands Leadership Team to Fuel Next Stage of Growth
Dalet, a leading technology and service provider for media-rich organizations, today announced three new members of its executive team. Tara Bryant joins as Chi...
18/09/2024
Line up revealed for World's Most Dangerous Roads S6
Johnny Vegas & Lucy Beaumont and Babatunde Al sh & Kae Kurd arethecomedians taking part in brand new episodes of World's Most Dangerous Roads, which return...
18/09/2024
TV channel Gold's Absolutely Fabulous: Inside Out is joined by celebrities Emma Bunton, Meera Syal, Ruby Wax and more
The nation's favourite comedy channel, Gold, is set to take a reflective loo...
18/09/2024
Press Release: ToolsOnAir Wins 2024 OEM & Developer Award from Blackmagic Design at IBC
Press Release: ToolsOnAir Wins 2024 OEM & Developer Award from Blackmagic Design...
18/09/2024
A Different Man Is a Triumph That Lingers Long After Credits Role
Warning: This feature contains spoilers about the film. By Bailey Pennick Aaron Schimberg kept it brief in his introduction before A Different Man had its wor...
18/09/2024
Mi Primer Escenario' ofrece a los artistas emergentes en Mxico la oportunidad de tomar el escenario en MEXCLA Spotify
Apoyar a los artistas emergentes es parte fundamental del ADN de Spotify. Ahora ...
18/09/2024
Mi Primer Escenario' Offers Emerging Mexican Artists a Chance To Perform at MEXCLA Spotify'
Supporting emerging artists is a fundamental part of Spotify's DNA, and we...
18/09/2024
Karmic lessons and laughs with new SBS podcast Comedy Karma'
Karmic lessons and laughs with new SBS podcast Comedy Karma' 18 September, 2024 Media releases Join the ever-curious stand-up comedian Aditya Gautam a...
18/09/2024
Clear-Com Supports the Next Generation of Media Professionals at Rise Academy Summer...
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...
18/09/2024
Nielsen launches Advanced Audiences, enhancing digital campaign precision, reach and effectiveness across Australia and New Zealand
Sydney, September 18, 2024 - Nielsen today announced the launch of Advanced Audi...
18/09/2024
Heartland Video Systems Welcomes Industry Veteran Dan Whe...
Heartland Video Systems (HVS), a premier video systems integration and consulting firm, is proud to announce the appointment of Dan Whealy as Director of Busine...
18/09/2024
Clear-Com Supports the Next Generation of Media Professio...
Clear-Com is proud to have participated in the Rise Academy Summer School 2024, a transformative experience aimed at introducing young people to the dynamic wor...
18/09/2024
Amplify Berklee Honors the Legacy and Celebrates the Future of Berklee City Music
Amplify Berklee Honors the Legacy and Celebrates the Future of Berklee City Musi...
18/09/2024
Riedel Expands Its Range of NSA Network Stream Adapters
Riedel Communications today announced the launch of two new additions to its acclaimed Network Stream Adapter (NSA) series: the NSA-003A and NSA-006A. Unveiled ...
18/09/2024
WDR Relies on Riedel Backbone for Remote Production of UE...
The German regional public broadcaster Westdeutscher Rundfunk (WDR) has implemented a Riedel backbone for communications and signal distribution for the ARD bro...
18/09/2024
Amagi Expands Footprint in Latin America with Mexico Entr...
Amagi, the global leader in cloud-based SaaS technology for broadcast and connected TV (CTV), today announced that it is entering the Mexican market. This strat...
18/09/2024
ITV to Modernize Its Media Supply Chain With Cloud-Native...
SDVI, the leading platform provider for cloud-native media supply chains, today announced that U.K. broadcaster ITV is deploying the SDVI Rally platform as part...
18/09/2024
Triveni Digital SCTE TechExpo24 Exhibitor Preview
ATSC 3.0 is gaining momentum across the U.S., and for cable operators, ensuring top-notch service quality is more important than ever. Monitoring the performanc...
18/09/2024
Amagi and BuyDRM Partner to Secure Streaming Video on Pla...
Amagi, the global leader in cloud-based SaaS technology for broadcast and connected TV (CTV), today announced a partnership with BuyDRM, a leading content secur...
18/09/2024
Charter Bumps Up Broadband Speeds, Unveils New Bundle Pricing
STAMFORD, Conn. Spectrum has made a series of announcements that include a new simplified pricing strategy, increased broadband speeds and new customer service ...
18/09/2024
Lawo Doubles the Number of HOME Apps
Lawo has announced that its HOME Apps platform now hosts nine essential processing apps, effectively doubling the previous offering with more apps to follow in ...
18/09/2024
Gray, New Orleans Pelicans Announce New Sports Network
Gray Media is partnering with the New Orleans Pelicans to create a new network that promises to bring every non-national Pelicans NBA game to its viewers....
18/09/2024
Fox Weather Expands Distribution to DirecTV
NEW YORK Fox News Media has announced that Fox Weather, a free ad-supported streaming television service (FAST), is now available to DirecTV customers....
18/09/2024
NAB Show New York Exhibitor Insight TAG Video Systems
TV TECH: What do you anticipate will be the most significant technology trends at the 2024 NAB Show New York?...
18/09/2024
Key Conversations With News, Sports Panels on Tap at NAB Show New York
Broadcast, media and entertainment leaders will gather once again at NAB Show New York in October to explore key innovations and strategies reshaping how conten...
18/09/2024
SCTE Foundation Rebrands
EXTON, Pa. The SCTE Foundation has announced a comprehensive relaunch of its efforts. The relaunch includes new branding that will be on display at the Georgia ...
18/09/2024
Viant Technology Launches New Programmatic Ad Solution, ViantAI
IRVINE, Calif. Viant Technology Inc. has launched ViantAI, an advanced AI-powered platform that it says will reshape how programmatic advertising is planned, pu...
18/09/2024
Blackmagic Design Announces Pricing for Blackmagic URSA Cine 17K 65
Blackmagic Design Announces Pricing for Blackmagic URSA Cine 17K 65 Brie Clayton September 17, 2024 0 Comments Revolutionary large format digital film...
18/09/2024
Avid | Stream IO ingest & playout solution now supports SMPTE 2110
Avid | Stream IO ingest & playout solution now supports SMPTE 2110 Brie Clayton September 17, 2024 0 Comments Avid's next-gen software-based produ...
18/09/2024
Telemundo's Celebrando Todo Lo Que Somos' Marks Hispanic Heritage Month
NBCUniversal's Telemundo Enterprises is marking Hispanic Heritage Month with year four of its multiplatform initiative with the slogan Celebrando Todo Lo Q...
18/09/2024
Hispano Soy' Marks Hispanic Heritage Month on Warner Bros. Discovery U.S. Hispanic Nets
To celebrate Hispanic Heritage Month, Warner Bros. Discovery U.S. Hispanic is la...
18/09/2024
MeTV Toons Plans Spooky Sundays in October
As Halloween approaches, MeTV Toons will feature frightful Sunday programming. On October 13, it's a scary Flintstones block 1-3 p.m., then Scooby-Doo! 3-5 ...
18/09/2024
TMZ Investigates Matthew Perry and His Death in Sept. 16 Special on Fox
TMZ takes a close look at actor Matthew Perry and the drug network that led to his death when TMZ Investigates: Matthew Perry & the Secret Celebrity Drug Ring a...
18/09/2024
Olympics Boost Broadcast, Peacock Viewing in August
The Paris Summer Olympics gave a boost to broadcast and popped on Peacock in August, according to Nielsen....
18/09/2024
Gray Forms Gulf Coast Network To Broadcast Pelicans NBA Games
Gray Media is forming a new venture called Gulf Coast Sports & Entertainment Network that will carry all of the locally televised games of the NBA's New Orl...
18/09/2024
LG Study: Asian-American Viewers Prefer Streaming Ads
LG Ad Solutions shared a new report The Inclusive Screen: Asian Americans, which found that 70% of Asian Americans feel that streaming TV ads are more relevant...
18/09/2024
VideoAmp Says It Serves as Currency in $1 Billion of Media Deals
Measurement company VideoAmp said that $1 billion in media buys have already been guaranteed using its measurement as a currency this year....
18/09/2024
Kenny Smith Will Host Season 3 of Harlem Globetrotters: Play It Forward'
Kenny Smith, former NBA star and current TNT Sports analyst, will be the host of Harlem Globetrotters: Play It Forward for Season 3, which premieres Saturday, O...
18/09/2024
ESPN's Jimmy Pitaro Reflects on ESPN Turning 45, Launch of a New App in 2025, and the Role of AI, RSNs
ESPN's Jimmy Pitaro Reflects on ESPN Turning 45, Launch of a New App in 2025...
18/09/2024
Chicago Sports Network Agrees to OTA-TV Deal With Millennial Telecommunications' WJYS-TV
Chicago Sports Network Agrees to OTA-TV Deal With Millennial Telecommunications&...
18/09/2024
New Orleans Pelicans Ink OTA-TV Distribution Deal With Gray Media; Raycom Sports To Produce All Games
New Orleans Pelicans Ink OTA-TV Distribution Deal With Gray Media; Raycom Sports...
18/09/2024
Seattle Kraken Officially Launch Kraken Hockey Network, Promise Biggest Regional Production in the NHL'
Seattle Kraken Officially Launch Kraken Hockey Network, Promise Biggest Regiona...
18/09/2024
New Victory+ Free, DTC Streaming Service From Dallas Stars and APMC Goes Live
New Victory Free, DTC Streaming Service From Dallas Stars and APMC Goes Live In addition to all Stars games, Victory will carry Anaheim Ducks games this seaso...
18/09/2024
ESPN Looking to Hire Drone Pilot
ESPN Looking to Hire Drone Pilot By Ken Kerschbaumer Wednesday, September 18, 2024 - 4:30 pm Print This Story | Subscribe Story Highlights Have the ski...
18/09/2024
Only on Netflix! With Stars like Rodrigo Santoro and Rafael Vitti, Four Brazilian Films Are Starting Production From Bahia to Bariloche
Back to All News Only on Netflix! With Stars like Rodrigo Santoro and Rafael Vi...
18/09/2024
Haivision Wins Prestigious IBC Innovation Award for its Live Video Contribution Solutions over Private 5G Networks
Haivision Wins Prestigious IBC Innovation Award for its Live Video Contribution ...
18/09/2024
Eutelsat Group Secures Additional Launches in New Agreement with Mitsubishi Heavy Industries
Photo credit: Mitsubishi Heavy Industries, Ltd Press release - 18 September 20...
18/09/2024
2024-09-18
iPadOS 18 makes the iPad experience more versatile and intelligent than ever, and is available today as a free software update. iPadOS 18 brings incredible new ...
18/09/2024
Telespazio and ABS Partner to Deliver Enhanced Connectivity Services for the Brazilian Air Force System
Telespazio and ABS Partner to Deliver Enhanced Connectivity Services for the Bra...