AI on the Air: Behind the Scenes at IBC With Holoscan for Media
11/09/2024
Launched this week in limited availability, NVIDIA Holoscan for Media is a software-defined, AI-enabled platform that helps developers easily integrate AI into their live media applications and allows media companies to run live media pipelines on the same infrastructure as AI.
NVIDIA RTX AI workstations and PCs, powered by NVIDIA GPUs for real-time graphics processing and AI computing, provide an ideal foundation for developing these applications.
At the IBC broadcast and media tech show in Amsterdam, NVIDIA partners including Adobe, Blackmagic Design and Topaz Labs will showcase the latest RTX AI-powered video editing tools and technologies powering live media advancements.
NVIDIA Holoscan for Media: Building the Future of Live Production NVIDIA Holoscan for Media is an AI-enabled, software-defined platform for live media. Building a robust AI software stack for application development in live media is an intricate process that requires substantial expertise and resources.
This technical complexity, coupled with the need for large amounts of high-quality data and the difficulty of scaling pilot programs to production-level performance, often prevents these initiatives from reaching full deployment. Additionally, traditional development of software is tied to dedicated hardware, further limiting innovation and making upgrades cumbersome.
Addressing these challenges, NVIDIA Holoscan for Media empowers developers to create cutting-edge AI applications for live media with ease through its seamless integration with NVIDIA's extensive suite of AI software development kits (SDKs). This allows developers to easily incorporate advanced AI capabilities into their applications so they can focus on creating more sophisticated and intelligent media applications. Media companies can then seamlessly connect those applications to live video pipelines running on top of the platform.
Another typical challenge in live media application development is inefficiency in deployment. Developers often find themselves needing to create separate builds for different deployment types, whether on premises, in the cloud or at the edge. This increases costs and can extend development timelines. Developers must also allocate resources to build additional infrastructure services, such as authentication and timing protocols, further straining budgets.
Holoscan for Media's cloud-native architecture enables applications to run from anywhere. Applications developed for the cloud, edge or on-premises deployments can run across environments, eliminating the need for separate builds.
Holoscan for Media is available on premises today, with cloud and edge deployments coming soon. The platform also includes Precision Time Protocol for audio-video synchronization in live broadcasts and Networked Media Open Specifications for seamless communication between applications - simplifying the management of complex systems.
Enhancing Development With RTX AI PCs and Workstations NVIDIA RTX AI PCs and workstations complement the potential of Holoscan for Media by offering a robust foundation for developing immersive media experiences.
The CUDA ecosystem available on RTX AI PCs and workstations offers access to a vast array of NVIDIA SDKs and tools optimized for media and AI workloads. This allows developers to build applications that can seamlessly transition from workstation to deployment environments, ensuring that their creations are both robust and scalable.
NVIDIA AI Enterprise offers further enhancements by putting a comprehensive suite of AI software, tools and frameworks optimized for NVIDIA GPUs into the hands of enterprise developers who require secure, stable and scalable production environments for AI applications. This enterprise-grade AI platform includes popular frameworks like TensorFlow, PyTorch and RAPIDS for streamlined deployment.
Using NVIDIA AI Enterprise, developers can build advanced AI capabilities such as computer vision, natural language processing and recommendation systems directly in their media applications. And they can prototype, test and deploy sophisticated AI models within their media workflows.
Video Editors and Enthusiasts - Rejoice! Holoscan for Media will be on display at IBC, running Sept. 13-16. At the Dell Technologies booth 7.A45, attendees can witness live demonstrations that showcase how to seamlessly transition from application development to live deployment.
A number of NVIDIA partners will spotlight their latest RTX AI-powered video editing tools and technologies at the show.
Blackmagic Design's DaVinci Resolve 19 Studio is now available, introducing AI features that streamline editing workflows:
IntelliTrack AI makes it fast and easy to stabilize footage during the editing process. It can be used in DaVinci Resolve's Fairlight tool to track on-screen subjects and automatically generate audio panning as they move across 2D and 3D spaces. With the AI-powered feature, editors can quickly pan or move audio across the stereo field, controlling the voice positions of multiple actors in the mix environment.
UltraNR is an AI-accelerated denoise mode in DaVinci Resolve's spatial noise reduction palette. Editors can use it to dramatically reduce digital noise - undesired color or luminance fluctuations that obscure detail - from a frame while maintaining image clarity. Editors can also combine the tool with temporal noise reduction for even more effective denoising in images with motion, where fluctuations can be more noticeable.
RTX Video Super Resolution uses AI to sharpen low-resolution video. It can detect and remove compression artifacts, greatly enhancing lower-quality video.
RTX Video HDR uses an
LINK: | https://blogs.nvidia.com/blog/rtx-ai-holoscan-video-broadcast-editing/... |
See more stories from nvidia |
More from Nvidia
18/09/2024
NVIDIA AI Aerial Launches to Optimize Wireless Networks, Deliver New Generative AI Experiences on One Platform
Telecommunications providers are transforming beyond voice and data services wit...
18/09/2024
How SonicJobs Uses AI Agents to Connect the Internet, Starting with Jobs
Companies in the US spend $15bn annually on talent acquisition. The most important metric in recruitment advertising is the conversion from the paid click on th...
17/09/2024
New AI Innovation Hub in Tunisia Drives Technological Advancement Across Africa
A new AI innovation hub for developers across Tunisia launched today in Novation City, a technology park that's designed to cultivate a vibrant, innovation ...
17/09/2024
Upgrade Livestreams With Twitch Enhanced Broadcasting and the NVIDIA Encoder
At TwitchCon - a global convention for the Twitch livestreaming platform-livestreamers and content creators this week can experience the latest technologies for...
12/09/2024
GeForce NOW to Bring Dead Rising Deluxe Remaster' to the Cloud at Launch
Rise and shine - Capcom's latest action-adventure game, Dead Rising Deluxe Remaster, heads to the cloud at launch next week. It's part of nine new titl...
11/09/2024
AI on the Air: Behind the Scenes at IBC With Holoscan for Media
AI is transforming the broadcast industry by enhancing the way content is created, distributed and consumed - but integrating the technology can be challenging....
11/09/2024
NVIDIA and Oracle to Accelerate AI and Data Processing for Enterprises
Enterprises are looking for increasingly powerful compute to support their AI workloads and accelerate data processing. The efficiency gained can translate to b...
11/09/2024
Ready to Roll: Nuro to License Its Autonomous Driving System
To accelerate autonomous vehicle development and deployment timelines, Nuro announced today it will license its Nuro Driver autonomous driving system directly t...
09/09/2024
Live Media Reimagined: NVIDIA Holoscan for Media Now Available for Production
Companies in broadcast, sports and streaming are transitioning to software-defined infrastructure to benefit from flexible deployment and to more easily adopt t...
06/09/2024
How AI Is Personalizing Customer Service Experiences Across Industries
Customer service departments across industries are facing increased call volumes, high customer service agent turnover, talent shortages and shifting customer e...
05/09/2024
19 New Games to Drop for GeForce NOW in September
Fall will be here soon, so leaf it to GeForce NOW to bring the games, with 19 joining the cloud in September. Get started with the seven games available to str...
05/09/2024
Three Ways to Ride the Flywheel of Cybersecurity AI
The business transformations that generative AI brings come with risks that AI itself can help secure in a kind of flywheel of progress. Companies who were qui...
04/09/2024
Volvo Cars EX90 SUV Rolls Out, Built on NVIDIA Accelerated Computing and AI
Volvo Cars' new, fully electric EX90 is making its way from the automaker's assembly line in Charleston, South Carolina, to dealerships around the U.S. ...
04/09/2024
Do the Math: New RTX AI PC Hardware Delivers More AI, Faster
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
04/09/2024
Hammer Time: Machina Labs' Edward Mehr on Autonomous Blacksmith Bots and More
Edward Mehr works where AI meets the anvil. The company he cofounded, Machina L...
04/09/2024
Manufacturing Intelligence: Deltia AI Delivers Assembly Line Gains With NVIDIA Metropolis and Jetson
It all started at Berlin's Merantix venture studio in 2022, when Silviu Homo...
29/08/2024
From RAG to Richness: Startup Uplevels Retrieval-Augmented Generation for Enterprises
Well before OpenAI upended the technology industry with its release of ChatGPT i...
29/08/2024
Crystal-Clear Gaming: Visions of Mana' Sharpens on GeForce NOW
It's time to mana-fest the spirit of adventure with Square Enix's highly anticipated action role-playing game, Visions of Mana, launching today in the c...
28/08/2024
NVIDIA Blackwell Sets New Standard for Generative AI in MLPerf Inference Debut
As enterprises race to adopt generative AI and bring new services to market, the demands on data center infrastructure have never been greater. Training large l...
28/08/2024
More Than Fine: Multi-LoRA Support Now Available in NVIDIA RTX AI Toolkit
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
27/08/2024
From Prototype to Prompt: NVIDIA NIM Agent Blueprints Fast-Forward Next Wave of Enterprise Generative AI
The initial wave of generative AI was driven by its use in internet services tha...
27/08/2024
Better Molecules, Faster: NVIDIA NIM Agent Blueprint Redefines Hit Identification With Generative AI-Based Virtual Screening
Aiming at making the process faster and smarter, NVIDIA on Wednesday released th...
26/08/2024
NVIDIA Launches NIM Microservices for Generative AI in Japan, Taiwan
Nations around the world are pursuing sovereign AI to produce artificial intelligence using their own computing infrastructure, data, workforce and business net...
23/08/2024
NVIDIA to Present Innovations at Hot Chips That Boost Data Center Performance and Energy Efficiency
A deep technology conference for processor and system architects from industry a...
22/08/2024
Straight Out of Gamescom and Into Xbox PC Games, GeForce NOW Newly Supports Automatic Xbox Sign-In
Straight out of Gamescom, NVIDIA introduced GeForce NOW support for Xbox automat...
21/08/2024
How Snowflake Is Unlocking the Value of Data With Large Language Models
Snowflake is using AI to help enterprises transform data into insights and applications. In this episode of NVIDIA's AI Podcast, host Noah Kravitz and Baris...
21/08/2024
Lightweight Champ: NVIDIA Releases Small Language Model With State-of-the-Art Accuracy
Developers of generative AI typically face a tradeoff between model size and acc...
21/08/2024
SLMming Down Latency: How NVIDIA's First On-Device Small Language Model Makes Digital Humans More Lifelike
Editor's note: This post is part of the AI Decoded series, which demystifies...
20/08/2024
NVIDIA Showcases New AI Capabilities With ACE, RTX Games and More at Gamescom 2024
At Gamescom, the world's biggest gaming expo, NVIDIA has once again pushed t...
20/08/2024
High-Tech Highways: India Uses NVIDIA Accelerated Computing to Ease Tollbooth Traffic
India is home to the globe's second-largest road network, spanning nearly 4 ...
20/08/2024
Level Up: NVIDIA, MediaTek to Bring G-SYNC Display Technologies to More Gamers
Picture this: NVIDIA and MediaTek are working together to make the industry's best gaming display technologies more accessible to gamers globally. The comp...
20/08/2024
NVIDIA Announces First Digital Human Technologies On-Device Small Language Model, Improving Conversation for Game Characters
NVIDIA's first digital human technology small language model is being demons...
20/08/2024
At Gamescom 2024, GeForce NOW Brings Black Myth: Wukong' and FINAL FANTASY XVI Demo' to the Cloud
Each week, GeForce NOW elevates cloud gaming by bringing top PC games and new up...
19/08/2024
AI Chases the Storm: New NVIDIA Research Boosts Weather Prediction, Climate Simulation
As hurricanes, tornadoes and other extreme weather events occur with increased f...
15/08/2024
GeForce NOW and CurseForge Bring Mod Support to World of Warcraft: The War Within' in the Cloud
Time to be wowed: GeForce NOW members can now stream World of Warcraft on suppor...
14/08/2024
Decoding NVIDIA Edify - The Technology That Helps Developers Create Custom Models Trained on Their Data
Editor's note: This post is part of the AI Decoded series, which demystifies...
13/08/2024
Applications Now Open for $60,000 NVIDIA Graduate Fellowship Awards
Bringing together the world's brightest minds and the latest accelerated computing technology leads to powerful breakthroughs that help tackle some of the b...
09/08/2024
Golden Opportunities: California to Train Students, Educators in AI
The State of California today announced a first-of-its-kind AI education initiative with NVIDIA. The public-private collaboration supports the state's goal...
08/08/2024
GeForce NOW Celebrates 2,000 Games in the Cloud
Editor's note: This blog was updated on Aug. 9 to reflect changes to the availability of Warhammer 40,000: Speed Freeks.' This GFN Thursday marks 2,00...
08/08/2024
Figure Unveils Next-Gen Conversational Humanoid Robot With 3x AI Computing for Fully Autonomous Tasks
Silicon Valley's Figure has taken the wraps off of its next-generation Figur...
07/08/2024
Problem Solved: STEM Studies Supercharged With RTX and AI Technologies
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
07/08/2024
Recursion CEO Chris Gibson on Accelerating the Biopharmaceutical Industry With AI
Techbio is a field combining data, technology and biology to enhance scientific ...
06/08/2024
Meet the Maker: High School Student Develops Robot Guide Dogs With NVIDIA Jetson
High school student Selin Alara Ornek is looking ahead - using machine learning and the NVIDIA Jetson platform for edge AI and robotics to create robot guide do...
06/08/2024
Editor's Paradise: NVIDIA RTX-Powered Video Software CyberLink PowerDirector Gains High-Efficiency Video Coding Upgrades
Editor's note: This post is part of our In the NVIDIA Studio series, which c...
01/08/2024
August Adventures Await: 18 New Games Coming to GeForce NOW
Members can choose their own adventure with GeForce NOW bringing 18 new games to the cloud in August - including Square Enix's fantasy role-playing game Vis...
31/07/2024
Oracle Cloud Infrastructure Expands NVIDIA GPU-Accelerated Instances for AI, Digital Twins and More
Enterprises are rapidly adopting generative AI, large language models (LLMs), ad...
31/07/2024
NVIDIA Researchers Harness Real-Time Gen AI to Build Immersive Desert World
NVIDIA researchers used NVIDIA Edify, a multimodal architecture for visual generative AI, to build a detailed 3D desert landscape within a few minutes in a live...
31/07/2024
NVIDIA and Zoox Pave the Way for Autonomous Ride-Hailing
In celebration of Zoox's 10th anniversary, NVIDIA founder and CEO Jensen Huang recently joined the robotaxi company's CEO, Aicha Evans, and its cofounde...
31/07/2024
Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations
Editor's note: This post is part of the AI Decoded series, which demystifies...