Sony Pixel Power calrec Sony

AI on the Air: Behind the Scenes at IBC With Holoscan for Media

11/09/2024

AI is transforming the broadcast industry by enhancing the way content is created, distributed and consumed - but integrating the technology can be challenging.

Launched this week in limited availability, NVIDIA Holoscan for Media is a software-defined, AI-enabled platform that helps developers easily integrate AI into their live media applications and allows media companies to run live media pipelines on the same infrastructure as AI.

NVIDIA RTX AI workstations and PCs, powered by NVIDIA GPUs for real-time graphics processing and AI computing, provide an ideal foundation for developing these applications.

At the IBC broadcast and media tech show in Amsterdam, NVIDIA partners including Adobe, Blackmagic Design and Topaz Labs will showcase the latest RTX AI-powered video editing tools and technologies powering live media advancements.

NVIDIA Holoscan for Media: Building the Future of Live Production NVIDIA Holoscan for Media is an AI-enabled, software-defined platform for live media. Building a robust AI software stack for application development in live media is an intricate process that requires substantial expertise and resources.

This technical complexity, coupled with the need for large amounts of high-quality data and the difficulty of scaling pilot programs to production-level performance, often prevents these initiatives from reaching full deployment. Additionally, traditional development of software is tied to dedicated hardware, further limiting innovation and making upgrades cumbersome.

Addressing these challenges, NVIDIA Holoscan for Media empowers developers to create cutting-edge AI applications for live media with ease through its seamless integration with NVIDIA's extensive suite of AI software development kits (SDKs). This allows developers to easily incorporate advanced AI capabilities into their applications so they can focus on creating more sophisticated and intelligent media applications. Media companies can then seamlessly connect those applications to live video pipelines running on top of the platform.

Another typical challenge in live media application development is inefficiency in deployment. Developers often find themselves needing to create separate builds for different deployment types, whether on premises, in the cloud or at the edge. This increases costs and can extend development timelines. Developers must also allocate resources to build additional infrastructure services, such as authentication and timing protocols, further straining budgets.

Holoscan for Media's cloud-native architecture enables applications to run from anywhere. Applications developed for the cloud, edge or on-premises deployments can run across environments, eliminating the need for separate builds.

Holoscan for Media is available on premises today, with cloud and edge deployments coming soon. The platform also includes Precision Time Protocol for audio-video synchronization in live broadcasts and Networked Media Open Specifications for seamless communication between applications - simplifying the management of complex systems.

Enhancing Development With RTX AI PCs and Workstations NVIDIA RTX AI PCs and workstations complement the potential of Holoscan for Media by offering a robust foundation for developing immersive media experiences.

The CUDA ecosystem available on RTX AI PCs and workstations offers access to a vast array of NVIDIA SDKs and tools optimized for media and AI workloads. This allows developers to build applications that can seamlessly transition from workstation to deployment environments, ensuring that their creations are both robust and scalable.

NVIDIA AI Enterprise offers further enhancements by putting a comprehensive suite of AI software, tools and frameworks optimized for NVIDIA GPUs into the hands of enterprise developers who require secure, stable and scalable production environments for AI applications. This enterprise-grade AI platform includes popular frameworks like TensorFlow, PyTorch and RAPIDS for streamlined deployment.

Using NVIDIA AI Enterprise, developers can build advanced AI capabilities such as computer vision, natural language processing and recommendation systems directly in their media applications. And they can prototype, test and deploy sophisticated AI models within their media workflows.

Video Editors and Enthusiasts - Rejoice! Holoscan for Media will be on display at IBC, running Sept. 13-16. At the Dell Technologies booth 7.A45, attendees can witness live demonstrations that showcase how to seamlessly transition from application development to live deployment.

A number of NVIDIA partners will spotlight their latest RTX AI-powered video editing tools and technologies at the show.

Blackmagic Design's DaVinci Resolve 19 Studio is now available, introducing AI features that streamline editing workflows:

IntelliTrack AI makes it fast and easy to stabilize footage during the editing process. It can be used in DaVinci Resolve's Fairlight tool to track on-screen subjects and automatically generate audio panning as they move across 2D and 3D spaces. With the AI-powered feature, editors can quickly pan or move audio across the stereo field, controlling the voice positions of multiple actors in the mix environment.

UltraNR is an AI-accelerated denoise mode in DaVinci Resolve's spatial noise reduction palette. Editors can use it to dramatically reduce digital noise - undesired color or luminance fluctuations that obscure detail - from a frame while maintaining image clarity. Editors can also combine the tool with temporal noise reduction for even more effective denoising in images with motion, where fluctuations can be more noticeable.

RTX Video Super Resolution uses AI to sharpen low-resolution video. It can detect and remove compression artifacts, greatly enhancing lower-quality video.

RTX Video HDR uses an
LINK: https://blogs.nvidia.com/blog/rtx-ai-holoscan-video-broadcast-editing/...
See more stories from nvidia

More from Nvidia

18/09/2024

NVIDIA AI Aerial Launches to Optimize Wireless Networks, Deliver New Generative AI Experiences on One Platform

Telecommunications providers are transforming beyond voice and data services wit...

18/09/2024

How SonicJobs Uses AI Agents to Connect the Internet, Starting with Jobs

Companies in the US spend $15bn annually on talent acquisition. The most important metric in recruitment advertising is the conversion from the paid click on th...

17/09/2024

New AI Innovation Hub in Tunisia Drives Technological Advancement Across Africa

A new AI innovation hub for developers across Tunisia launched today in Novation City, a technology park that's designed to cultivate a vibrant, innovation ...

17/09/2024

Upgrade Livestreams With Twitch Enhanced Broadcasting and the NVIDIA Encoder

At TwitchCon - a global convention for the Twitch livestreaming platform-livestreamers and content creators this week can experience the latest technologies for...

12/09/2024

GeForce NOW to Bring Dead Rising Deluxe Remaster' to the Cloud at Launch

Rise and shine - Capcom's latest action-adventure game, Dead Rising Deluxe Remaster, heads to the cloud at launch next week. It's part of nine new titl...

11/09/2024

AI on the Air: Behind the Scenes at IBC With Holoscan for Media

AI is transforming the broadcast industry by enhancing the way content is created, distributed and consumed - but integrating the technology can be challenging....

11/09/2024

NVIDIA and Oracle to Accelerate AI and Data Processing for Enterprises

Enterprises are looking for increasingly powerful compute to support their AI workloads and accelerate data processing. The efficiency gained can translate to b...

11/09/2024

Ready to Roll: Nuro to License Its Autonomous Driving System

To accelerate autonomous vehicle development and deployment timelines, Nuro announced today it will license its Nuro Driver autonomous driving system directly t...

09/09/2024

Live Media Reimagined: NVIDIA Holoscan for Media Now Available for Production

Companies in broadcast, sports and streaming are transitioning to software-defined infrastructure to benefit from flexible deployment and to more easily adopt t...

06/09/2024

How AI Is Personalizing Customer Service Experiences Across Industries

Customer service departments across industries are facing increased call volumes, high customer service agent turnover, talent shortages and shifting customer e...

05/09/2024

19 New Games to Drop for GeForce NOW in September

Fall will be here soon, so leaf it to GeForce NOW to bring the games, with 19 joining the cloud in September. Get started with the seven games available to str...

05/09/2024

Three Ways to Ride the Flywheel of Cybersecurity AI

The business transformations that generative AI brings come with risks that AI itself can help secure in a kind of flywheel of progress. Companies who were qui...

04/09/2024

Volvo Cars EX90 SUV Rolls Out, Built on NVIDIA Accelerated Computing and AI

Volvo Cars' new, fully electric EX90 is making its way from the automaker's assembly line in Charleston, South Carolina, to dealerships around the U.S. ...

04/09/2024

Do the Math: New RTX AI PC Hardware Delivers More AI, Faster

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...

04/09/2024

Hammer Time: Machina Labs' Edward Mehr on Autonomous Blacksmith Bots and More

Edward Mehr works where AI meets the anvil. The company he cofounded, Machina L...

04/09/2024

Manufacturing Intelligence: Deltia AI Delivers Assembly Line Gains With NVIDIA Metropolis and Jetson

It all started at Berlin's Merantix venture studio in 2022, when Silviu Homo...

29/08/2024

From RAG to Richness: Startup Uplevels Retrieval-Augmented Generation for Enterprises

Well before OpenAI upended the technology industry with its release of ChatGPT i...

29/08/2024

Crystal-Clear Gaming: Visions of Mana' Sharpens on GeForce NOW

It's time to mana-fest the spirit of adventure with Square Enix's highly anticipated action role-playing game, Visions of Mana, launching today in the c...

28/08/2024

NVIDIA Blackwell Sets New Standard for Generative AI in MLPerf Inference Debut

As enterprises race to adopt generative AI and bring new services to market, the demands on data center infrastructure have never been greater. Training large l...

28/08/2024

More Than Fine: Multi-LoRA Support Now Available in NVIDIA RTX AI Toolkit

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...

27/08/2024

From Prototype to Prompt: NVIDIA NIM Agent Blueprints Fast-Forward Next Wave of Enterprise Generative AI

The initial wave of generative AI was driven by its use in internet services tha...

27/08/2024

Better Molecules, Faster: NVIDIA NIM Agent Blueprint Redefines Hit Identification With Generative AI-Based Virtual Screening

Aiming at making the process faster and smarter, NVIDIA on Wednesday released th...

26/08/2024

NVIDIA Launches NIM Microservices for Generative AI in Japan, Taiwan

Nations around the world are pursuing sovereign AI to produce artificial intelligence using their own computing infrastructure, data, workforce and business net...

23/08/2024

NVIDIA to Present Innovations at Hot Chips That Boost Data Center Performance and Energy Efficiency

A deep technology conference for processor and system architects from industry a...

22/08/2024

Straight Out of Gamescom and Into Xbox PC Games, GeForce NOW Newly Supports Automatic Xbox Sign-In

Straight out of Gamescom, NVIDIA introduced GeForce NOW support for Xbox automat...

21/08/2024

How Snowflake Is Unlocking the Value of Data With Large Language Models

Snowflake is using AI to help enterprises transform data into insights and applications. In this episode of NVIDIA's AI Podcast, host Noah Kravitz and Baris...

21/08/2024

Lightweight Champ: NVIDIA Releases Small Language Model With State-of-the-Art Accuracy

Developers of generative AI typically face a tradeoff between model size and acc...

21/08/2024

SLMming Down Latency: How NVIDIA's First On-Device Small Language Model Makes Digital Humans More Lifelike

Editor's note: This post is part of the AI Decoded series, which demystifies...

20/08/2024

NVIDIA Showcases New AI Capabilities With ACE, RTX Games and More at Gamescom 2024

At Gamescom, the world's biggest gaming expo, NVIDIA has once again pushed t...

20/08/2024

High-Tech Highways: India Uses NVIDIA Accelerated Computing to Ease Tollbooth Traffic

India is home to the globe's second-largest road network, spanning nearly 4 ...

20/08/2024

Level Up: NVIDIA, MediaTek to Bring G-SYNC Display Technologies to More Gamers

Picture this: NVIDIA and MediaTek are working together to make the industry's best gaming display technologies more accessible to gamers globally. The comp...

20/08/2024

NVIDIA Announces First Digital Human Technologies On-Device Small Language Model, Improving Conversation for Game Characters

NVIDIA's first digital human technology small language model is being demons...

20/08/2024

At Gamescom 2024, GeForce NOW Brings Black Myth: Wukong' and FINAL FANTASY XVI Demo' to the Cloud

Each week, GeForce NOW elevates cloud gaming by bringing top PC games and new up...

19/08/2024

AI Chases the Storm: New NVIDIA Research Boosts Weather Prediction, Climate Simulation

As hurricanes, tornadoes and other extreme weather events occur with increased f...

15/08/2024

GeForce NOW and CurseForge Bring Mod Support to World of Warcraft: The War Within' in the Cloud

Time to be wowed: GeForce NOW members can now stream World of Warcraft on suppor...

14/08/2024

Decoding NVIDIA Edify - The Technology That Helps Developers Create Custom Models Trained on Their Data

Editor's note: This post is part of the AI Decoded series, which demystifies...

13/08/2024

Applications Now Open for $60,000 NVIDIA Graduate Fellowship Awards

Bringing together the world's brightest minds and the latest accelerated computing technology leads to powerful breakthroughs that help tackle some of the b...

09/08/2024

Golden Opportunities: California to Train Students, Educators in AI

The State of California today announced a first-of-its-kind AI education initiative with NVIDIA. The public-private collaboration supports the state's goal...

08/08/2024

GeForce NOW Celebrates 2,000 Games in the Cloud

Editor's note: This blog was updated on Aug. 9 to reflect changes to the availability of Warhammer 40,000: Speed Freeks.' This GFN Thursday marks 2,00...

08/08/2024

Figure Unveils Next-Gen Conversational Humanoid Robot With 3x AI Computing for Fully Autonomous Tasks

Silicon Valley's Figure has taken the wraps off of its next-generation Figur...

07/08/2024

Problem Solved: STEM Studies Supercharged With RTX and AI Technologies

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...

07/08/2024

Recursion CEO Chris Gibson on Accelerating the Biopharmaceutical Industry With AI

Techbio is a field combining data, technology and biology to enhance scientific ...

06/08/2024

Meet the Maker: High School Student Develops Robot Guide Dogs With NVIDIA Jetson

High school student Selin Alara Ornek is looking ahead - using machine learning and the NVIDIA Jetson platform for edge AI and robotics to create robot guide do...

06/08/2024

Editor's Paradise: NVIDIA RTX-Powered Video Software CyberLink PowerDirector Gains High-Efficiency Video Coding Upgrades

Editor's note: This post is part of our In the NVIDIA Studio series, which c...

01/08/2024

August Adventures Await: 18 New Games Coming to GeForce NOW

Members can choose their own adventure with GeForce NOW bringing 18 new games to the cloud in August - including Square Enix's fantasy role-playing game Vis...

31/07/2024

Oracle Cloud Infrastructure Expands NVIDIA GPU-Accelerated Instances for AI, Digital Twins and More

Enterprises are rapidly adopting generative AI, large language models (LLMs), ad...

31/07/2024

NVIDIA Researchers Harness Real-Time Gen AI to Build Immersive Desert World

NVIDIA researchers used NVIDIA Edify, a multimodal architecture for visual generative AI, to build a detailed 3D desert landscape within a few minutes in a live...

31/07/2024

NVIDIA and Zoox Pave the Way for Autonomous Ride-Hailing

In celebration of Zoox's 10th anniversary, NVIDIA founder and CEO Jensen Huang recently joined the robotaxi company's CEO, Aicha Evans, and its cofounde...