Sony Pixel Power calrec Sony

Extended Cut: NVIDIA Expands Maxine for Video Editing, Showcases 3D Virtual Conferencing Research

08/08/2023

Professionals, teams, creators and others can tap into the power of AI to create high-quality audio and video effects - even using standard microphones and webcams - with the help of NVIDIA Maxine.

The suite of GPU-accelerated software development kits and cloud-native microservices lets users deploy AI features that enhance audio, video and augmented-reality effects for real-time communications services and platforms. Maxine will also expand features for video editing, enabling teams to reach new heights in video communication.

Plus, an NVIDIA Research demo at this week's SIGGRAPH conference displays how AI can take video conferencing to the next level with 3D features.

NVIDIA Maxine Features Expand to Video Editing Wireless connectivity has enabled people to join virtual meetings from more locations than ever. Typically, audio and video quality are heavily impacted when a caller is on the move or in a location with poor connectivity.

Advanced, real-time Maxine features - such as Background Noise Removal, Super Resolution and Eye Contact - allow remote users to enhance interpersonal communication experiences.

In addition, Maxine can now be used for video editing. NVIDIA partners are transforming this professional workflow with the same Maxine features that elevate video conferencing. The goal when editing a video, whether a sales pitch or a webinar, is to engage the broadest audience possible. Using Maxine, professionals can tap into AI features that enhance audio and video signals.

With Maxine, a spokesperson can look away from the screen to reference notes or a script while their gaze remains as if looking directly into the camera. Users can also film videos in low resolution and enhance the quality later. Plus, Maxine lets people record videos in several different languages and export the video in English.

Maxine features to be released in early access this year include:

Interpreter: Translates from simplified Chinese, Russian, French, German and Spanish to English while animating the user's image to show them speaking English.

Voice Font: Enables users to apply characteristics of a speaker's voice and map it to the audio output.

Audio Super Resolution: Improves audio quality by increasing the temporal resolution of the audio signal and extending bandwidth. It currently supports upsampling from 8,000Hz to 16,000Hz as well as from 16,000Hz to 48,000Hz. This feature is also updated with more than 50% reduction in latency and up to 2x better throughput.

Maxine Client: Brings the AI capabilities of Maxine's microservices to video-conferencing sessions on PCs. The application is optimized for low-latency streaming and will use the cloud for all of its GPU compute requirements. Thin Client will be available on Windows this fall, with additional OS support to follow.

Maxine can be deployed in the cloud, on premises or at the edge, meaning quality communication can be accessible from nearly anywhere.

Taking Video Conferencing to New Heights Many partners and customers are experiencing high-quality video conferencing and editing with Maxine. Two features of Maxine - Eye Contact and Live Portrait - are now available in production releases on the NVIDIA AI Enterprise software platform. Eye Contact simulates direct eye contact with the camera by estimating and aligning the user's gaze with the camera. And Live Portrait animates a person's portrait photo through their live video feed.

Software company Descript aims to make video a staple of every communicator's toolkit, alongside docs and slides. With NVIDIA Maxine, professionals and beginners who use Descript can access AI features that improve their video-content workflows.

With the NVIDIA Maxine Eye Contact feature, users no longer have to worry about memorizing scripts or doing tedious video retakes, said Jay LeBoeuf, head of business and corporate development at Descript. They can maintain a perfect on-screen presence while nailing their script every time.

Reincubate's Camo app aims to broaden access to great video by taking advantage of the hardware and devices people already own. It does this by giving users greater control over their image and by implementing a powerful, efficient processing pipeline for video effects and transformation. Using technologies enabled by NVIDIA Maxine, Camo can offer users an easier way to achieve incredible video creation.

Integrating NVIDIA Maxine into Camo couldn't have been easier, and it's enabled us to get high performance from users' RTX GPUs right out of the box, said Aidan Fitzpatrick, founder and CEO of Reincubate. With Maxine, the team's been able to move faster and with more confidence.

Quicklink's Cre8 is a powerful video production platform for creating professional, on-brand productions, virtual and hybrid live events. The user-friendly interface combines an intuitive design with all the tools needed to build, edit and customize a professional-looking production. Cre8 incorporates NVIDIA Maxine technology to maximize productivity and the quality of video productions, offering complete control to the operator.

Quicklink Cre8 now offers the most advanced video production platform on the planet, said Richard Rees, CEO of Quicklink. With NVIDIA Maxine, we were able to add advanced features, including Auto Framing, Video Noise Removal, Noise and Echo Cancellation, and Eye Contact Simulation.

Los Angeles-based company gemelo.ai provides a platform for creating AI twins that can scale a user's voice, content and interactions. Using Maxine's Live Portrait feature, the gemelo.ai team can unlock new opportunities for scaled, personalized content and one-on-one interactions.

The realism of Live Portrait has been a game-changer, unlocking new realms of potential for our AI twins, said Paul Jaski, CEO of gemelo.ai.
LINK: https://blogs.nvidia.com/blog/2023/08/08/maxine-3d-video-communication...
See more stories from nvidia

Most recent headlines

09/12/2024

Dalet Named an IDC Innovator in Media and Entertainment

Dalet, a leading technology and service provider for media-rich organizations, today announced that it has been named an IDC Innovator in the IDC Innovators: ...

09/11/2024

Dalet Expands Leadership Team to Fuel Next Stage of Growth

Dalet, a leading technology and service provider for media-rich organizations, today announced three new members of its executive team. Tara Bryant joins as Chi...

30/10/2024

Drone detection just got a whole lot smarter with ARDRONIS Detect from Rohde & Schwarz

Drone detection just got a whole lot smarter with ARDRONIS Detect from Rohde & S...

25/10/2024

Brighter Eyes

Jenny Priestley talks to the BFI's Douglas Weir who oversaw the restoration of a much-loved animated classic, which returns to UK and Ireland cinemas today ...

25/10/2024

Comercio TV Chooses Broadpeak to Optimize OTT Video Deliv...

Broadpeak , a leading provider of content delivery network (CDN) and video streaming solutions for content providers and pay-TV operators worldwide, announced t...

25/10/2024

Amagi Partners With Allrites to Expand the Global Distrib...

Amagi, the global leader in cloud-based SaaS technology for broadcast and connected TV (CTV), has announced a strategic partnership with Allrites, a premium con...

25/10/2024

Studio Technologies Enhances ST 2110 Integration with Mer...

Studio Technologies, Inc., a pioneer in high-performance audio, video, and fibre-optic solutions, has long been at the forefront of the professional broadcast a...

25/10/2024

QuickLink Improves Remote Production for Saturday Night T...

QuickLink, empowering creatives to exceed modern-day standards of production, has been instrumental in easing the remote production challenges of ITV Studios...

25/10/2024

stYpe AI Glue and StypeCentral Advance the Art of TV Tale...

stYpe, a globally active innovator of virtual studio production resources, reports strong interest in the latest additions to its wide range of broadcast-qualit...

25/10/2024

Top Argentine Music Facility Casa Frida Estudio Chooses P...

Casa Frida Estudio, one of the most prestigious music facilities in Argentina, has upgraded its main control room to Dolby Atmos specifications and installed a ...

25/10/2024

Frequency expands Managed Channel Services to Europe at M...

Frequency, the engine behind many of the world's best-known streaming television channels, announces the European expansion of its Managed Channel Services ...

25/10/2024

InnovateUK and EU Approve Funding for Immersive Technolog...

Disguise, an HPA-Award-winning immersive experience company, has received £1.2 Million in funding from Innovate UK and the EU as part of a larger investment int...

25/10/2024

MASORANGE AND AGILE CONTENT RENEW THEIR COLLABORATION AGR...

Through this agreement, MASORANGE will incorporate new AGILE CONTENT technologies into its television service, enhancing customer experience with optimum servic...

25/10/2024

Swiss Indoors Basel 2024 delivered with Appear X Platform

Appear, a global leader in live production technology, is proud to announce its role as an official provider of cutting-edge broadcast transmission solutions fo...

25/10/2024

MSCTV Chooses Witbes Virtual NOC for Proactive Live TV Mo...

Witbe (Euronext Growth FR0013143872 ALWIT), a global leader in test automation and monitoring technology for video service providers, today announced that M...

25/10/2024

Unified Streaming fortifies customer ties with two hires

Unified Streaming, a leading streaming software company, has hired Valentijn Siebrands, an industry veteran, as its new streaming solutions manager. The company...

25/10/2024

Independent Midwest Broadcaster selects Rohde and Schwarz...

Competitive search leads Toledo's WLMB-TV 40 to TE1 based on energy efficiency and durability As part of its effort to reach a wider audience, the Toledo-b...

25/10/2024

IBC Accelerator Programme 2025 - Call For Industry Challe...

IBC announces the Call for Challenges for the 2025 Accelerator Media Innovation Programme, inviting proposals for transformative, fast-track innovation projects...

25/10/2024

TVN Deploys Lawo AoIP Technology in New OB Truck

HANNOVER, Germany TVN Live Production is using a variety of solutions and technologies from Lawo in its new TVN- 8UHD OB truck, which it unveiled at this year&#...

25/10/2024

LG Ad Solutions Joins Innovid's Harmony Initiative

NEW YORK Innovid, a software platform for the creation, delivery, measurement and optimization of connected TV (CTV), linear and digital advertising, said LG Ad...

25/10/2024

Hightouch Launches New CTV Advertising Offering

SAN FRANCISCO Consumer data platform provider Hightouch has announced a new solution it said will streamline and accelerate connected TV (CTV) advertising....

25/10/2024

Max Adds DAZN's Sports Offering in Spain

MADRID Warner Bros. Discovery's streaming service Max has reached a new agreement with DAZN that will give Max customers in Spain access to the premium spor...

25/10/2024

Beloved Genre-Benders Karate Make a Fitting Comeback

Beloved Genre-Benders Karate Make a Fitting Comeback Its one of the decades feel-good music stories: How the legendary alumni acts rediscovery led to rereleas...

25/10/2024

Berklee Presents Holiday Extravaganza: Duke Ellingtons Nutcracker Suite and Christmas Vibes Featuring Warren Wolf

Berklee Presents Holiday Extravaganza: Duke Ellingtons Nutcracker Suite and Chri...

24/10/2024

Give Yourself a Scare With These Suspenseful Audiobooks

Gather your tricks and treats because Halloween season is upon us. Spotify launched our first Spine-Chilling Audiobooks hub this month featuring the Fear Index...

24/10/2024

PUBLIC INVITATION TO THE INTERVIEW OF NOMINATED CANDIDATE FOR THE COUNCIL OF THE NATIONAL FILM AND VIDEO FOUNDATION (NFVF)

In accordance with Section 6 (2) (c) of the National Film and Video Foundation A...

24/10/2024

L3Harris and Palantir Announce Strategic Partnership

MELBOURNE, Fla., Oct. 23, 2024 - L3Harris Technologies (NYSE: LHX) and Palantir Technologies Inc. (NYSE: PLTR) today announced a strategic partnership to propel...

24/10/2024

FCC Makes a Service Call on Broadband, Cable and Phone Customer Support

WASHINGTON The FCC has launched a formal proceeding to review the quality of support that cable, broadband, satellite TV, and voice service providers give their...

24/10/2024

Scripps Promotes Matt Simon to VP of Scripps News

CINCINNATI E.W. Scripps has named veteran journalist Matt Simon as vice president of Scripps News. In the new role, Simon will be responsible for the vision, ov...

24/10/2024

Cine Gear Film Series Competition is Now Open

Cine Gear Film Series Competition is Now Open Brie Clayton October 24, 2024 0 Comments Each year, thousands of filmmakers of all kinds gather at a maj...

24/10/2024

DaVinci Resolve Studio Integral to Ringling College of Art and Design's Post Program

DaVinci Resolve Studio Integral to Ringling College of Art and Design's Post...

24/10/2024

Krotos Introduces the World's First Dynamic Crowd System in Krotos Studio

Krotos Introduces the World's First Dynamic Crowd System in Krotos Studio Brie Clayton October 24, 2024 0 Comments Krotos, a leader in cutting-edg...

24/10/2024

Technicolor in talks over sale'

According to a report, following a move towards growth, Technicolor has opened talks with potential buyers as shareholders are assessing its long-term future B...

24/10/2024

Meet the VP, business strategy and partnerships

Orfiums Mark Vermaat, VP business strategy and partnerships, tells TVBEurope why remaining curious and challenging the status quo is vital in a career in the me...

24/10/2024

Amagi: Sports Viewing Spikes on FAST Channels

NEW YORK A new study from Amagi highlights both the ongoing shift of viewing to free ad-supported streaming (FAST) channels and the rapidly growing amount of sp...

24/10/2024

Vizrt Deploys Matrox Video DSX LE5 SDI I/O Cards in TriCaster Vizion

MONTREAL Matrox Video has announced that it is supplying DSX LE5 SDI I/O cards for Vizrts latest TriCaster product range....

24/10/2024

FCC Sends Second Round of EEO Audit Letters to TV, Radio Stations

WASHINGTON, D.C. The FCC's Enforcement Bureau has sent out Equal Employment Opportunity (EEO) audit letters to 150 randomly selected TV and radio stations....

24/10/2024

USTelecom: Broadband Providers Invested $94.7 Billion in 2023

Industry group USTelecom has released a study showing broadband providers invested $94.7 billion into the U.S. communications infrastructure in 2023. The annual...

24/10/2024

Curse of the Sin Eater Used DaVinci Resolve Studio and Blackmagic Cloud for End to End Post Production

Curse of the Sin Eater Used DaVinci Resolve Studio and Blackmagic Cloud for End ...

24/10/2024

Michael Shinn Named Executive Director of Boston Conservatory at Berklee

Michael Shinn Named Executive Director of Boston Conservatory at Berklee Shinn, who served as the Conservatory's dean of music for six years, has been int...

24/10/2024

India Should Manufacture Its Own AI,' Declares NVIDIA CEO

Artificial intelligence will be the driving force behind India's digital transformation, fueling innovation, economic growth, and global leadership, NVIDIA ...

24/10/2024

VEON's Jazz Launches FikrFree: An AI-Powered Digital Marketplace to Unlock Affordable Insurance and Healthcare in Pakistan

24 Oct 2024 VEON's Jazz Launches FikrFree: An AI-Powered Digital Marketplac...

24/10/2024

NESN Continues Unobstructed Views Series of Alternate Broadcasts With Six Bruins-Themed Episodes

NESN Continues Unobstructed Views Series of Alternate Broadcasts With Six Bruins...

24/10/2024

Inside the NFL's International Strategy, Broadcast Plans for the Growth of Its Future European Fan Base

Touchdown: Inside the NFL's international strategy and broadcast plans for t...

24/10/2024

SVG New Sponsor Spotlight: AbelCine's Tom Digges on the Growing Trend of Cinematic Cameras in Live Sports

SVG New Sponsor Spotlight: AbelCine's Tom Digges on the Growing Trend of Cin...

24/10/2024

Sweet Home, Carolina: How Charlotte Became a REMI Sports Production Hub

Sweet Home, Carolina: How Charlotte Became a REMI Sports Production Hub Leaders from ESPN, FOX Sports, NASCAR, Van Wagner, and SMT discuss their at-home product...

24/10/2024

SVG Sit-Down: USWNT Star Sydney Leroux on Working With DAZN's Team Whistle, Increased Interest in Women's Sports

SVG Sit-Down: USWNT Star Sydney Leroux on Working With DAZN's Team Whistle, ...

24/10/2024

Sony Sports CEO Rufus Hack on the Impact of the KinaTrax Acquisition

Sony Sports CEO Rufus Hack on the Impact of the KinaTrax Acquisition KinaTrax joins Hawk-Eye, Beyond Sports, and Pulselive under the Sony Sporta umbrella By Br...