Sony Pixel Power calrec Sony

NVIDIA, Partners Show Leading AI Performance and Versatility in MLPerf

29/06/2022

NVIDIA and its partners continued to provide the best overall AI training performance and the most submissions across all benchmarks with 90% of all entries coming from the ecosystem, according to MLPerf benchmarks released today.

The NVIDIA AI platform covered all eight benchmarks in the MLPerf Training 2.0 round, highlighting its leading versatility.

No other accelerator ran all benchmarks, which represent popular AI use cases including speech recognition, natural language processing, recommender systems, object detection, image classification and more. NVIDIA has done so consistently since submitting in December 2018 to the first round of MLPerf, an industry-standard suite of AI benchmarks.

Leading Benchmark Results, Availability In its fourth consecutive MLPerf Training submission, the NVIDIA A100 Tensor Core GPU based on the NVIDIA Ampere architecture continued to excel.

Fastest time to train on each network by each submitter's platform | Format: Chip count, Submitter, MLPerf-ID | RNN-T: 1536x NVIDIA 2.0-2104 | BERT: 4096x NVIDIA 2.0-2106, 4096x Google 2.0-2012, 256x Graphcore 2.0-2053, 8x Intel-HabanaLabs 2.0-2073 | RN-50: 4216x NVIDIA 2.0-2107, 4096x Google 2.0-2012, 256x Graphcore 2.0-2054, 8x Intel-HabanaLabs 2.0-2073 | 3D U-Net: 768x NVIDIA 2.0-2100 | RetinaNet: 1280x NVIDIA 2.0-2103, 2048x Google 2.0-2010 | Mask R-CNN: 384x NVIDIA 2.0-2099, 2048x Google 2.0-2010 | MiniGo: 1792x NVIDIA 2.0-2105 | DLRM: 112x NVIDIA 2.0-2098 Selene - our in-house AI supercomputer based on the modular NVIDIA DGX SuperPOD and powered by NVIDIA A100 GPUs, our software stack and NVIDIA InfiniBand networking - turned in the fastest time to train on four out of eight tests.

Per-chip performance is not a primary metric of MLPerf Training. To calculate per-chip performance, this chart normalizes every submission to the closest scale of the fastest competitor. The fastest competitors are shown with 1x. To determine the fastest competitor, we selected the scale common to most submitters.| Format: Chip count, Submitter, MLPerf-ID | ResNet-50: 8x Inspur 2.0-2069, 3456x Google 2.0-2011, 16x Graphcore 2.0-2047, 8x Intel-HabanaLabs 2.0-2073 | BERT: 8x Inspur 2.0-2070, 3456x Google 2.0-2011, 16x Graphcore 2.0-2045, 8x Intel-HabanaLabs 2.0-2073 | DLRM: 8x Inspur 2.0-2068 | Mask R-CNN: 384x NVIDIA 2.0-2099, 1024x Google 2.0-2009 | RetinaNet: 1280x NVIDIA 2.0-2103, 2048x Google 2.0-2010 | RNN-T 8x Inspur 2.0-2066 | 3D-UNet: 8x H3C 2.0-2060,| MiniGo: 8x H3C 2.0-2059 NVIDIA A100 also continued its per-chip leadership, proving the fastest on six of the eight tests.

A total of 16 partners submitted results this round using the NVIDIA AI platform. They include ASUS, Baidu, CASIA (Institute of Automation, Chinese Academy of Sciences), Dell Technologies, Fujitsu, GIGABYTE, H3C, Hewlett Packard Enterprise, Inspur, KRAI, Lenovo, Microsoft Azure, MosaicML, Nettrix and Supermicro.

Most of our OEM partners submitted results using NVIDIA-Certified Systems, servers validated by NVIDIA to provide great performance, manageability, security and scalability for enterprise deployments.

Many Models Power Real AI Applications An AI application may need to understand a user's spoken request, classify an image, make a recommendation and deliver a response as a spoken message.

Even the simple above use case requires nearly 10 models, highlighting the importance of running every benchmark These tasks require multiple kinds of AI models to work in sequence, also known as a pipeline. Users need to design, train, deploy and optimize these models fast and flexibly.

That's why both versatility - the ability to run every model in MLPerf and beyond - as well as leading performance are vital for bringing real-world AI into production.

Delivering ROI With AI For customers, their data science and engineering teams are their most precious resources, and their productivity determines the return on investment for AI infrastructure. Customers must consider the cost of expensive data science teams, which often plays a significant part in the total cost of deploying AI, as well as the relatively small cost of deploying the AI infrastructure itself.

AI researcher productivity depends on the ability to quickly test new ideas, requiring both the versatility to train any model as well as the speed afforded by training those models at the largest scale.That's why organizations focus on overall productivity per dollar to determine the best AI platforms - a more comprehensive view that more accurately represents the true cost of deploying AI.

In addition, the utilization of their AI infrastructure relies on its fungibility, or the ability to accelerate the entire AI workflow - from data prep to training to inference - on a single platform.

With NVIDIA AI, customers can use the same infrastructure for the entire AI pipeline, repurposing it to match the varying demands between data preparation, training and inference, which dramatically boosts utilization, leading to very high ROI.

And, as researchers discover new AI breakthroughs, supporting the latest model innovations is key to maximizing the useful life of AI infrastructure.

NVIDIA AI delivers the highest productivity per dollar as it is universal and performant for every model, scales to any size and accelerates AI from end to end - from data prep to training to inference.

Today's results provide the latest demonstration of NVIDIA's broad and deep AI expertise shown in every MLPerf training, inference and HPC round to date.

23x More Performance in 3.5 Years In the two years since our first MLPerf submission with A100, our platform has delivered 6x more performance. Continuous optimizations to our software stack helped fuel those gains.

Since the advent of MLPerf, the NVIDIA AI platform has delivered 23x more performance in 3.5 years on the benchmark - the result of fu
LINK: https://blogs.nvidia.com/blog/2022/06/29/nvidia-partners-ai-mlperf/...
See more stories from nvidia

Most recent headlines

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

23/04/2025

Finding Accountability

In 2024, Thomson's Total Turnout project played a pivotal role in elevating ethical election reporting and strengthening journalist safety in Pakistan. Wit...

23/04/2025

We heard that you could use a little pick-me-up, so get ready to sh-sh-shake it goodit's almost time for the Eurovision Song Contest!

We heard that you could use a little pick-me-up, so get ready to sh-sh-shake it ...

23/04/2025

The Gauge: Poland | March 2025

March shows a further downward trend of time spent watching television; following the February period when winter holidays contributed to a shorter time spent. ...

23/04/2025

The Gauge: Mexico March 2025

During March, audiences in Mexico increased their streaming usage by 2.1 points compared to the previous month, accounting for 24.4% of TV viewing. Disclaimer:...

23/04/2025

Nielsen Report: Asian American Audiences Are Reshaping Sports, Digital Media and Beauty Trends

AANHPI audiences over index the total U.S. for share of time spent with Netflix ...

23/04/2025

Roku Unveils New TVs, Smart Devices and Software Upgrades

SAN JOSE, Calif. Roku has announced new TVs, new streaming devices and significant upgrades to its user interface and software platforms that are designed to st...

23/04/2025

COW Job Listing: Opportunity for a Passionate Feature Film Editor - London-Based, In-Person, Paid Indie Project

COW Job Listing: Opportunity for a Passionate Feature Film Editor - London-Based...

23/04/2025

RM Equity Partners Acquires MAGIX Software, Appoints Robert Rutkowski as CEO to Drive Growth in the Creator Economy

RM Equity Partners Acquires MAGIX Software, Appoints Robert Rutkowski as CEO to ...

23/04/2025

All Men Are Wicked Western Shot with Blackmagic Design

All Men Are Wicked Western Shot with Blackmagic Design Brie Clayton April 23, 2025 0 Comments Blackmagic Pocket Cinema Camera 4Ks were put to the test...

23/04/2025

March Madness, Max Boost Warner Bros. Discovery's TV Viewing Share

NEW YORK Warner Bros. Discovery captured the largest monthly viewership increase among media distributors in March, according to Nielsen's latest Media Dist...

23/04/2025

WAPA+ FAST Channel Launches on Samsung TV Plus

MIAMI, Fla. Hemisphere Media Group has inked a deal with Samsung to launch WAPA+ as a FAST channel on Samsung TV Plus, a free TV streaming service that comes pr...

23/04/2025

Calrec Promotes Sid Stanley to Managing Director

HEBDEN BRIDGE, U.K. Calrec Audio has promoted Sid Stanley to managing director. Stanley, who joined the company in July 2018 as general manager, has been instru...

23/04/2025

FCC Commissioner Simington Names Gavin M. Wax Chief Of Staff

WASHINGTON Federal Communications Commission Commissioner Nathan A. Simington has announced a series of staff appointments made in March and April 2025, includi...

23/04/2025

FCC Releases Agenda for April Open Meeting

WASHINGTON The Federal Communications Commission has set its agenda for the Monday, April 28, 2025 Open Meeting, which is scheduled to start at 10:30 a.m. in th...

23/04/2025

COW Job Listing: Full-Time Video Editor, Remote

COW Job Listing: Full-Time Video Editor, Remote Brie Clayton April 22, 2025 0 Comments Full-Time Video Editor April 23, 2025COW Job Listing: Opportu...

23/04/2025

Berklee Abu Dhabi's Jazz Night Kicks off Global Celebration of Music and Culture

Berklee Abu Dhabi's Jazz Night Kicks off Global Celebration of Music and Cul...

23/04/2025

E.W. Scripps Folding Scripps News, Eliminating 200 Jobs; Stock Jumps 15%

The E.W. Scripps Co. said it was shutting down its Scripps News over-the-air channel effective November 15 and eliminating at least 200 jobs....

23/04/2025

Audio Helps Chess.com Checkmate Cheating

Audio Helps Chess.com Checkmate Cheating Matches are produced using REMI workflows By Dan Daley, Audio Editor Wednesday, April 23, 2025 - 7:00 am Print Th...

23/04/2025

Tech Focus: Intercoms, Part 1 - Key to Onsite, REMI, Hybrid Operations

Tech Focus: Intercoms, Part 1 - Key to Onsite, REMI, Hybrid Operations Intercoms keep increasingly disparate production locations together By Dan Daley, Audio ...

23/04/2025

Speaking My Language: Bringing AI to the Fore With Real Time Audio Translation for French football

Speaking my language: Bringing AI to the fore with real time audio translation f...

23/04/2025

Netflix Drops Trailer for Crime Drama 'Secrets We Keep', Set in Denmark's Wealthiest Neighborhood

Back to All News Netflix Drops Trailer for Crime Drama Secrets We Keep, Set in ...

23/04/2025

World Book Day: Netflix Announces New TV Adaptations and Impact on Book Sales as Sweet Magnolias' Is Renewed for Season 5

Back to All News World Book Day: Netflix Announces New TV Adaptations and Impac...

23/04/2025

Comscore to Announce First Quarter 2025 Financial Results

Comscore to Announce First Quarter 2025 Financial ResultsRESTON, VA, April 23, 2025 Comscore, Inc. (Nasdaq: SCOR), a trusted partner for planning, transacting...

23/04/2025

RT opens Voluntary Exit Programme 2025

In an email to RT staff today, RT Director-General, Kevin Backhurst confirmed that RT 's Voluntary Exit Programme (VEP) 2025 is open from today, Wednesday...

23/04/2025

RT coverage of The Funeral of Pope Francis

RT will air live coverage on television, radio and online of the funeral of Pope Francis which takes place this Saturday, 26 April 2025. Beginning at 8.30am o...

23/04/2025

How the Economics of Inference Can Maximize AI Value

As AI models evolve and adoption grows, enterprises must perform a delicate balancing act to achieve maximum value. That's because inference - the process ...

23/04/2025

Capital One Banks on AI for Financial Services

Financial services has long been at the forefront of adopting technological innovations. Today, generative AI and agentic systems are redefining the industry, f...

23/04/2025

Thales and Michelin drive software revenue growth with innovative simulation software

Facebook Twitter LinkedIn Enables Michelin to focus on development of its ...

23/04/2025

Project G-Assist Plug-In Builder Lets Anyone Customize AI on GeForce RTX AI PCs

AI is rapidly reshaping what's possible on a PC - whether for real-time image generation or voice-controlled workflows. As AI capabilities grow, so does the...

23/04/2025

Enterprises Onboard AI Teammates Faster With NVIDIA NeMo Tools to Scale Employee Productivity

An AI agent is only as accurate, relevant and timely as the data that powers it....

23/04/2025

Dolby Ushers in the Future of In-car Entertainment at Auto Shanghai 2025

April 23 2025, 02:00 (PDT) Dolby Ushers in the Future of In-car Entertainment at Auto Shanghai 2025 Dolby and industry partners demonstrate robust momentum ...

22/04/2025

Amalia Ulman Breaks the Rules With Magic Farm

Chloe Sevigny at the Magic Farm premiere (photo by Michael Hurcomb/Shutterstock for Sundance Film Festival)...

22/04/2025

Celebrate Earth Day With New Music Featuring the Sounds of Nature

Music has the power to connect us to one another and to the world around us. Spotify is once again teaming up with the Museum for the United Nations - UN Live&#...

22/04/2025

Spotify and ELLE Once Again Collaborate in Celebration of Emerging Women in Music

Spotify has an unwavering commitment to supporting emerging artists across all g...

22/04/2025

Celebrate Earth Day With Audiobooks That Educate and Entertain

This year marks the 55th anniversary of Earth Day, celebrated annually on April 22. On Spotify, listeners can explore a world of stories about our planet in our...

22/04/2025

McAvaney takes the lead for SBS' Coverage of the World Athletics Championships in Tokyo in September

McAvaney takes the lead for SBS' Coverage of the World Athletics Championshi...

22/04/2025

VLAST live streams virtual K-pop concerts with AJA Gear

Virtual idols are poised to revolutionize entertainment, with the market projected to top $4 billion by 2029. Crafted with motion capture and game engine techno...

22/04/2025

Singapore Polytechnic Readies Aspiring AV Professionals f...

As the audiovisual (AV) industry rapidly evolves, educational institutions are preparing the next generation of AV professionals for the future. Singapore Polyt...

22/04/2025

Study: Most U.S. TV Viewers Choose Streaming As Default Viewing Option

DENVER A new survey highlights just how important streaming has become in the entertainment landscape. Data compiled by Adtaxi shows streaming isnt just an alte...

22/04/2025

Samsung TV Plus Expands to Nearly 700 Channels in U.S.

Samsung TV Plus has announced that it is now offering nearly 700 streaming channels in the U.S. more than any of the other major FAST platforms, the streaming s...

22/04/2025

Amazon's Prime Vision NFL Feed Wins Over Fans, Hub Says

PORTSMOUTH, N.H. New findings from Hub Research's latest survey on sports and television coverage reveal Amazon may have cracked the code of how to use tech...

22/04/2025

Rockbridge Growth Equity Sells GSTV to MidOcean Partners

DETROIT Rockbridge Growth Equity has sold a controlling stake in GSTV to MidOcean Partners. Rockbridge will retain a minority stake in the video network which i...

22/04/2025

Gray Promotes Dana Neves to Senior Managing VP

ATLANTA Gray Media has promoted Dana Neves to senior managing vice president, overseeing a number of Gray's television markets in the Northeast and Mid-Atla...

22/04/2025

The Infrastructure of Creative Flow: DigitalGlue's creative.space Wins NAB 2025 Product of the Year

The Infrastructure of Creative Flow: DigitalGlue's creative.space Wins NAB 2...

22/04/2025

iZotope unveils Equinox: the ultimate reverb plugin for Post and Music production

iZotope unveils Equinox: the ultimate reverb plugin for Post and Music productio...

22/04/2025

Every way to export transparent videos from After Effects

Every way to export transparent videos from After Effects Graham Quince April 21, 2025 0 Comments In this video, I break down each way you can export ...

22/04/2025

Tribeca Festival 2025 Announces Short Film Lineup

April 22nd, 2025 Press Materials Available Here Tribeca Festival 2025 Announces Short Film Lineup Featuring How I Learned to Die Executive Produced by Osca...