News summary: New libraries in accelerated computing deliver order-of-magnitude speedups and reduce energy consumption and costs in data processing, generative AI, recommender systems, AI data curation, data processing, 6G research, AI-physics and more. They include:
LLM applications: NeMo Curator, to create custom datasets, adds image curation and Nemotron-4 340B for high-quality synthetic data generation
Data processing: cuVS for vector search to build indexes in minutes instead of days and a new Polars GPU Engine in open beta
Physical AI: For physics simulation, Warp accelerates computations with a new TIle API. For wireless network simulation, Aerial adds more map formats for ray tracing and simulation. And for link-level wireless simulation, Sionna adds a new toolchain for real-time inference
Companies around the world are increasingly turning to NVIDIA accelerated computing to speed up applications they first ran on CPUs only. This has enabled them to achieve extreme speedups and benefit from incredible energy savings.
In Houston, CPFD makes computational fluid dynamics simulation software for industrial applications, like its Barracuda Virtual Reactor software that helps design next-generation recycling facilities. Plastic recycling facilities run CPFD software in cloud instances powered by NVIDIA accelerated computing. With a CUDA GPU-accelerated virtual machine, they can efficiently scale and run simulations 400x faster and 140x more energy efficiently than using a CPU-based workstation.
Bottles being loaded into a plastics recycling facility. AI-generated image. A popular video conferencing application captions several hundred thousand virtual meetings an hour. When using CPUs to create live captions, the app could query a transformer-powered speech recognition AI model three times a second. After migrating to GPUs in the cloud, the application's throughput increased to 200 queries per second - a 66x speedup and 25x energy-efficiency improvement.
In homes across the globe, an e-commerce website connects hundreds of millions of shoppers a day to the products they need using an advanced recommendation system powered by a deep learning model, running on its NVIDIA accelerated cloud computing system. After switching from CPUs to GPUs in the cloud, it achieved significantly lower latency with a 33x speedup and nearly 12x energy-efficiency improvement.
With the exponential growth of data, accelerated computing in the cloud is set to enable even more innovative use cases.
NVIDIA Accelerated Computing on CUDA GPUs Is Sustainable Computing NVIDIA estimates that if all AI, HPC and data analytics workloads that are still running on CPU servers were CUDA GPU-accelerated, data centers would save 40 terawatt-hours of energy annually. That's the equivalent energy consumption of 5 million U.S. homes per year.
Accelerated computing uses the parallel processing capabilities of CUDA GPUs to complete jobs orders of magnitude faster than CPUs, improving productivity while dramatically reducing cost and energy consumption.
Although adding GPUs to a CPU-only server increases peak power, GPU acceleration finishes tasks quickly and then enters a low-power state. The total energy consumed with GPU-accelerated computing is significantly lower than with general-purpose CPUs, while yielding superior performance.
GPUs achieve 20x greater energy efficiency compared to traditional computing on CPU-only servers because they deliver greater performance per watt, completing more tasks in less time. In the past decade, NVIDIA AI computing has achieved approximately 100,000x more energy efficiency when processing large language models. To put that into perspective, if the efficiency of cars improved as much as NVIDIA has advanced the efficiency of AI on its accelerated computing platform, they'd get 500,000 miles per gallon. That's enough to drive to the moon, and back, on less than a gallon of gasoline.
In addition to these dramatic boosts in efficiency on AI workloads, GPU computing can achieve incredible speedups over CPUs. Customers of the NVIDIA accelerated computing platform running workloads on cloud service providers saw speedups of 10-180x across a gamut of real-world tasks, from data processing to computer vision, as the chart below shows.
Speedups of 10-180x achieved in real-world implementations by cloud customers across workloads with the NVIDIA accelerated computing platform. As workloads continue to demand exponentially more computing power, CPUs have struggled to provide the necessary performance, creating a growing performance gap and driving compute inflation. The chart below illustrates a multiyear trend of how data growth has far outpaced the growth in compute performance per watt of CPUs.
The widening gap between data growth and the lagging compute performance per watt of CPUs. The energy savings of GPU acceleration frees up what would otherwise have been wasted cost and energy.
With its massive energy-efficiency savings, accelerated computing is sustainable computing.
The Right Tools for Every Job GPUs cannot accelerate software written for general-purpose CPUs. Specialized algorithm software libraries are needed to accelerate specific workloads. Just like a mechanic would have an entire toolbox from a screwdriver to a wrench for different tasks, NVIDIA provides a diverse set of libraries to perform low-level functions like parsing and executing calculations on data.
Each NVIDIA CUDA library is optimized to harness hardware features specific to NVIDIA GPUs. Combined, they encompass the power of the NVIDIA platform.
New updates continue to be added on the CUDA platform roadmap, expanding across diverse use cases:
LLM Applications NeMo Curator gives developers the flexibility to quickly create custom datasets in large language model (LLM) use cases. Recently
North America Stories
13/09/2024
By Bailey Pennick
One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. ...
13/09/2024
SNS is excited to preview the latest features coming to the award-winning EVO Suite. Be among the first to test drive these workflow innovations at IBC2024, and...
13/09/2024
SALT LAKE CITY, Sept. 12, 2024 - L3Harris Technologies (NYSE:LHX) has received a...
13/09/2024
Rendering of L3Harris Tranche 2 Tracking (T2TRK) imagery for the Space Developme...
13/09/2024
Last month, L3Harris delivered the third U.S. Air Force EA-37B Compass Call Cross Deck aircraft integrated with sophisticated electromagnetic attack (EA) miss...
13/09/2024
Targeted at low-to-mid tier productions, the new products set new standards for ...
13/09/2024
The next generation products will enhance the Densit Modular Platform with unma...
13/09/2024
AMSTERDAM Calrec Audio has unveiled its compact Argo M audio console, ImPulseV cloud audio mixing solution and True Control 2.0 at IBC 2024, Sept. 13-16....
13/09/2024
A study of how the media and broadcast industry feels about artificial intelligence (AI) has revealed most media and broadcast companies view its adoption as a ...
13/09/2024
AMSTERDAM AI-driven digital asset management system (DAM) Starchive announced at IBC 2024 a collaboration with Seagate that fully integrates its toolset with Se...
13/09/2024
AMSTERDAM DPA Microphones has introduced its 2061 Miniature Omnidirectional Microphone for applications ranging from broadcast studios and ENG to theaters, even...
13/09/2024
Rodney Alejandro Named Dean of Professional Writing and Music Technology Alejandro, Berklees current Songwriting Department chair and an alumnus of the colleg...
13/09/2024
The presidential debate between Vice President Kamala Harris and former President Donald Trump was watched by 67.1 million viewers, according to Nielsen....
13/09/2024
Brightcove introduced the Brightcove AI Suite, which uses AI to provide content creation, audience growth and engagement and increased revenue generation....
13/09/2024
Warner Bros. Discovery and Charter Communications said the reached a new multi-y...
13/09/2024
The History Channel's History This Week podcast returns for a fifth season on September 16....
13/09/2024
NEW YORK The ABC News Presidential Debate between Vice President Kamala Harris and former President Donald Trump drew an estimated audience of 67.1 million view...
13/09/2024
WASHINGTON, D.C. In response to Donald Trump's call for ABC stations to lose their broadcast licenses, Federal Communications Commission chairwoman Jessica ...
13/09/2024
IRVINE, Calif. Teradek will launch its new Prism 877 4K HEVC encoder/decoder cards at the IBC 2024, Sept. 13-16, at the RAI Amsterdam Convention Center....
13/09/2024
ATLANTA The Georgia Association of Broadcasters honored nine station employees at the early stage of their broadcast career as members of its first-ever class o...
13/09/2024
MONTREAL Grass Valley and broadcast equipment supply and service company ES Broadcast have inked a strategic partnership agreement that continues and expands a ...
13/09/2024
NEWARK, N.J. Panasonic Connect has announced the new AK-UCX100 4K studio camera and two new 4K multi-purpose cameras. In addition, the company said it will exte...
13/09/2024
OTTAWA, Canada Ross Video has launched Ultricore Tally, a full-featured, versatile tally control and management solution and will showcase it at IBC 2024, Sept....
13/09/2024
Hollyland Elevates Wireless Communications for Large-Scale Film and TV Productio...
13/09/2024
Blackmagic Design Announces Blackmagic PYXIS Monitor!
Brie Clayton September 12, 2024
0 Comments
New cinematic monitoring solution for Blackmagic PYXI...
13/09/2024
Sculpting Reimagined: Maxon Releases ZBrush for iPad
Brie Clayton September 13, 2024
0 Comments
Take the power of ZBrush on the go with reimagined UI,...
13/09/2024
WCVB Spotlights Berklee Institute for Accessible Arts Education The institutes ABLE summer camp program was featured in the 5 for Good segment.
By
Daniel Pe...
13/09/2024
Back to All News
Netflix Greenlights Love Untangled': A Nostalgic Korean Y...
12/09/2024
Final Phase of RFP Process Will See a Decision Announced in Q1 of 2025...
12/09/2024
By Jessica Herndon
We all have moments from movies that we love to rewatch. Som...
12/09/2024
St. Louis, MO - September 12, 2024 - Studio Network Solutions (SNS) announced that Legacy Effects, the Oscar-nominated and Emmy-winning FX studio, relies on EVO...
12/09/2024
St. Louis, MO - September 12, 2024 - Studio Network Solutions (SNS) today announced a significant update to its NDI plug-in for Vizrt NRS systems at IBC2024. T...
12/09/2024
St. Louis, MO - September 12, 2024 - Studio Network Solutions (SNS) is showcasing significant updates to the EVO Suite at IBC2024.
Designed to empower media t...
12/09/2024
L3Harris is now one of 13 prime contractors involved in the Australian government's GSC program, designed to support in-country suppliers and bolster global...
12/09/2024
The 3.5-meter glass mirror, which L3Harris polished and finished, has been lifted onto Rubin Observatory's Simonyi Survey Telescope in Chile. This achieveme...
12/09/2024
The new LDX 110 and LDX C110 bring the cutting-edge technology of the LDX 100 series to the entry-level market.
Montreal, Canada, September 12, 2024 -. Grass V...
12/09/2024
NEW YORK - September 11, 2024 - The ABC News Presidential Debate between Vice President Kamala Harris and former President Donald Trump drew an estimated audien...
12/09/2024
Reinvigorated alliance the next step in the evolution of media in Japan and a bi...
12/09/2024
NEW YORK The ABC News Presidential Debate between Vice President Kamala Harris and former President Donald Trump drew an estimated audience of 67.1 million view...
12/09/2024
Boston Conservatory at Berklee to Present Center Stage Production of Jesus Chris...
12/09/2024
The Jennifer Hudson Show returns for its third season on Monday, September 16 with a renewed focus on joy, positivity and inspiration, the show said Tuesday....
12/09/2024
Netflix's The Perfect Couple had its debut as the No. 1 show on connected TV...
12/09/2024
FreeWheel, Comcast's ad-tech company, said it would be integrating Samba TV automatic content recognition viewer data into FreeWheel's Audience Manager,...
12/09/2024
Mike Fisher, who had been executive director of investment innovation at GroupM, has joined Comcast Advertising as executive director, agency development....
12/09/2024
John Leguizamo took the stage at the Hispanic Television Summit, as the session ...
12/09/2024
Samba TV is reporting that 28.3 million homes watched the Presidential Debate hosted by ABC News on Sept. 10. That makes the faceoff between Donald Trump and Ka...
12/09/2024
PARIS Dalet has announced three new members of its executive team. Tara Bryant joins as chief revenue officer (CRO) with responsibilities spanning sales, market...
12/09/2024
BURLINGTON, Mass. Avid has announced improvements to its Avid | Stream IO software subscription solution for broadcast production ingest and playout that are de...
12/09/2024
NEW YORK A new report from Nielsen indicates that the U.S. Hispanic population is having a major influence on the U.S. sports landscape, helping to drive growin...
News summary: New libraries in accelerated computing deliver order-of-magnitude speedups and reduce energy consumption and costs in data processing, generative AI, recommender systems, AI data curation, data processing, 6G research, AI-physics and more. They include:
