How AI and Accelerated Computing Drive Energy Efficiency
03/10/2024
From optimizing energy use to reducing emissions, AI and accelerated computing are helping industries tackle some of the world's toughest environmental challenges.
As Joshua Parker, senior director of corporate sustainability at NVIDIA, explains in the latest episode of NVIDIA's AI Podcast, these technologies are powering a new era of energy efficiency.
Parker, a seasoned sustainability professional with a background in law and engineering, has led sustainability initiatives at major companies like Western Digital, where he developed corporate sustainability strategies. His expertise spans corporate sustainability, intellectual property and environmental impact.
The AI Podcast NVIDIA's Josh Parker on How AI and Accelerated Computing Drive Sustainability Ep. 233
AI can, in fact, help reduce energy consumption. And it's doing it in some surprising ways.
AI systems themselves use energy, of course, but the big story is how AI and accelerated computing are helping other systems save energy. Take data centers, for instance.
They're the backbone of AI, housing the powerful systems that crunch the data needed for AI to work in services like chatbots, AI-powered search and content generation. Globally, data centers account for about 2% of total energy consumption, and AI-specific centers represent only a tiny fraction of that.
AI still accounts for a tiny, tiny fraction of overall energy consumption globally, Parker said. Yet, the potential for AI to optimize energy use is vast.
Despite this, AI's real superpower lies in its ability to optimize.
How? By using accelerated computing platforms that combine GPUs and CPUs. GPUs are designed to handle complex computations quickly and efficiently.
In fact, these systems can be up to 20x more energy-efficient than traditional CPU-only systems for AI inference and training, Parker notes.
This progress has contributed to massive gains in energy efficiency over the past eight years, which is part of the reason AI is now able to tackle increasingly complex problems.
What Is Accelerated Computing? At its core, accelerated computing is about doing more with less.
It involves using specialized hardware - like GPUs - to perform tasks faster and with less energy.
This isn't just theoretical. The change in efficiency is really, really dramatic, Parker emphasized.
If you compare the energy efficiency for AI inference from eight years ago until today, [it's] 45,000 times more energy efficient, Parker said.
This matters because as AI becomes more widespread, the demand for computing power grows.
Accelerated computing helps companies scale their AI operations without consuming massive amounts of energy.
This energy efficiency is key to AI's ability to tackle some of today's biggest sustainability challenges.
AI in Action: Tackling Climate Change AI isn't just saving energy - it's helping to fight climate change.
AI and accelerated computing in general are game-changers when it comes to weather and climate modeling and simulation, Parker said.
For instance, AI-enhanced weather forecasting is becoming more accurate, allowing industries and governments to prepare for climate-related events like hurricanes or floods, Parker explained.
The better we can predict these events, the better we can prepare for them, which means fewer resources wasted and less damage done.
Another key area is the rise of digital twins - virtual models of physical environments.
These AI-powered simulations allow companies to optimize energy consumption in real time, without having to make costly changes in the physical world. In one case, using a digital twin helped a company achieve a 10% reduction in energy use, Parker said.
That may sound small, but scale it across industries, and the impact is huge.
AI is also playing a crucial role in developing new materials for renewable energy technologies like solar panels and electric vehicles, helping accelerate the transition to clean energy.
Can AI Make Data Centers More Sustainable? AI needs data centers to operate, and, as AI grows, so does the demand for computing power. But data centers don't have to be energy hogs. In fact, they can be part of the sustainability solution.
One major innovation is direct-to-chip liquid cooling. This technology allows data centers to cool their systems much more efficiently than traditional air conditioning methods, which are often energy-intensive.
Our recommended design for the data centers for our new B200 chip is focused all on direct-to-chip liquid cooling, Parker explained. By cooling directly at the chip level, this method saves energy, helping data centers stay cool without guzzling power.
As AI scales up, the future of data centers will depend on designing for energy efficiency from the ground up.
That means integrating renewable energy, using energy storage solutions and continuing to innovate with cooling technologies.
The goal is to create green data centers that can meet the world's growing demand for compute power without increasing their carbon footprint.
The compute density is so high that it makes more sense to invest in the cooling because you're getting so much more compute for that same single direct-to-chip cooling element, Parker said.
The Role of AI in Building a Sustainable Future AI is not just a tool for optimizing systems - it's a driver of sustainable innovation.
From improving the efficiency of energy grids to enhancing supply chain logistics, AI is leading the charge in reducing waste and emissions.
AI, I firmly believe, is going to be the best tool that we've ever seen to help us achieve more sustainability and more sustainable outcomes, Parker said.
The AI Podcast NVIDIA&
North America Stories
04/10/2024
Food and Country: When Farmers and Chefs Cry
Georgia farmers Will Harris and daughters Jenni Harris (right) and Jodi Harris (left) are featured in Food and Country, which premiered at the 2023 Sundance F...
04/10/2024
L3Harris Supports United Launch Alliance's Second Vulcan Launch
The United Launch Alliance (ULA) Vulcan rocket lifts off Oct. 4, 2024 from Space Launch Complex-41 (SLC-41) at Cape Canaveral on the Cert-2 flight test. Photo C...
04/10/2024
Nielsen launches deduplicated YouTube CTV campaign measurement in the Philippines
Philippines October 1 ,2024 Nielsen, a global leader in audience measurement...
04/10/2024
Nielsen data reveals finance industry's top ad spenders as ad investment for the sector jumps more than 9%, year-on-year
Top 12 financial service brands (by ad spend) revealed How the finance industry...
04/10/2024
Samsung Adds Gen AI to its Smart TVs
Samsung's Smart TVs are getting even smarter with the company's announcement this week that it is adding generative AI to its TV lineup....
04/10/2024
The easiest way to create a Progress Bar in After Effects
The easiest way to create a Progress Bar in After Effects Graham Quince October 4, 2024 0 Comments Forget using expressions, complex equations or anim...
04/10/2024
IBC Attendees Grapple With AI Reality vs. Expectations
If anyone doubted the normalization of AI in the M&E space is a fait accompli, the IBC Show in Amsterdam put that notion to rest last month with the help of som...
04/10/2024
Hearst Television Promotes Derek Schnell to Regional Director of News
NEW YORK Derek Schnell, who since 2018 has served as news director of KCRA-TV and KQCA-TV, Hearst Television's NBC- and CW-affiliated stations in Sacrament...
04/10/2024
Samsung's Adds Gen AI to its Smart TVs
Samsung's Smart TVs are getting even smarter with the company's announcement this week that it is adding generative AI to its TV lineup....
04/10/2024
Eighteen Blackmagic Design Cameras Used for KIRINJI's 25th Anniversary Live Concert
Eighteen Blackmagic Design Cameras Used for KIRINJI's 25th Anniversary Live ...
04/10/2024
CPB Awards Grants to Public Media Stations for NextGen TV Warning System
WASHINGTON The Corporation for Public Broadcasting (CPB) announced today it has awarded 30 grants to date through the first round of the Next Generation Warning...
04/10/2024
NAB Show New York Exhibitor Insight: Black Box Corp.
TV TECH: What do you anticipate will be the most significant technology trends at the 2024 NAB Show New York?...
04/10/2024
HPA Taps Creative Category Awards Nominees for 2024
The Hollywood Professional Association Monday tapped a host of creative teams from high-profile projects as Creative Category Nominees in the 2024 HPA Awards, w...
04/10/2024
FCC Names Former Verizon Exec as Enforcement Bureau's First CTO
WASHINGTON The FCC's Enforcement Bureau has appointed Andy Hendrickson as its new chief technology officer, tasked with providing strategic and technical ad...
04/10/2024
NAB Show New York Exhibitor Insight: Matrox Video
TV TECH: What do you anticipate will be the most significant technology trends at the 2024 NAB Show New York?...
04/10/2024
Tech Emmys Add New Excellence in Production Technology' Category
NEW YORK and LOS ANGELES The National Academy of Television Arts & Sciences (NATAS) is introducing a new category for the 75th Technology & Engineering Awards t...
04/10/2024
FOX Sports' Devin Klein on the Philosophies Driving At-Home' Production
FOX Sports' Devin Klein on the Philosophies Driving At-Home' Production By Jason Dachman, Editorial Director, U.S. Friday, October 4, 2024 - 9:21 am...
04/10/2024
Super League Basketball: Sustainability, Consistency in Focus as New League Shares Broadcast Plans
Super League Basketball: Sustainability and consistency in focus as new league s...
04/10/2024
AES Show NY 2024: Updates, Upgrades, New Gear for Audio
AES Show NY 2024: Updates, Upgrades, New Gear for Audio Combined AES and NAB expos demonstrate synergy of audio and video By Dan Daley, Audio Editor Friday, ...
04/10/2024
MLB Postseason 2024: Fox Sports Brings Back DirtCams, FlyCam, UmpCam, and Drones
MLB Postseason 2024: Fox Sports Brings Back DirtCams, FlyCam, UmpCam, and Drones All NLDS, NLCS and World Series broadcasts will be produced out of trucks on-si...
04/10/2024
MLB Postseason 2024: TNT Sports Rolls Out BaseCam, UmpCam, and Drones; Will Feature MLB DataCast' for ALCS
MLB Postseason 2024: TNT Sports Rolls Out BaseCam, UmpCam, and Drones; Will Feat...
03/10/2024
Give Me the Backstory: Get to Know 4 Latine Filmmakers With Shorts at the 2024 Sundance Film Festival
A still from Daniel Barosa's Boi de Conchas (The Shell Covered Ox), which ...
03/10/2024
Hollywood Professional Association Unveils 2024 HPA Awards Creative Category Nominees
The HPA Awards Committee today announced the nominees for the Creative Categorie...
03/10/2024
2024 Vice Presidential Debate Draws Over 43 Million Viewers
NEW YORK - October 2, 2024 - An estimated 43.15 million viewers watched the CBS News Vice Presidential Debate across 15 networks on Tuesday, October 1, accordin...
03/10/2024
Blackmagic Cinema Camera 6K Supports Troy University's Art and Design Department
Blackmagic Cinema Camera 6K Supports Troy University's Art and Design Depart...
03/10/2024
Create With Maxon: Marble Run - Simulation and Rendering
Create With Maxon: Marble Run - Simulation and Rendering Brie Clayton October 3, 2024 0 Comments Wednesday, October 9th 4PM GMT / 6PM CET / 9AM Pacifi...
03/10/2024
Shattered Reflection in Resolve Fusion
Shattered Reflection in Resolve Fusion Simon Ubsdell October 3, 2024 0 Comments How to make a dramatic reflection scene in Fusion: render passes, shad...
03/10/2024
Student Spotlight: Rafael Heredia
Student Spotlight: Rafael Heredia The flamenco percussionist is channeling the vibrant music scenes of Japan and Spain in his musical explorations at Berklee,...
03/10/2024
Berklee and Can We Talk Celebrate Healing Power of the Arts in BIPOC Communities
Berklee and Can We Talk Celebrate Healing Power of the Arts in BIPOC Communities Arts Activation 2024: Harmony and Healing (October 19) unites artists, thoug...
03/10/2024
Nielsen: VP Debate Draws Just Over 43M Viewers
NEW YORK An estimated 43.15 million viewers watched the CBS News Vice Presidential Debate across 15 networks on Tuesday, according to Nielsen. The first and onl...
03/10/2024
QuickLink StudioPro Controller Revolutionizes Video Prod...
QuickLink, empowering creatives to exceed modern-day standards of production, is launching the new QuickLink StudioPro Controller control panel at NAB New York...
03/10/2024
TAG to Bring Award Winning Technologies that Maximize Dat...
TAG Video Systems, the leader in software-based IP end-to-end workflow monitoring, deep probing, and real-time visualization, is presenting its Realtime Media P...
03/10/2024
Telestream and Starin partner to deliver transformational...
Telestream and Starin, a value-add distributor of broadcast and pro AV products, are pleased to announce a distribution partnership to deliver Telestream's ...
03/10/2024
Vizrt expands TriCaster possibilities with new flagship a...
Vizrt, the leader in real-time graphics and live production solutions for content creators, today announces two new additions to the TriCaster family, TriCaster...
03/10/2024
Radio Clodia Celebrates 40th Anniversary with Upgrade to...
Celebrating its 40th anniversary this year, Radio Clodia has chosen a DHD SX2 audio mixing console and XC3 IP processing core in a major upgrade of the producti...
03/10/2024
Waymark Launches Single-Click AI-Powered Ad Generator
DETROIT Waymark, a developer of AI video-creation technology, is launching Variations, a new technology that generates video ads in multiple lengths and aspec...
03/10/2024
Vizrt expands TriCaster possibilities with new flagship and entry-level solutions, TriCaster Vizion and TriCaster Mini S
Vizrt expands TriCaster possibilities with new flagship and entry-level solution...
03/10/2024
VFX Industry Veteran Joseph Bell Releases the Visual Effects World Atlas
VFX Industry Veteran Joseph Bell Releases the Visual Effects World Atlas Brie Clayton October 2, 2024 0 Comments Long frustrated by the shortage of cl...
03/10/2024
The Surge in Women's Sports TV Viewing: A New Era for Advertising Opportunities
With the WNBA's semifinal playoff round underway, and the first gender-equal...
03/10/2024
Warner Bros. Discovery and AEW Ink Multi-Year Media Rights Renewal That Includes Streaming on Max
Warner Bros. Discovery and AEW Ink Multi-Year Media Rights Renewal That Includes...
03/10/2024
NEP Specialty Capture Improves Pylon Camera, Offers 4K Pan-and-Scan and Super-Slo-Mo
NEP Specialty Capture Improves Pylon Camera, Offers 4K Pan-and-Scan and Super-Sl...
03/10/2024
Diamond Sports Group Confirms Plans to Drop 11 of 12 MLB Teams, Indicates Potential for NBA and NHL Teams to Leave in 2025
Diamond Sports Group Confirms Plans to Drop 11 of 12 MLB Teams, Indicates Potent...
03/10/2024
Warner Bros. Discovery's Chris Brown on Building REMI Control Rooms at the Network's Techwood Headquarters
Warner Bros. Discovery's Chris Brown on Building REMI Control Rooms at the N...
03/10/2024
The Shadow Strays' Trailer Tease Dark Suspense and Intense Fight Choreography
Back to All News The Shadow Strays' Trailer Tease Dark Suspense and Intens...
03/10/2024
Uncover the Darkest Depths in Bangkok Breaking: Heaven and Hell': Thai Action Film Climbs Global Charts
Back to All News Uncover the Darkest Depths in Bangkok Breaking: Heaven and He...
03/10/2024
No Tricks, Just Games: GeForce NOW Thrills With 22 Games in October
The air is crisp, the pumpkins are waiting to be carved, and GFN Thursday is ready to deliver some gaming thrills. GeForce NOW is unleashing a monster mash of ...
03/10/2024
How AI and Accelerated Computing Drive Energy Efficiency
AI isn't just about building smarter machines. It's about building a greener world. From optimizing energy use to reducing emissions, AI and accelerate...
02/10/2024
Release Rundown: Your Monster, Union, and More Reach Wider Audiences This October
Aspiring actor Laura (Melissa Barrera) contends with a peculiar houseguest in wr...
02/10/2024
Give Me the Backstory: Get to Know Nora Fingscheidt, the Writer-Director of The Outrun
By Bailey Pennick One of the most exciting things about the Sundance Film Festi...
02/10/2024
Nielsen launches deduplicated YouTube CTV campaign measurement in Japan
Tokyo, Japan September 17, 2024: Nielsen, a global leader in audience measurement, data and analytics, has today announced the expansion of YouTube Connected ...