![](//www.4rfv.com/images/no_image.jpg)
Data centers need an upgraded dashboard to guide their journey to greater energy efficiency, one that shows progress running real-world applications.
The formula for energy efficiency is simple: work done divided by energy used. Applying it to data centers calls for unpacking some details.
Today's most widely used gauge - power usage effectiveness (PUE) - compares the total energy a facility consumes to the amount its computing infrastructure uses. Over the last 17 years, PUE has driven the most efficient operators closer to an ideal where almost no energy is wasted on processes like power conversion and cooling.
Finding the Next Metrics PUE served data centers well during the rise of cloud computing, and it will continue to be useful. But it's insufficient in today's generative AI era, when workloads and the systems running them have changed dramatically.
That's because PUE doesn't measure the useful output of a data center, only the energy that it consumes. That'd be like measuring the amount of gas an engine uses without noticing how far the car has gone.
Many standards exist for data center efficiency. A 2017 paper lists nearly three dozen of them, several focused on specific targets such as cooling, water use, security and cost.
Understanding What's Watts When it comes to energy efficiency, the computer industry has a long and somewhat unfortunate history of describing systems and the processors they use in terms of power, typically in watts. It's a worthwhile metric, but many fail to realize that watts only measure input power at a point in time, not the actual energy computers use or how efficiently they use it.
So, when modern systems and processors report rising input power levels in watts, that doesn't mean they're less energy efficient. In fact, they're often much more efficient in the amount of work they do with the amount of energy they use.
Modern data center metrics should focus on energy, what the engineering community knows as kilowatt-hours or joules. The key is how much useful work they do with this energy.
Reworking What We Call Work Here again, the industry has a practice of measuring in abstract terms, like processor instructions or math calculations. So, MIPS (millions of instructions per second) and FLOPS (floating point operations per second) are widely quoted.
Only computer scientists care how many of these low-level jobs their system can handle. Users would prefer to know how much real work their systems put out, but defining useful work is somewhat subjective.
Data centers focused on AI may rely on the MLPerf benchmarks. Supercomputing centers tackling scientific research typically use additional measures of work. Commercial data centers focused on streaming media may want others.
The resulting suite of applications must be allowed to evolve over time to reflect the state of the art and the most relevant use cases. For example, the last MLPerf round added tests using two generative AI models that didn't even exist five years ago.
A Gauge for Accelerated Computing Ideally, any new benchmarks should measure advances in accelerated computing. This combination of parallel processing hardware, software and methods is running applications dramatically faster and more efficiently than CPUs across many modern workloads.
For example, on scientific applications, the Perlmutter supercomputer at the National Energy Research Scientific Computing Center demonstrated an average of 5x gains in energy efficiency using accelerated computing. That's why it's among the 39 of the top 50 supercomputers - including the No. 1 system - on the Green500 list that use NVIDIA GPUs.
Because they execute lots of tasks in parallel, GPUs execute more work in less time than CPUs, saving energy. Companies across many industries share similar results. For example, PayPal improved real-time fraud detection by 10% and lowered server energy consumption nearly 8x with accelerated computing.
The gains are growing with each new generation of GPU hardware and software.
In a recent report, Stanford University's Human-Centered AI group estimated GPU performance has increased roughly 7,000 times since 2003, and price per performance is 5,600 times greater.
Data centers need a suite of benchmarks to track energy efficiency across their major workloads. Two Experts Weigh In Experts see the need for a new energy-efficiency metric, too.
With today's data centers achieving scores around 1.2 PUE, the metric has run its course, said Christian Belady, a data center engineer who had the original idea for PUE. It improved data center efficiency when things were bad, but two decades later, they're better, and we need to focus on other metrics more relevant to today's problems.
Looking forward, the holy grail is a performance metric. You can't compare different workloads directly, but if you segment by workloads, I think there is a better likelihood for success, said Belady, who continues to work on initiatives driving data center sustainability.
Jonathan Koomey, a researcher and author on computer efficiency and sustainability, agreed.
To make good decisions about efficiency, data center operators need a suite of benchmarks that measure the energy implications of today's most widely used AI workloads, said Koomey.
Tokens per joule is a great example of what one element of such a suite might be, Koomey added. Companies will need to engage in open discussions, share information on the nuances of their own workloads and experiments, and agree to realistic test procedures to ensure these metrics accurately characterize energy use for hardware running real-world applications.
Finally, we need an open public forum to conduct this important work, he said.
It Takes a Village Thanks to metrics like PUE an
Most recent headlines
07/09/2024
The official kickoff to the college football season provided another reminder of how football can boost audiences across all platforms, with ESPN and ABC report...
07/09/2024
CAMBRIDGE, U.K. Adder Technology, a provider of connectivity solutions and high performance IP KVM technologies, has announced a new addition to its KVM matrix ...
07/09/2024
CINCINNATI The E.W. Scripps Company (NASDAQ: SSP) has promoted Sean Franklin to vice president and general manager for WLEX, the Scripps-owned NBC affiliate in ...
07/09/2024
AMSTERDAM Cobalt Digital has announced that during the IBC Show it will be sharpening its focus on IP-based solutions by adding a scalable software-based multiv...
07/09/2024
The IBC Talent Programme will look at how the industry can collaborate to foster new talent, make training more accessible, and develop common standards for div...
07/09/2024
The non-profit association aims to reduce risks and support trust in media, in the face of increasing threat levels
By Matthew Corrigan
Published: September ...
07/09/2024
Cerberus Tech, a leader in cloud-native IP contribution and distribution, today announced a series of updates that combine to increase user control in working w...
07/09/2024
Interra Systems, a leading provider of end-to-end quality assurance solutions to the digital media industry, today announced a strategic partnership with Videli...
07/09/2024
oMoVo, an innovator in AI-driven digital asset management (DAM), is launching ioPilot, a new feature in its game-changing DAM platform. Designed to streamline c...
07/09/2024
Creativepool Annual 2024: The Most Awards Launched at Sinfonia Smith Square
Brie Clayton September 7, 2024
0 Comments
The creative industry's mo...
07/09/2024
Meredith Veloz has been named news director at WRMD Tampa, part of NBC Universal Local's Telemundo Station Group. She starts in early October and will repor...
06/09/2024
By Jessica Herndon
One of the most exciting things about the Sundance Film Fes...
06/09/2024
PARK CITY, UTAH - JANUARY 22: (L-R) Eugene Grygo, Phoebe Hoffman, Lana Wilson, Michael Kim, and Nikenya Hall attend the 2024 Sundance Film Festival Look Into M...
06/09/2024
The highly anticipated opus from director Quentin Tarantino doesn't disappoint. It's a typically outrageous conglomeration of comedy and shock laced wit...
06/09/2024
Cinema, the most voyeuristic of mediums, is uniquely placed to convey both the act of surveillance and the psychology of the surveilled. In Seberg, director Ben...
06/09/2024
In February 2019, director J.J. Abrams called Cut! for the last time during principal photography of the ninth chapter of the long-running Star Wars saga. Sta...
06/09/2024
In a cinematic universe expanding with superheroes, the creative challenge for filmmakers is to set newcomers apart from the crowd. The task is doubly important...
06/09/2024
Having photographed episodes of the Showtime horror drama Penny Dreadful's second and third seasons, John Conroy, ISC was eager to reteam with showrunner Jo...
06/09/2024
The psychological thriller Homecoming returns for its sophomore season with fresh twists, nail-biting cliff-hangers, and more of the unnerving cinematography th...
06/09/2024
Based on the series of novels by Eoin Colfer, the feature Artemis Fowl finds its namesake a precocious, hyperintelligent 12-year-old boy (played by Ferdia Sha...
06/09/2024
Vincent lives in Los Angeles, Anthony in New York City. They met on a dating app and have been talking for months, but the physical distance between them has ke...
06/09/2024
What are we going to talk about today? cinematographer Anastas Michos, ASC, GSC asks almost immediately after answering his phone. It's late July when Pana...
06/09/2024
The recent features and bear a number of similarities. Chief among them: Both were shot by cinematographer Hillary Spera. Each story also exists in the realm of...
06/09/2024
Angeliena follows the adventures and self-discovery of its namesake heroine (played by Euodia Samson), a lovable parking attendant who harbors dreams of traveli...
06/09/2024
Pair a British-born songwriter-director who's collaborated with musicians like Jay-Z with a Romanian cinematographer known for shooting intense dramas, and ...
06/09/2024
It was June 2019 when director Baz Luhrmann first approached cinematographer Mandy Walker, ACS, ASC about collaborating on the new biopic Elvis. I was extremel...
06/09/2024
Based on the best-selling mystery novel of the same name, the feature Where the Crawdads Sing tells the story of Kya (Daisy Edgar-Jones), a young woman who grew...
06/09/2024
Johannesburg, 05 September 2024 - The National Film and Video Foundation (NFVF),...
06/09/2024
Video over IP, in the sense that's used in film and television, sometimes feels like a newer idea than it really is. That might be because the high-end, unc...
06/09/2024
The ability of NFL football to attract large audiences in an era of declining viewing for linear TV was on full display in the NFL seasons opener, with an avera...
06/09/2024
MELVILLE, N.Y. Chyron has beefed up its team in EMEA and APAC with the addition of three new positions intended to enhance its growth and better serve customers...
06/09/2024
NEW YORK FutureB2B, a world-leading provider of business intelligence and networking services, is proud to announce the appointment of Joe Palombo as the publis...
06/09/2024
Adventurer A/V, a leading Taiwanese broadcast production company and equipment rental service provider based in Taipei City, has invested in latest-generation U...
06/09/2024
At IBC 2024, Hall 1 B33, leading video software provider, Synamedia, will unveil a raft of new video network solutions as it solidifies its position as a key te...
06/09/2024
LiveU today launched its Lightweight Sports Production solution making fully featured, professional live sports production accessible and affordable for every e...
06/09/2024
Osprey Video
IBC2024 Show Preview
Sept. 13-16
Various Partner Stands
At IBC2024, Osprey Video's encoding/decoding technology will be on display at sever...
06/09/2024
GB Labs, the leader in intelligent, centralized media storage, today announced the launch of NebulaNAS, a transformative new cloud storage solution developed fr...
06/09/2024
Suitest, provider of test automation for OTT applications, today announced the full availability of image- and object-based test automation capabilities in a si...
06/09/2024
France 3 Nouvelle Aquitaine (.3NoA) is a 100% regional channel that aims to promote culture and creativity at regional level.
At the beginning of 2024, the cha...
06/09/2024
At IBC 2024, Camera control specialists Videosys Broadcast will be announcing a new bidirectional radio camera system that will simplify wireless workflows, as ...
06/09/2024
Magnifi by VideoVerse, an AI-driven video technology company and powerful video-editing SaaS platform, has announced a partnership with Storyteller,a leading Sa...
06/09/2024
iWedia, a leading provider of software solutions for connected TV devices and services, is proud to announce its selection as the official vendor for the HbbTV ...
06/09/2024
LTN and Skyline Communications announce a new collaboration to drive enhanced broadcast monitoring and control for Tier 1 media, sports, entertainment, and tech...
06/09/2024
IBC2024 today announces the line-up of speakers and sessions for the first-ever dedicated IBC Talent Programme, taking place on Monday 16 September in the Showc...
06/09/2024
Kiloview, a leading provider of IP-based video transmission solutions, is set to make a significant impact at IBC 2024 with the unveiling of three groundbreakin...
06/09/2024
The newly combined entity of Fabric and Xytech Systems, currently known as Fabric x Xytech, is pleased to announce the appointment of Kira Baca as Chief Revenue...
06/09/2024
Student Spotlight: Mateo Londo o The producer talks about leaving Berklee to grieve the passing of a close friend and fellow student and then returning to fin...
06/09/2024
More rough news for grownups in traditional media. According to a new study from Precise TV, teens prefer the ads on YouTube and are turning to Netflix and YouT...
06/09/2024
A data-driven campaign created by Samsung Ads and Davis Elen Advertising for the...
06/09/2024
Glen Dacy has been named VP of news content and streaming at WFLD-WPWR Chicago, starting September 9. He most recently worked with the CBS Network News Special ...