Hopper Scales New Heights, Accelerating AI and HPC Applications for Mainstream Enterprise Servers
18/11/2024
During the Supercomputing 2024 conference, NVIDIA announced the availability of the NVIDIA H200 NVL PCIe GPU - the latest addition to the Hopper family. H200 NVL is ideal for organizations with data centers looking for lower-power, air-cooled enterprise rack designs with flexible configurations to deliver acceleration for every AI and HPC workload, regardless of size.
According to a recent survey, roughly 70% of enterprise racks are 20kW and below and use air cooling. This makes PCIe GPUs essential, as they provide granularity of node deployment, whether using one, two, four or eight GPUs - enabling data centers to pack more computing power into smaller spaces. Companies can then use their existing racks and select the number of GPUs that best suits their needs.
Enterprises can use H200 NVL to accelerate AI and HPC applications, while also improving energy efficiency through reduced power consumption. With a 1.5x memory increase and 1.2x bandwidth increase over NVIDIA H100 NVL, companies can use H200 NVL to fine-tune LLMs within a few hours and deliver up to 1.7x faster inference performance. For HPC workloads, performance is boosted up to 1.3x over H100 NVL and 2.5x over the NVIDIA Ampere architecture generation.
Complementing the raw power of the H200 NVL is NVIDIA NVLink technology. The latest generation of NVLink provides GPU-to-GPU communication 7x faster than fifth-generation PCIe - delivering higher performance to meet the needs of HPC, large language model inference and fine-tuning.
The NVIDIA H200 NVL is paired with powerful software tools that enable enterprises to accelerate applications from AI to HPC. It comes with a five-year subscription for NVIDIA AI Enterprise, a cloud-native software platform for the development and deployment of production AI. NVIDIA AI Enterprise includes NVIDIA NIM microservices for the secure, reliable deployment of high-performance AI model inference.
Companies Tapping Into Power of H200 NVL With H200 NVL, NVIDIA provides enterprises with a full-stack platform to develop and deploy their AI and HPC workloads.
Customers are seeing significant impact for multiple AI and HPC use cases across industries, such as visual AI agents and chatbots for customer service, trading algorithms for finance, medical imaging for improved anomaly detection in healthcare, pattern recognition for manufacturing, and seismic imaging for federal science organizations.
Dropbox is harnessing NVIDIA accelerated computing for its services and infrastructure.
Dropbox handles large amounts of content, requiring advanced AI and machine learning capabilities, said Ali Zafar, VP of Infrastructure at Dropbox. We're exploring H200 NVL to continually improve our services and bring more value to our customers.
The University of New Mexico has been using NVIDIA accelerated computing in various research and academic applications.
As a public research university, our commitment to AI enables the university to be on the forefront of scientific and technological advancements, said Prof. Patrick Bridges, director of the UNM Center for Advanced Research Computing. As we shift to H200 NVL, we'll be able to accelerate a variety of applications, including data science initiatives, bioinformatics and genomics research, physics and astronomy simulations, climate modeling and more.
H200 NVL Available Across Ecosystem Dell Technologies, Hewlett Packard Enterprise, Lenovo and Supermicro are expected to deliver a wide range of configurations supporting H200 NVL.
Additionally, H200 NVL will be available in platforms from Aivres, ASRock Rack, ASUS, GIGABYTE, Ingrasys, Inventec, MSI, Pegatron, QCT, Wistron and Wiwynn.
Some systems are based on the NVIDIA MGX modular architecture, which enables computer makers to quickly and cost-effectively build a vast array of data center infrastructure designs.
Platforms with H200 NVL will be available from NVIDIA's global systems partners beginning in December. To complement availability from leading global partners, NVIDIA is also developing an Enterprise Reference Architecture for H200 NVL systems.
The reference architecture will incorporate NVIDIA's expertise and design principles, so partners and customers can design and deploy high-performance AI infrastructure based on H200 NVL at scale. This includes full-stack hardware and software recommendations, with detailed guidance on optimal server, cluster and network configurations. Networking is optimized for the highest performance with the NVIDIA Spectrum-X Ethernet platform.
NVIDIA technologies will be showcased on the showroom floor at SC24, taking place at the Georgia World Congress Center through Nov. 22. To learn more, watch NVIDIA's special address.
See notice regarding software product information.
North America Stories
19/11/2024
Twin Cities PBS To Air Broadcast Wars' Doc
ST. PAUL, Minn. Twin Cities PBS (TPT) said it will premiere Broadcast Wars, an original documentary about local broadcast news in Minneapolis-St. Paul. The pr...
19/11/2024
American Spirit Media Selects Nielsen for Local TV Measurement
NEW YORK Nielsen has reached an expanded multiyear agreement for local TV measurement with Charlotte, North Carolina-based station group American Spirit Media....
19/11/2024
Texas A&M Selects Sony Tech for Virtual Production Institute
BRYAN-COLLEGE STATION, Texas The College of Performance, Visualization and Fine Arts at Texas A&M University has selected Sony Electronics and its equipment and...
19/11/2024
Harmonic Investors Urge Company To Investigate Possible Sale
Calls for Harmonic to seek a possible buyer mounted as Ancora Holdings Group and Romanesque Capital Management urged the pay TV technology provider to maximize ...
19/11/2024
Actually Useful AI Video Effects Explained
Actually Useful AI Video Effects Explained Kelsey Brannan November 18, 2024 0 Comments There are so many AI video generator tools out there, and while...
19/11/2024
OpenDrives Introduces Atlas Professional, A New Mid-Tier Data Management Feature Bundle
OpenDrives Introduces Atlas Professional, A New Mid-Tier Data Management Feature...
18/11/2024
Porcelain War Stands at the Intersection of War, Beauty, and Resistance
(Photo by Suzanne Cordeiro/Shutterstock for Sundance Film Festival) By Patty Consolazio If you find it difficult on any level to justify Russia's war on U...
18/11/2024
Harnessing Data to Power the Future of Space Domain Awareness
How cutting-edge technology from L3Harris is enabling rapid data processing-and faster, more informed decisions in space defense operations....
18/11/2024
American Spirit Media Selects Nielsen for Local TV Measurement
Multi-year deal includes Local TV ratings for all six markets and includes Nielsen's Ad Intel Nielsen's big data + panel solution will power Local TV m...
18/11/2024
Bill Bradford Joins Bitcentral Board of Directors
NEWPORT BEACH, Calif. Bill Bradford, a industry veteran of nearly 30 years with expertise in digital media and technology, has joined the board of directors of ...
18/11/2024
NBA, Warner Bros. Discovery Settle Lawsuit, Ink International Rights Deal
The NBA and Warner Bros. Discovery have reached an agreement that ends WBD's lawsuit against the league and extends their longstanding media partnership for...
18/11/2024
Enhance Image, Video, and Audio Quality with VideoProc AI - 66% OFF This Black Friday
Enhance Image, Video, and Audio Quality with VideoProc AI - 66% OFF This Black F...
18/11/2024
Announcing the Winners of the RE:Vision Effects Raffle, Week 4!
Announcing the Winners of the RE:Vision Effects Raffle, Week 4! Brie Clayton November 18, 2024 0 Comments The results are in for the final week of the...
18/11/2024
Trump Nominates Brendan Carr to Lead FCC
WASHINGTON President-elect Donald Trump has nominated Brendan Carr as the next chair of the Federal Communications Commission. Trump first placed Carr on the FC...
18/11/2024
MARSHALL Unveils CV630 IP PTZ Cameras
Marshall Electronics introduces the new CV630-BI (in black) and CV630-WI (in white) IP PTZ Cameras. The CV630-BI and CV630-WI cameras feature 25X UHD (HEVC) IP ...
18/11/2024
Major Norwegian Broadcaster Taps arkona for Path to IP
arkona technologies GmbH is proud to announce a substantial order from one of Norway s largest broadcasters. The order is for our BLADE//runner solutions for IP...
18/11/2024
Dalet and Caretta Research Publish Future of Newsroom Wor...
Dalet, a leading technology and service provider for media-rich organizations, today published "The Future of Newsroom Workflows," an industry-first report that...
18/11/2024
Clear-Com and MTC Strengthen Bonds in Carlsbad Visit
Clear-Com recently welcomed a delegation from MTC to its Carlsbad, California factory on April 17, 2024. This visit marks another milestone in the enduring part...
18/11/2024
Lightware Launches Dedicated Website Landing Page for its...
Providing an All-In-One Resource for AV Professionals Requiring Reliable, High-Quality Connectivity Solutions Lightware Visual Engineering, a leading manufactu...
18/11/2024
ioMoVo Streamlines Workflows for Creatives and Office Tea...
ioMoVo, a leader in AI-powered digital asset management (DAM), has introduced enhanced integrations with Adobe Creative Cloud and Microsoft 365, enabling a seam...
18/11/2024
Ovyo and The Loop Co Merge to Expand World-Class OTT and...
Ovyo Ltd, a leader in custom OTT & media software services and project delivery, is excited to announce its strategic merger with Portuguese technology services...
18/11/2024
LiveU EcoSystem Drives Record Surge in Live IP Video for...
LiveU s IP-video technology has been synonymous with election coverage since the company was founded in 2006, enabling networks and journalists to deliver non-s...
18/11/2024
Framefloor Evolves Creative Workflows with AJA Gear
Creativity and technology coalesce at Framefloor, a boutique creative shop where experimentation with technologies like augmented reality (AR) and high dynamic ...
18/11/2024
Light Iron welcomes Andrew Geary as Senior Colorist
Light Iron, the post-production creative-services division of Panavision, is excited to announce that Andrew Geary has joined the company as a Senior Colorist. ...
18/11/2024
From Algorithms to Atoms: NVIDIA ALCHEMI NIM Catalyzes Sustainable Materials Research for EV Batteries, Solar Panels and More
More than 96% of all manufactured goods - ranging from everyday products, like l...
18/11/2024
Foxconn Expands Blackwell Testing and Production With New Factories in U.S., Mexico and Taiwan
To meet demand for Blackwell, now in full production, Foxconn, the world's l...
18/11/2024
Hopper Scales New Heights, Accelerating AI and HPC Applications for Mainstream Enterprise Servers
Since its introduction, the NVIDIA Hopper architecture has transformed the AI an...
18/11/2024
NVIDIA Releases cuPyNumeric, Enabling Scientists to Harness GPU Acceleration at Cluster Scale
Whether they're looking at nanoscale electron behaviors or starry galaxies c...
18/11/2024
Faster Forecasts: NVIDIA Launches Earth-2 NIM Microservices for 500x Speedup in Delivering Higher-Resolution Simulations
NVIDIA today at SC24 announced two new NVIDIA NIM microservices that can acceler...
18/11/2024
AI Will Drive Scientific Breakthroughs, NVIDIA CEO Says at SC24
NVIDIA kicked off SC24 in Atlanta with a wave of AI and supercomputing tools set to revolutionize industries like biopharma and climate science. The announceme...
18/11/2024
WBD, NBA Extend Media Partnership; TNT To Produce Inside the NBA for ESPN
WBD, NBA Extend Media Partnership; TNT To Produce Inside the NBA for ESPN By Ken Kerschbaumer, Editorial Director Monday, November 18, 2024 - 9:50 am Print...
18/11/2024
Break Off: Sunset+Vine Pots BBC Snooker Contract with the Triple Crown
Break off: Sunset Vine pots BBC Snooker contract with the Triple Crown By Heather McLean Friday, November 15, 2024 - 09:20 Print This Story Sports product...
18/11/2024
Ten Hot Takes From ESPN's EDGE Innovation Conference
Ten Hot Takes From ESPN's EDGE Innovation Conference Discussions for tech execs range from generative AI to alternative broadcasts By Ken Kerschbaumer, Ed...
18/11/2024
NBC Universal's Stamford Studios Turns 15
NBC Universal's Stamford Studios Turns 15 46,000-square-foot production center offers two soundstages, state-of-the-art HD control rooms By SVG Staff Mon...
18/11/2024
'The Snow Girl 2: The Soul Game' Arrives January 31st
Back to All News The Snow Girl 2: The Soul Game Arrives January 31stPlay Video Play Video Entertainment 18 November 2024 GlobalSpain Link copied to clipbo...
18/11/2024
First Look: 'Apple Cider Vinegar' Uncovers the Bitter Truths of a Wellness Empire
Back to All News First Look: Apple Cider Vinegar Uncovers the Bitter Truths of ...
18/11/2024
Beyonc to Perform at Halftime of Ravens-Texans During NFL Christmas Gameday Live on Netflix
Back to All News Beyonc to Perform at Halftime of Ravens-Texans During NFL Chr...
16/11/2024
FCC to Vote on FM Booster Stations, Caller ID at Nov. 21 Meeting
WASHINGTON The FCC has unveiled a preliminary agenda for its Nov. 21 open meeting that includes votes on rules for FM booster stations, caller ID, submarine cab...
16/11/2024
Scripps News Unveils Streaming Programming Plans
ATLANTA National news network Scripps News said will roll out a new lineup on Nov. 18, after it ends its over-the-air distribution and transitions to a streamin...
16/11/2024
Amazon Passes 250 Million Fire TV Devices Sold, Expands Lineup
Amazon said it has sold more than 250 million Fire TV devices globally since the platform's launch in 2014 and has added new devices to its lineup. They inc...
16/11/2024
Nexstar Hires Ex-Fox News Exec Bill Sammon
IRVING, Texas Nexstar Media Group said it has hired Bill Sammon as senior vice president of Washington editorial content for The Hill and NewsNation....
16/11/2024
Berklee Global Partners with AES Dominicana Foundation and Ministry of Culture for Berklee in Santo Domingo
Berklee Global Partners with AES Dominicana Foundation and Ministry of Culture f...
16/11/2024
Berklee Alumni Win at the 2024 Latin Grammy Awards
Berklee Alumni Win at the 2024 Latin Grammy Awards Juan Luis Guerra '82 won four Latin Grammys, including two of the most prestigious awards: Record of th...
16/11/2024
Meet the Berklee Grads Shaping Latin Music's Future
Meet the Berklee Grads Shaping Latin Music's Future The Miami-based alumni-along with collaborator and Latin Grammy winner Ela Taubert-share their insight...
16/11/2024
Spotifys New Creator Program Is Here to Take On YouTube
Spotifys New Creator Program Is Here to Take On YouTube Spotify for Creators will let podcasters monetize their videos without ads. By Tara Bellucci Novemb...
15/11/2024
Court Approves Diamond Sports Plan To Exit Bankruptcy
SOUTHPORT, Conn. A U.S. bankruptcy court has approved Diamond Sports Group's reorganization plan, paving the way for the troubled regional sports network ow...
15/11/2024
Create With Maxon - Beautiful Texturing for Motion
Create With Maxon - Beautiful Texturing for Motion Brie Clayton November 15, 2024 0 Comments Wednesday, November 20th 5PM GMT / 6PM CET / 9AM Pacific...
15/11/2024
Light Iron welcomes Andrew Geary as Senior Colorist
Light Iron welcomes Andrew Geary as Senior Colorist Brie Clayton November 15, 2024 0 Comments Renowned artist brings extensive feature and series expe...
15/11/2024
Did You Know? Redshift for Cinema 4D: Color Variation Shader
Did You Know? Redshift for Cinema 4D: Color Variation Shader Marc Potocnik November 15, 2024 0 Comments The Did You Know? Redshift for Cinema 4D ser...