US Healthcare System Deploys AI Agents, From Research to Rounds
08/10/2024
The latest AI-accelerated tools - on display at the NVIDIA AI Summit taking place this week in Washington, D.C. - include NVIDIA NIM, a collection of cloud-native microservices that support AI model deployment and execution, and NVIDIA NIM Agent Blueprints, a catalog of pretrained, customizable workflows.
These technologies are already in use in the public sector to advance the analysis of medical images, aid the search for new therapeutics and extract information from massive PDF databases containing text, tables and graphs.
For example, researchers at the National Cancer Institute, part of the National Institutes of Health (NIH), are using several AI models built with NVIDIA MONAI for medical imaging - including the VISTA-3D NIM foundation model for segmenting and annotating 3D CT images. A team at NIH's National Center for Advancing Translational Sciences (NCATS) is using the NIM Agent Blueprint for generative AI-based virtual screening to reduce the time and cost of developing novel drug molecules.
With NVIDIA NIM and NIM Agent Blueprints, medical researchers across the public sector can jump-start their adoption of state-of-the-art, optimized AI models to accelerate their work. The pretrained models are customizable based on an organization's own data and can be continually refined based on user feedback.
NIM microservices and NIM Agent Blueprints are available at ai.nvidia.com and accessible through a wide variety of cloud service providers, global system integrators and technology solutions providers.
Building With NIM Agent Blueprints Dozens of NIM microservices and a growing set of NIM Agent Blueprints are available for developers to experience and download for free. They can be deployed in production with the NVIDIA AI Enterprise software platform.
The blueprint for generative virtual screening for drug discovery brings together three NIM microservices to help researchers search and optimize libraries of small molecules to identify promising candidates that bind to a target protein.
The multimodal PDF data extraction blueprint uses NVIDIA NeMo Retriever NIM microservices to extract insights from enterprise documents, helping developers build powerful AI agents and chatbots.
The digital human blueprint supports the creation of interactive, AI-powered avatars for customer service. These avatars have potential applications in telehealth and nonclinical aspects of patient care, such as scheduling appointments, filling out intake forms and managing prescriptions.
Two new NIM microservices for drug discovery are now available on ai.nvidia.com to help researchers understand how proteins bind to target molecules, a crucial step in drug design. By conducting more of this preclinical research digitally, scientists can narrow down their pool of drug candidates before testing in the lab - making the discovery process more efficient and less expensive.
With the AlphaFold2-Multimer NIM microservice, researchers can accurately predict protein structure from their sequences in minutes, reducing the need for time-consuming tests in the lab. The RFdiffusion NIM microservice uses generative AI to design novel proteins that are promising drug candidates because they're likely to bind with a target molecule.
NCATS Accelerates Drug Discovery Research ASPIRE, a research laboratory at NCATS, is evaluating the NIM Agent Blueprint for virtual screening and is using RAPIDS, a suite of open-source software libraries for GPU-accelerated data science, to accelerate its drug discovery research. Using the cuGraph library for graph data analytics and cuDF library for accelerating data frames, the lab's researchers can map chemical reactions across the vast unknown chemical space.
The NCATS informatics team reported that with NVIDIA AI, processes that used to take hours on CPU-based infrastructure are now done in seconds.
Massive quantities of healthcare data - including research papers, radiology reports and patient records - are unstructured and locked in PDF documents, making it difficult for researchers to quickly search for information.
The Genetic and Rare Diseases Information Center, also run by NCATS, is exploring using the PDF data extraction blueprint to develop generative AI tools that enhance the center's ability to glean information from previously unsearchable databases. These tools will help answer questions from those affected by rare diseases.
The center analyzes data sources spanning the National Library of Medicine, the Orphanet database and other institutes and centers within the NIH to answer patient questions, said Sam Michael, chief information officer of NCATS. AI-powered PDF data extraction can make it massively easier to extract valuable information from previously unsearchable databases.
Mi-NIM-al Effort, Maximum Benefit: Getting Started With NIM A growing number of startups, cloud service providers and global systems integrators include NVIDIA NIM microservices and NIM Agent Blueprints as part of their platforms and services, making it easy for federal healthcare researchers to get started.
Abridge, an NVIDIA Inception startup and NVentures portfolio company, was recently awarded a contract from the U.S. Department of Veterans Affairs to help transcribe and summarize clinical appointments, reducing the burden on doctors to document each patient interaction.
The company uses NVIDIA TensorRT-LLM to accelerate AI inference and NVIDIA Triton Inference Server for deploying its audio-to-text and content summarization models at scale, some of the same technologies that power NIM microservices.
The NIM Agent Blueprint for virtual screening is now available through AWS HealthOmics, a purpose-built s
More from Nvidia
19/12/2024
AI's in Style: Ulta Beauty Helps Shoppers Virtually Try New Hairstyles
Shoppers pondering a new hairstyle can now try styles before committing to curls or a new color. An AI app by Ulta Beauty, the largest specialty beauty retailer...
19/12/2024
NieR Perfect: GeForce NOW Loops Square Enix's NieR:Automata' and NieR Replicant ver.1.22474487139' Into the Cloud
Stuck in a gaming rut? Get out of the loop this GFN Thursday with four new games...
18/12/2024
AI at Your Service: Digital Avatars With Speech Capabilities Offer Interactive Customer Experiences
Editor's note: This post is part of the AI On blog series, which explores th...
18/12/2024
Imbue's Kanjun Qiu Shares Insights on How to Build Smarter AI Agents
Imagine a future in which everyone is empowered to build and use their own AI agents. That future may not be far off, as new software is infused with intelligen...
18/12/2024
NVIDIA Awards up to $60,000 Research Fellowships to PhD Students
For more than two decades, the NVIDIA Graduate Fellowship Program has supported graduate students doing outstanding work relevant to NVIDIA technologies. Today,...
17/12/2024
AI in Your Own Words: NVIDIA Debuts NeMo Retriever Microservices for Multilingual Generative AI Fueled by Data
In enterprise AI, understanding and working across multiple languages is no long...
17/12/2024
NVIDIA Unveils Its Most Affordable Generative AI Supercomputer
NVIDIA is taking the wraps off a new compact generative AI supercomputer, offering increased performance at a lower price with a software upgrade. The new NVID...
16/12/2024
Tech Leader, AI Visionary, Endlessly Curious Jensen Huang to Keynote CES 2025
On Jan. 6 at 6:30 p.m. PT, NVIDIA founder and CEO Jensen Huang - with his trademark leather jacket and an unwavering vision - will step onto the CES 2025 stage....
12/12/2024
Ready Player Fun: GFN Thursday Brings Six New Adventures to the Cloud
From heart-pounding action games to remastered classics, there's something for everyone this GFN Thursday. Six new titles join the cloud this week, startin...
11/12/2024
Driving Mobility Forward, Vay Brings Advanced Automotive Solutions to Roads With NVIDIA DRIVE AGX
Vay, a Berlin-based provider of automotive-grade remote driving (teledriving) te...
11/12/2024
Built for the Era of AI, NVIDIA RTX AI PCs Enhance Content Creation, Gaming, Entertainment and More
Editor's note: This post is part of the AI Decoded series, which demystifies...
11/12/2024
Into the Omniverse: How OpenUSD-Based Simulation and Synthetic Data Generation Advance Robot Learning
Editor's note: This post is part of Into the Omniverse, a series focused on ...
10/12/2024
AI Pioneers Win Nobel Prizes for Physics and Chemistry
Artificial intelligence, once the realm of science fiction, claimed its place at the pinnacle of scientific achievement Monday in Sweden. In a historic ceremon...
10/12/2024
Turn Down the Noise: CUDA-Q Enables Industry-First Quantum Computing Demo With Logical Qubits
Quantum computing has the potential to transform industries ranging from drug di...
09/12/2024
Crowning Achievement: NVIDIA Research Model Enables Fast, Efficient Dynamic Scene Reconstruction
Content streaming and engagement are entering a new dimension with QUEEN, an AI ...
06/12/2024
Thailand and Vietnam Embrace Sovereign AI to Drive Economic Growth
Southeast Asia is embracing sovereign AI. The prime ministers of Thailand and Vietnam this week met with NVIDIA founder and CEO Jensen Huang to discuss initiat...
05/12/2024
2025 Predictions: Enterprises, Researchers and Startups Home In on Humanoids, AI Agents as Generative AI Crosses the Chasm
From boardroom to break room, generative AI took this year by storm, stirring di...
05/12/2024
Stream Indiana Jones and the Great Circle' at Launch With RTX Power in the Cloud at up to 50% Off
GeForce NOW is wrapping a sleigh-full of gaming gifts this month, stuffing membe...
04/12/2024
NVIDIA NIM on AWS Supercharges AI Inference
Generative AI is rapidly transforming industries, driving demand for secure, high-performance inference solutions to scale increasingly complex models efficient...
03/12/2024
NVIDIA Advances Physical AI With Accelerated Robotics Simulation on AWS
Field AI is building robot brains that enable robots to autonomously manage a wide range of industrial processes. Vention creates pretrained skills to ease deve...
03/12/2024
Latest NVIDIA AI, Robotics and Quantum Computing Software Comes to AWS
Expanding what's possible for developers and enterprises in the cloud, NVIDIA and Amazon Web Services are converging at AWS re:Invent in Las Vegas this week...
03/12/2024
How AI Can Enhance Disability Inclusion, Special Education
A recent survey from the Special Olympics Global Center for Inclusion in Education shows that while a majority of students with an intellectual and developmenta...
03/12/2024
New NVIDIA Certifications Expand Professionals' Credentials in AI Infrastructure and Operations
As generative AI continues to grow, implementing and managing the right infrastr...
02/12/2024
Siemens Healthineers Adopts MONAI Deploy for Medical Imaging AI
3.6 billion. That's about how many medical imaging tests are performed annually worldwide to diagnose, monitor and treat various conditions. Speeding up th...
28/11/2024
Get the Power of GeForce-Powered Gaming in the Cloud Half Off With Black Friday Deal
Turn Black Friday into Green Thursday with a new deal on GeForce NOW Ultimate an...
27/11/2024
How RTX AI PCs Unlock AI Agents That Solve Complex Problems Autonomously With Generative AI
Editor's note: This post is part of the AI Decoded series, which demystifies...
26/11/2024
Taste of Success: Zordi Plants AI and Robotics to Grow Flavorful Strawberries Indoors
With startup Zordi, founder Gilwoo Lee's enthusiasm for robotics, healthy ea...
25/11/2024
Why Workforce Development Is Key to Reaping AI Benefits
AI is changing industries and economies worldwide. Workforce development is central to ensuring the changes benefit all of us, as Louis Stewart, head of strate...
25/11/2024
Now Hear This: World's Most Flexible Sound Machine Debuts
A team of generative AI researchers created a Swiss Army knife for sound, one that allows users to control the audio output simply using text. While some AI mo...
21/11/2024
Efficiency Meets Personalization: How AI Agents Improve Customer Service
Editor's note: This post is the first in the AI On blog series, which explores the latest techniques and real-world applications of agentic AI, chatbots and...
21/11/2024
First Star Wars Outlaws' Story Pack Hits GeForce NOW
Get ready to dive deeper into the criminal underworld of a galaxy far, far away as GeForce NOW brings the first major story pack for Star Wars Outlaws to the cl...
21/11/2024
Into the Omniverse: How Generative AI Fuels Personalized, Brand-Accurate Visuals With OpenUSD
Editor's note: This post is part of Into the Omniverse, a blog series focuse...
20/11/2024
The Need for Speed: NVIDIA Accelerates Majority of World's Supercomputers to Drive Advancements in Science and Technology
Starting with the release of CUDA in 2006, NVIDIA has driven advancements in AI ...
19/11/2024
AI at COP29: Balancing Innovation and Sustainability
As COP29 attendees gather in Baku, Azerbaijan, to tackle climate change, the role AI plays in environmental sustainability is front and center. A panel hosted ...
19/11/2024
How the Department of Energy's AI Initiatives Are Transforming Science, Industry and Government
The U.S. Department of Energy oversees national energy policy and production. As...
19/11/2024
Microsoft and NVIDIA Supercharge AI Development on RTX AI PCs
Generative AI-powered laptops and PCs are unlocking advancements in gaming, content creation, productivity and development. Today, over 600 Windows apps and gam...
19/11/2024
NVIDIA and Microsoft Showcase Blackwell Preview, Omniverse Industrial AI and RTX AI PCs at Microsoft Ignite
NVIDIA and Microsoft today unveiled product integrations designed to advance ful...
18/11/2024
From Algorithms to Atoms: NVIDIA ALCHEMI NIM Catalyzes Sustainable Materials Research for EV Batteries, Solar Panels and More
More than 96% of all manufactured goods - ranging from everyday products, like l...
18/11/2024
Foxconn Expands Blackwell Testing and Production With New Factories in U.S., Mexico and Taiwan
To meet demand for Blackwell, now in full production, Foxconn, the world's l...
18/11/2024
Hopper Scales New Heights, Accelerating AI and HPC Applications for Mainstream Enterprise Servers
Since its introduction, the NVIDIA Hopper architecture has transformed the AI an...
18/11/2024
NVIDIA Releases cuPyNumeric, Enabling Scientists to Harness GPU Acceleration at Cluster Scale
Whether they're looking at nanoscale electron behaviors or starry galaxies c...
18/11/2024
Faster Forecasts: NVIDIA Launches Earth-2 NIM Microservices for 500x Speedup in Delivering Higher-Resolution Simulations
NVIDIA today at SC24 announced two new NVIDIA NIM microservices that can acceler...
18/11/2024
AI Will Drive Scientific Breakthroughs, NVIDIA CEO Says at SC24
NVIDIA kicked off SC24 in Atlanta with a wave of AI and supercomputing tools set to revolutionize industries like biopharma and climate science. The announceme...
14/11/2024
From Seed to Stream: Farming Simulator 25' Sprouts on GeForce NOW
Grab a pitchfork and fire up the tractor - the fields of GeForce NOW are about to get a whole lot greener with Farming Simulator 25. Whether looking for a time...
14/11/2024
Open for Development: NVIDIA Works With Cloud-Native Community to Advance AI and ML
Cloud-native technologies have become crucial for developers to create and imple...
14/11/2024
NVIDIA Ranks No. 1 as Forbes Debuts List of America's Best Companies 2025
NVIDIA ranked No. 1 on Forbes magazine's new list - America's Best Companies - based on more than 60 measures in nearly a dozen categories that cover fi...
14/11/2024
Keeping an AI on Diabetes Risk: Gen AI Model Predicts Blood Sugar Levels Four Years Out
Diabetics - or others monitoring their sugar intake - may look at a cookie and w...
13/11/2024
Indonesia Tech Leaders Team With NVIDIA and Partners to Launch Nation's AI
Working with NVIDIA and its partners, Indonesia's technology leaders have launched an initiative to bring sovereign AI to the nation's more than 277 mil...
13/11/2024
2025 Predictions: AI Finds a Reason to Tap Industry Data Lakes
Since the advent of the computer age, industries have been so awash in stored data that most of it never gets put to use. This data is estimated to be in the n...
13/11/2024
Peak Training: Blackwell Delivers Next-Level MLPerf Training Performance
Generative AI applications that use text, computer code, protein chains, summaries, video and even 3D graphics require data-center-scale accelerated computing t...