NVIDIA Releases NIM Microservices to Safeguard Applications for Agentic AI
16/01/2025
New NVIDIA NIM microservices for AI guardrails - part of the NVIDIA NeMo Guardrails collection of software tools - are portable, optimized inference microservices that help companies improve the safety, precision and scalability of their generative AI applications.
Central to the orchestration of the microservices is NeMo Guardrails, part of the NVIDIA NeMo platform for curating, customizing and guardrailing AI. NeMo Guardrails helps developers integrate and manage AI guardrails in large language model (LLM) applications. Industry leaders Amdocs, Cerence AI and Lowe's are among those using NeMo Guardrails to safeguard AI applications.
Developers can use the NIM microservices to build more secure, trustworthy AI agents that provide safe, appropriate responses within context-specific guidelines and are bolstered against jailbreak attempts. Deployed in customer service across industries like automotive, finance, healthcare, manufacturing and retail, the agents can boost customer satisfaction and trust.
One of the new microservices, built for moderating content safety, was trained using the Aegis Content Safety Dataset - one of the highest-quality, human-annotated data sources in its category. Curated and owned by NVIDIA, the dataset is publicly available on Hugging Face and includes over 35,000 human-annotated data samples flagged for AI safety and jailbreak attempts to bypass system restrictions.
NVIDIA NeMo Guardrails Keeps AI Agents on Track
AI is rapidly boosting productivity for a broad range of business processes. In customer service, it's helping resolve customer issues up to 40% faster. However, scaling AI for customer service and other AI agents requires secure models that prevent harmful or inappropriate outputs and ensure the AI application behaves within defined parameters.
NVIDIA has introduced three new NIM microservices for NeMo Guardrails that help AI agents operate at scale while maintaining controlled behavior:
Content safety NIM microservice that safeguards AI against generating biased or harmful outputs, ensuring responses align with ethical standards.
Topic control NIM microservice that keeps conversations focused on approved topics, avoiding digression or inappropriate content.
Jailbreak detection NIM microservice that adds protection against jailbreak attempts, helping maintain AI integrity in adversarial scenarios.
By applying multiple lightweight, specialized models as guardrails, developers can cover gaps that may occur when only more general global policies and protections exist - as a one-size-fits-all approach doesn't properly secure and control complex agentic AI workflows.
Small language models, like those in the NeMo Guardrails collection, offer lower latency and are designed to run efficiently, even in resource-constrained or distributed environments. This makes them ideal for scaling AI applications in industries such as healthcare, automotive and manufacturing, in locations like hospitals or warehouses.
Industry Leaders and Partners Safeguard AI With NeMo Guardrails
NeMo Guardrails, available to the open-source community, helps developers orchestrate multiple AI software policies - called rails - to enhance LLM application security and control. It works with NVIDIA NIM microservices to offer a robust framework for building AI systems that can be deployed at scale without compromising on safety or performance.
Amdocs, a leading global provider of software and services to communications and media companies, is harnessing NeMo Guardrails to enhance AI-driven customer interactions by delivering safer, more accurate and contextually appropriate responses.
Technologies like NeMo Guardrails are essential for safeguarding generative AI applications, helping make sure they operate securely and ethically, said Anthony Goonetilleke, group president of technology and head of strategy at Amdocs. By integrating NVIDIA NeMo Guardrails into our amAIz platform, we are enhancing the platform's Trusted AI' capabilities to deliver agentic experiences that are safe, reliable and scalable. This empowers service providers to deploy AI solutions safely and with confidence, setting new standards for AI innovation and operational excellence.
Cerence AI, a company specializing in AI solutions for the automotive industry, is using NVIDIA NeMo Guardrails to help ensure its in-car assistants deliver contextually appropriate, safe interactions powered by its CaLLM family of large and small language models.
Cerence AI relies on high-performing, secure solutions from NVIDIA to power our in-car assistant technologies, said Nils Schanz, executive vice president of product and technology at Cerence AI. Using NeMo Guardrails helps us deliver trusted, context-aware solutions to our automaker customers and provide sensible, mindful and hallucination-free responses. In addition, NeMo Guardrails is customizable for our automaker customers and helps us filter harmful or unpleasant requests, securing our CaLLM family of language models from unintended or inappropriate content delivery to end users.
Lowe's, a leading home improvement retailer, is leveraging generative AI to build on the deep expertise of its store associates. By providing enhanced access to comprehensive product knowledge, these tools empower associates to answer customer questions, helping them find the right products to complete their projects and setting a new standard for retail innovation and customer satisfaction.
We're always looking for ways to help associates go above and beyond for our customers, said
LINK: | https://blogs.nvidia.com/blog/nemo-guardrails-nim-microservices/... |
See more stories from nvidia |
North America Stories
04/02/2025
L3Harris Signs Multi-Year Pilot Training Agreement With Thai Airways
L3Harris has signed a two-year agreement with Thai Airways International to provide training service on its A320 Full Flight Simulator (FFS). This significant a...
04/02/2025
US Air Force Completes First Flight of L3Harris Viper Shield Electronic Warfare System
L3Harris' all-digital electronic warfare suite, Viper Shield , completed its...
04/02/2025
PARAMOUNT AND NIELSEN SIGN MULTI-YEAR MEASUREMENT AND ANALYTICS DEAL ACROSS PARAMOUNT'S LEADING BROADCAST, CABLE AND STREAMING PLATFORMS
Nielsen Reports Major Recent Ratings Milestones for CBS and Paramount Series N...
04/02/2025
Grup Mediapro to Collaborate with Google Cloud on Gen AI
BARCELONA Grup Mediapro and Google Cloud have expanded their collaboration to create an innovation lab focused on generative AI to develop solutions for the med...
04/02/2025
EditShare Receives SOCE 2 Type II Certification
WATERTOWN, Mass. EditShare this week said it has received SOC 2 Type II certification, an independently audited evaluation of an organization's information ...
04/02/2025
Executive Creative Director Halle Petro Named Partner of Sonic Union
Executive Creative Director Halle Petro Named Partner of Sonic Union Brie Clayton February 4, 2025 0 Comments Sonic Union is excited to announce Execu...
04/02/2025
Blackmagic Design Announces Blackmagic Camera for Android 2.0 Update
Blackmagic Design Announces Blackmagic Camera for Android 2.0 Update Brie Clayton February 4, 2025 0 Comments New update adds support for Xiaomi Pad 6...
04/02/2025
CETA Software Launches Artist Access: The Time-Tracking Tool for Creative Teams
CETA Software Launches Artist Access: The Time-Tracking Tool for Creative Teams Brie Clayton February 4, 2025 0 Comments CETA Software, creators of p...
04/02/2025
OWC Announces General Availability Launch of OWC Dock Ejector 2.0
OWC Announces General Availability Launch of OWC Dock Ejector 2.0 Brie Clayton February 4, 2025 0 Comments The Ultimate Tool for Efficiently and Safel...
04/02/2025
Paramount, Nielsen Sign Multiyear Measurement and Analytics Deal
NEW YORK Paramount Global and Nielsen have inked a new, multiyear deal that will provide measurement for all of the company's platforms, including national ...
04/02/2025
2d Animated Short Concerning a Project for Schools
2d Animated Short Concerning a Project for Schools Brie Clayton February 3, 2025 0 Comments 2d animated short concerning a project for schools Febru...
04/02/2025
Step by step guide to using 3D Models in After Effects
Step by step guide to using 3D Models in After Effects Graham Quince February 3, 2025 0 Comments Since 2024, Adobe After Effects has had native suppor...
04/02/2025
Powerful Premiere Automation with new Excalibur Update
Powerful Premiere Automation with new Excalibur Update Colin Smith February 3, 2025 0 Comments This tutorial takes you through the new update for auto...
04/02/2025
Cinematography of A Complete Unknown: Shooting 12,800 iso Sony Venice 2 to create a 1960's era film
Cinematography of A Complete Unknown: Shooting 12,800 iso Sony Venice 2 to creat...
04/02/2025
DIY to DA: Ela Minus Breaks Through
DIY to D A: Ela Minus Breaks Through The electronic artist and producer tells Rolling Stone about her new album, D A, and how shes forged a career outside the...
04/02/2025
The Future of Football? Technology and Entertainment Merge in the Kings World Cup Nations
The future of football? Technology and entertainment merge in the Kings World Cu...
04/02/2025
Virtual Production and AR Graphics: Demystifying the Tools, Technologies, and Trends
Virtual Production and AR Graphics: Demystifying the Tools, Technologies, and Tr...
04/02/2025
SVG All-Stars: Russell Fink, Senior Director, Programming and Content Analytics, SNY
SVG All-Stars: Russell Fink, Senior Director, Programming and Content Analytics,...
04/02/2025
SVG New Sponsor Spotlight: farmerswife's Jodi Clifford on Organizing Your Productions Like a Professional
SVG New Sponsor Spotlight: farmerswife's Jodi Clifford on Organizing Your Pr...
04/02/2025
EA Acquires TRACAB Technologies as It Looks to Move Beyond Games
EA Acquires TRACAB Technologies as It Looks to Move Beyond Games EA believes TRACABs sports tracking/analysis technology will help to make the EA SPORTS App the...
04/02/2025
Kingdom Come: Alamiya Media on Bringing the Supercoppa Italiana and Supercopa de Espaa to Saudi Arabia
Kingdom come: Alamiya Media on bringing the Supercoppa Italiana and Supercopa de...
04/02/2025
Alamiya Media at 50: Preparing for Rapid Change, an International Broadcast Center and the FIFA World Cup
Alamiya Media at 50: Preparing for rapid change, an international broadcast cent...
04/02/2025
Clara Galle, Claudia Salas and Paula Usero Star in 'That Night,' the New Netflix Series Based on the Bestselling Novel by Gillian McAllister
Back to All News Clara Galle, Claudia Salas and Paula Usero Star in That Night,...
03/02/2025
L3Harris Technology Enhances US Torpedo Capability
The L3Harris IPLCS is a fiber-optic tether connecting a torpedo to the origin vessel, providing data in real time. Credit: L3Harris...
03/02/2025
VidTrans 2025 to Focus on Security, Dynamic Media Production
BOTHELL, Wash. Video Services Forum (VSF) today announced that the VidTrans 2025 conference and exposition will take place Feb. 25-27 at the Marina del Rey Marr...
03/02/2025
Legislation Proposed to Require Refunds During TV Blackouts
WASHINGTON Last week Rep. Pat Ryan (D-N.Y.) and Sen. Chris Murphy (D-Conn.) introduced the Stop Sports Blackouts Act to make cable and satellite companies ref...
03/02/2025
New Vendors Gain Amazon Prime Video Preferred Certification
Amazon Prime Video has added more companies to its Preferred Vendor Services Program....
03/02/2025
Grand Slam Track Inks Media Rights Deal with The CW, NBC Sports
BURBANK, Calif. The CW, NBC Sports and Grand Slam Track, a new global track competition, have announced a media rights deal that makes The CW the exclusive U.S....
03/02/2025
CJP building virtual production studio for BNU
Adding LED wall to green screen studio expands creative options CJP Broadcast Service Solutions, systems integration, production and content digitisation speci...
03/02/2025
CJP Broadcast Becomes Certified QuickLink Gold Partner to...
CJP Broadcast Service Solutions, a systems integration and content digitisation specialist, has been appointed as a certified QuickLink Gold Partner. This strat...
03/02/2025
2d Animated Short Concerned a Project for Schools
2d Animated Short Concerned a Project for Schools Brie Clayton February 3, 2025 0 Comments 2d animated short concerning a project for schools Februa...
03/02/2025
Academy Award-Winning Production Company Caviar Signs Director Dawit N.M.
Academy Award-Winning Production Company Caviar Signs Director Dawit N.M. Brie Clayton February 3, 2025 0 Comments Academy Award-winning independent p...
03/02/2025
Blackmagic Design Announces Customizable Blackmagic URSA Cine 12K Body
Blackmagic Design Announces Customizable Blackmagic URSA Cine 12K Body Brie Clayton February 3, 2025 0 Comments New body only model of Blackmagic URSA...
03/02/2025
Berklee Alumni Recognized at the 2025 Grammy Awards
Berklee Alumni Recognized at the 2025 Grammy Awards Winners took home trophies in 14 categories, including Album of the Year, Best Pop Vocal Album, and Songwr...
03/02/2025
KVM Advances Simplify Complex Workflows, With More on the Way
For media production companies, the drive for increased efficiency without extensive incremental costs or added complexity is always near the top of the priorit...
03/02/2025
Hybrid Uses of Virtual Production Take Hold Industry-Wide
Any lingering resistance to virtual production involving next-generation elements like LED walls, in-camera visual effects (ICVFX) and mixed reality (MR) is rap...
03/02/2025
Audio Consoles: Surface Still Matters
The physical function of audio mixing remains relatively unchanged today despite technology's onward march. There are now many ways to mix studio and outsid...
03/02/2025
Lightbridge 40 Percent Off CRLS Reflectors
Lightbridge, creators of the renowned Precision Reflectors for motion picture lighting, celebrates 8 years of innovation with a 40% discount on all current CRLS...
03/02/2025
Camera Corps Streamlines Live HDR Sports Production with...
High dynamic range (HDR) has transformed the sports fan experience, enabling broadcasters and OTT providers to deliver live events with remarkably lifelike colo...
03/02/2025
MainConcept Unveils Enhanced Easy Video API with JPEG XS...
MainConcept, the leading provider of video and audio codecs, announces the latest additions to its MainConcept EVA (Easy Video API) technology, set to greatly e...
03/02/2025
Last Samurai Standing' Unveils 14 New Cast Members Ahead of November Debut
Back to All News Last Samurai Standing' Unveils 14 New Cast Members Ahead of November Debut Entertainment 03 February 2025 GlobalJapan Link copied to ...
03/02/2025
Super Bowl LIX: Flown Sound System Adapts Older Stadium for Game, Hip-Hop-Heavy Halftime Show
Super Bowl LIX: Flown Sound System Adapts Older Stadium for Game, Hip-Hop-Heavy ...
03/02/2025
The NAMM Show Continues To Move Beyond the Music
The NAMM Show Continues To Move Beyond the Music Dale Pro Audio had a front-row seat to what has become the major U.S. pro-audio expo By SVG Staff Monday, Fe...
03/02/2025
HPA Tech Retreat Announces: Behind the Scenes of MrBeast, A Conversation
As it heads to its estimable 30th anniversary, the HPA Tech Retreat continues to add one-of-a-kind programming to its schedule. The HPA Tech Retreat committee h...
02/02/2025
Come See Me in the Good Light Wins Festival Favorite Award at 2025 Sundance Film Festival and 2026 Sundance Film Festival Dates Revealed
2026 Edition of Sundance Film Festival to Take Place in Park City and Salt Lake ...
02/02/2025
Sintonia - The Last Party: Netflix Celebrates the Show's Fifth and Final Season With a Free Festival for More Than 10,000 Fans in So Paulo
Back to All News Sintonia - The Last Party: Netflix Celebrates the Shows Fifth ...
02/02/2025
Toma Ikuta Stars in Demon City' with Music by Tomoyasu Hotei, Streaming on February 27
Back to All News Toma Ikuta Stars in Demon City' with Music by Tomoyasu Ho...
01/02/2025
Cow Job Listing: Calling All Creative Editors! Love Japan? Japan-Inspired Video Editor Application
Cow Job Listing: Calling All Creative Editors! Love Japan? Japan-Inspired Video ...
01/02/2025
DirecTV Expands MySports Package to 122 Markets
DirecTV said it has significantly expanded its MySports package, which includes 40 national sports and local broadcast channels, to 122 Nielsen designated marke...