Sony Pixel Power calrec Sony

NVIDIA Releases NIM Microservices to Safeguard Applications for Agentic AI

16/01/2025

AI agents are poised to transform productivity for the world's billion knowledge workers with knowledge robots that can accomplish a variety of tasks. To develop AI agents, enterprises need to address critical concerns like trust, safety, security and compliance.

New NVIDIA NIM microservices for AI guardrails - part of the NVIDIA NeMo Guardrails collection of software tools - are portable, optimized inference microservices that help companies improve the safety, precision and scalability of their generative AI applications.

Central to the orchestration of the microservices is NeMo Guardrails, part of the NVIDIA NeMo platform for curating, customizing and guardrailing AI. NeMo Guardrails helps developers integrate and manage AI guardrails in large language model (LLM) applications. Industry leaders Amdocs, Cerence AI and Lowe's are among those using NeMo Guardrails to safeguard AI applications.

Developers can use the NIM microservices to build more secure, trustworthy AI agents that provide safe, appropriate responses within context-specific guidelines and are bolstered against jailbreak attempts. Deployed in customer service across industries like automotive, finance, healthcare, manufacturing and retail, the agents can boost customer satisfaction and trust.

One of the new microservices, built for moderating content safety, was trained using the Aegis Content Safety Dataset - one of the highest-quality, human-annotated data sources in its category. Curated and owned by NVIDIA, the dataset is publicly available on Hugging Face and includes over 35,000 human-annotated data samples flagged for AI safety and jailbreak attempts to bypass system restrictions.

NVIDIA NeMo Guardrails Keeps AI Agents on Track

AI is rapidly boosting productivity for a broad range of business processes. In customer service, it's helping resolve customer issues up to 40% faster. However, scaling AI for customer service and other AI agents requires secure models that prevent harmful or inappropriate outputs and ensure the AI application behaves within defined parameters.

NVIDIA has introduced three new NIM microservices for NeMo Guardrails that help AI agents operate at scale while maintaining controlled behavior:

Content safety NIM microservice that safeguards AI against generating biased or harmful outputs, ensuring responses align with ethical standards.

Topic control NIM microservice that keeps conversations focused on approved topics, avoiding digression or inappropriate content.

Jailbreak detection NIM microservice that adds protection against jailbreak attempts, helping maintain AI integrity in adversarial scenarios.

By applying multiple lightweight, specialized models as guardrails, developers can cover gaps that may occur when only more general global policies and protections exist - as a one-size-fits-all approach doesn't properly secure and control complex agentic AI workflows.

Small language models, like those in the NeMo Guardrails collection, offer lower latency and are designed to run efficiently, even in resource-constrained or distributed environments. This makes them ideal for scaling AI applications in industries such as healthcare, automotive and manufacturing, in locations like hospitals or warehouses.

Industry Leaders and Partners Safeguard AI With NeMo Guardrails

NeMo Guardrails, available to the open-source community, helps developers orchestrate multiple AI software policies - called rails - to enhance LLM application security and control. It works with NVIDIA NIM microservices to offer a robust framework for building AI systems that can be deployed at scale without compromising on safety or performance.

Amdocs, a leading global provider of software and services to communications and media companies, is harnessing NeMo Guardrails to enhance AI-driven customer interactions by delivering safer, more accurate and contextually appropriate responses.

Technologies like NeMo Guardrails are essential for safeguarding generative AI applications, helping make sure they operate securely and ethically, said Anthony Goonetilleke, group president of technology and head of strategy at Amdocs. By integrating NVIDIA NeMo Guardrails into our amAIz platform, we are enhancing the platform's Trusted AI' capabilities to deliver agentic experiences that are safe, reliable and scalable. This empowers service providers to deploy AI solutions safely and with confidence, setting new standards for AI innovation and operational excellence.

Cerence AI, a company specializing in AI solutions for the automotive industry, is using NVIDIA NeMo Guardrails to help ensure its in-car assistants deliver contextually appropriate, safe interactions powered by its CaLLM family of large and small language models.

Cerence AI relies on high-performing, secure solutions from NVIDIA to power our in-car assistant technologies, said Nils Schanz, executive vice president of product and technology at Cerence AI. Using NeMo Guardrails helps us deliver trusted, context-aware solutions to our automaker customers and provide sensible, mindful and hallucination-free responses. In addition, NeMo Guardrails is customizable for our automaker customers and helps us filter harmful or unpleasant requests, securing our CaLLM family of language models from unintended or inappropriate content delivery to end users.

Lowe's, a leading home improvement retailer, is leveraging generative AI to build on the deep expertise of its store associates. By providing enhanced access to comprehensive product knowledge, these tools empower associates to answer customer questions, helping them find the right products to complete their projects and setting a new standard for retail innovation and customer satisfaction.

We're always looking for ways to help associates to above and beyond for our customers, said
LINK: https://blogs.nvidia.com/blog/nemo-guardrails-nim-microservices/...
See more stories from nvidia

Most recent headlines

16/01/2025

Dalet Appoints Erik Holt as Senior Vice President, Global Channels

Dalet Appoints Erik Holt as Senior Vice President, Global Channels Brie Clayton January 16, 2025 0 Comments Dalet, a leading technology and service pr...

16/01/2025

Post Completed with DaVinci Resolve Studio for The Stargate Music Video

Post Completed with DaVinci Resolve Studio for The Stargate Music Video Brie Clayton January 16, 2025 0 Comments Hit band Blood Incantation uses DaVin...

16/01/2025

Laowa Sets the Stage for a Zoom Probe Lens with an Ultra-Wide 15mm Perspective, Broader Focal Range, and Dynamic Angles

Laowa Sets the Stage for a Zoom Probe Lens with an Ultra-Wide 15mm Perspective, ...

16/01/2025

Deepdub Introduces AI Audio API

TEL AVIV, Israel AI-powered voice solutions provider Deepdub today launched its AI Audio API enterprise-grade platform designed to deliver Hollywood-vetted audi...

16/01/2025

Friend MTS appoints Dave Gilmore to strengthen the wall against piracy

Gilmore joins Friend MTS following a two decade career during which he helped secure Irelands first conviction for illicit streaming By Matthew Corrigan Publ...

16/01/2025

Sinclair Renews NBC Affiliation Pacts

NEW YORK and BALTIMORE Sinclair and NBUCniversal said they have struck a major multiyear agreement renewing all 21 of Sinclair's owned and/or operated NBC a...

16/01/2025

Charter Opens Applications for 2025-26 Class of Spectrum Scholars

STAMFORD, Conn. Charter Communications' Spectrum brand has announced that it is now accepting applications for Spectrum Scholars, the cable operator's a...

16/01/2025

Erik Holt Joins Dalet as Senior VP, Global Channels

Dalet has hired Erik Holt as senior vice president, global channels, responsible for the media technology and service provider's global partner strategy....

16/01/2025

Survey: Local Media Industry Bullish on Digital in 2025

NEW YORK While local media outlets have been approaching this year with some trepidation after the massive political spending that boosted results in 2024, the ...

16/01/2025

DPA Microphones Acquires Austrian Audio

KOKKEDAL, Denmark DPA Microphones has acquired the majority share of Vienna-based Austrian Audio....

16/01/2025

Study: Netflix App, Browser Users Show Different Viewing Habits

Netflix viewers using the streaming service's app and those viewing with a web browser are quite similar, but a few notable differences exist, such as the p...

16/01/2025

FCC Media Bureau Sets Aug. 1, 2026, Closed Captioning Compliance Deadline

WASHINGTON The Federal Communications Commission's Media Bureau has announced that manufacturers of covered apparatus and multichannel video programming dis...

16/01/2025

Q&A with Piano Faculty Member Charlotte Hu

Q&A with Piano Faculty Member Charlotte Hu The acclaimed soloist shares her thoughts on compelling performances, student-teacher bonds, and the microwave ap...

16/01/2025

Betsy Newman Named Executive Vice President of Berklee

Betsy Newman Named Executive Vice President of Berklee Newman has led Berklee in various roles for over a decade, supporting students and the greater communit...

16/01/2025

It's a Late Late Show' GAA Special

All-Ireland Winning Captains, GAA President Jarlath Burns, Evanne N Chuilinn, Pat Spillane and The 2 Johnnies among guests Here is your host, Patrick Kielty! ...

16/01/2025

Fantastic Four-ce Awakens: Season One of Marvel Rivals' Joins GeForce NOW

Time to suit up, members. The multiverse is about to get a whole lot cloudier as GeForce NOW opens a portal to the first season of hit game Marvel Rivals from N...

16/01/2025

NVIDIA Releases NIM Microservices to Safeguard Applications for Agentic AI

AI agents are poised to transform productivity for the world's billion knowledge workers with knowledge robots that can accomplish a variety of tasks. To ...

15/01/2025

Revolutionising News Production: Thomson's workshop at Al Jazeera's AI in Media Conference

The buzz around artificial intelligence (AI) in journalism reached a crescendo a...

15/01/2025

2025 Sundance Film Festival Announces Jury Members

Top Row L-R: Kaniehtiio Horn, Vinnie Malhotra, Celine Song, Sam and Andy Zuchero, Kevin Macdonald, Wanuri Kahiu Second Row L-R: Nicholas Ma, Arian Moayed, Danie...

15/01/2025

New York State Selects L3Harris to Modernize Thruway Communications Network

L3Harris will upgrade the New York State Thruway Authority's critical-communications network infrastructure to Project 25 Phase 2-compliant solutions to enh...

15/01/2025

L3Harris Showcases Robotic Drone Detection Capability for US Army

L3Harris multi-mission T7 robot demonstrating a new drone detection and defeat capability for the U.S. Army....

15/01/2025

A Letter to the Leaders of the DOGE

L3Harris Technologies Co-founder, Chair and CEO Christopher E. Kubasik penned an open letter today to the leaders of the Department of Government Efficiency (DO...

15/01/2025

Grass Valley to Showcase Cutting-Edge Solutions for Concert and Staging Markets at ISE 2025

Photo credit: Christian Heinzel, Fifty Frames MONTREAL, CANADA - January 15, 20...

15/01/2025

Clear-Com Offers Secure Communication Network for Zurich at the 2024 Street Parade,...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

15/01/2025

Inam Mahmood joins Nielsen as General Manager, Audience Measurement, EMEA

London, UK - January 15, 2025 - Nielsen, a global leader in audience measurement, data, and analytics, has today announced the appointment of Inam Mahmood as it...

15/01/2025

Nielsen launches critical planning guide for media industry

NEW YORK - January 15, 2025 - Nielsen, a global leader in audience measurement, data and analytics, today unveiled its 2025 Upfront/NewFront Guide, a vital reso...

15/01/2025

Sling TV Launches Unlimited DVR To Remain Competitive

ENGLEWOOD, Colo. In an effort to become more competitive in the virtual live TV streaming market, Sling TV said it will add unlimited DVR storage for only $5 pe...

15/01/2025

DirecTV Acquires Majority Ownership in INVIDI Technologies

EL SEGUNDO, Calif. DirecTV has acquired the majority ownership in NVIDI Technologies, a provider of addressable television advertising products designed to help...

15/01/2025

IBC Taps Stephen Nuttall To Chair Its Partnership Board

IBC has named Stephen Nuttall, a 30-year senior executive and consultant in the sports, media and digital industries, as chair of its Partnership Board....

15/01/2025

Visual Effects Society Announces Nominees for 23rd Annual VES Awards

Visual Effects Society Announces Nominees for 23rd Annual VES Awards Brie Clayton January 15, 2025 0 Comments Dune: Part Two Leads Feature Film Field;...

15/01/2025

Opera Grand Rapids & Colvin Theatrical Film Stinney: An American Execution Opera with Blackmagic Design

Opera Grand Rapids & Colvin Theatrical Film Stinney: An American Execution Opera...

15/01/2025

XenData Announces the X10 Media Archive Appliance

XenData Announces the X10 Media Archive Appliance Brie Clayton January 15, 2025 0 Comments XenData, the provider of cutting-edge data storage solution...

15/01/2025

2025 NAB Show Opens Registration, Launches New Sports Summit

WASHINGTON The National Association of Broadcasters said registration is open for the 2025 NAB Show, which will bring the global media and entertainment industr...

15/01/2025

Dune: Part Two leads BAFTA Film Awards technical categories

In total, Edward Bergers Conclave received the most nominations and is up for 12 BAFTA Film Awards, followed by Emilia Perez and The Brutalist with nine By Jen...

15/01/2025

NAB Show 2025 announces new Sports Summit, registration opens

NAB Show 2025 takes place 5-9th April at the Las Vegas Convention Center By Jenny Priestley Published: January 15, 2025 Updated: January 16, 2025 NAB Sh...

15/01/2025

DPA Microphones Acquires Austrian Audio

DPA Microphones has acquired the majority share of Vienna-based Austrian Audio. Founded in 2017 by former AKG Vienna employees, Austrian Audio builds on that he...

15/01/2025

QuickLink Equips Students With Hands-on Video Production...

QuickLink, the leading global provider of multi-camera video productions and remote contribution solutions, announces the release of StudioPro Lab, an educatio...

15/01/2025

Lightware to Exhibit Industry-Leading USB-C and AV Innova...

Lightware Visual Engineering, a leading manufacturer of connectivity solutions for the professional integrated systems market and a pioneer in signal management...

15/01/2025

New BLAM Release Set to Transform End-to-End Workflow Man...

Blue Lucy's recent software update for orchestration, integration and media management platform, BLAM, includes a major upgrade to the tasks application tha...

15/01/2025

IBC2025 Technical Papers Submission is Now Open

IBC announces today that the call for Technical Papers is now open for the IBC2025 Conference. IBC is world-renowned for the quality, timeliness and innovative...

15/01/2025

New England Sports Network and Bitcentral Join Forces to...

In a move poised to set a new benchmark in sports broadcasting, New England Sports Network (NESN) has partnered with Bitcentral, a leading provider of professio...

15/01/2025

Overcoming Extreme Conditions to Livestream the CX80 Worl...

As digital platforms redefine how audiences engage with sports, niche events have a unique opportunity to capture global attention. Often these events take plac...

15/01/2025

SRT Milestones - Appear Sets New Standard for Broadcast R...

Appear, a global leader in live production technology, is marking continued success in its groundbreaking hardware-accelerated SRT (Secure Reliable Transport) w...

15/01/2025

Keepit celebrates dual wins at the 2024 - 25 Cloud Awards...

Keepit, a global provider of a comprehensive cloud backup and recovery platform, announced today its success in the 2024/25 Cloud Awards programme by being name...

15/01/2025

Alfalite unveils MATIX technology with new Neopix and UHD...

Alfalite, the only European manufacturer of LED screens, will showcase a comprehensive ecosystem of display solutions at ISE 2025 with two stands in Hall 4. Amo...

15/01/2025

Stephen Nuttall announced as New Chair of IBC Partnership...

Stephen Nuttall has been appointed as the new Chair of IBC's Partnership Board. Made up of representatives from each of the six partner organisations which ...

15/01/2025

Matrox Video Underlines Commitment to High and Open Stand...

Matrox Video has today announced it will showcase its latest IP video technology innovations at ISE 2025, the world s largest AV systems integration show. Under...

15/01/2025

Canon Unveils Camera Color-Matching Application

MELVILLE, N.Y. Canon USA has announced key features and availability for its new Camera Color Matching Application, a powerful new Windows-compatible software a...

15/01/2025

Altice's Optimum Complains to FCC Over Nexstar Retrans Negotiations

NEW YORK Altice USA has sent a letter to the Federal Communications Commission complaining about Nexstar's handling of retransmission consent negotiations, ...

15/01/2025

Heartland Video Systems Buys Videstra

PLYMOUTH, Wisc. Heartland Video Systems (HVS) has acquired Videstra, a company that offers solutions to integrate micro-local cameras for weather, towers and tr...