Sony Pixel Power calrec Sony

NVIDIA Releases NIM Microservices to Safeguard Applications for Agentic AI

16/01/2025

AI agents are poised to transform productivity for the world's billion knowledge workers with knowledge robots that can accomplish a variety of tasks. To develop AI agents, enterprises need to address critical concerns like trust, safety, security and compliance.

New NVIDIA NIM microservices for AI guardrails - part of the NVIDIA NeMo Guardrails collection of software tools - are portable, optimized inference microservices that help companies improve the safety, precision and scalability of their generative AI applications.

Central to the orchestration of the microservices is NeMo Guardrails, part of the NVIDIA NeMo platform for curating, customizing and guardrailing AI. NeMo Guardrails helps developers integrate and manage AI guardrails in large language model (LLM) applications. Industry leaders Amdocs, Cerence AI and Lowe's are among those using NeMo Guardrails to safeguard AI applications.

Developers can use the NIM microservices to build more secure, trustworthy AI agents that provide safe, appropriate responses within context-specific guidelines and are bolstered against jailbreak attempts. Deployed in customer service across industries like automotive, finance, healthcare, manufacturing and retail, the agents can boost customer satisfaction and trust.

One of the new microservices, built for moderating content safety, was trained using the Aegis Content Safety Dataset - one of the highest-quality, human-annotated data sources in its category. Curated and owned by NVIDIA, the dataset is publicly available on Hugging Face and includes over 35,000 human-annotated data samples flagged for AI safety and jailbreak attempts to bypass system restrictions.

NVIDIA NeMo Guardrails Keeps AI Agents on Track

AI is rapidly boosting productivity for a broad range of business processes. In customer service, it's helping resolve customer issues up to 40% faster. However, scaling AI for customer service and other AI agents requires secure models that prevent harmful or inappropriate outputs and ensure the AI application behaves within defined parameters.

NVIDIA has introduced three new NIM microservices for NeMo Guardrails that help AI agents operate at scale while maintaining controlled behavior:

Content safety NIM microservice that safeguards AI against generating biased or harmful outputs, ensuring responses align with ethical standards.

Topic control NIM microservice that keeps conversations focused on approved topics, avoiding digression or inappropriate content.

Jailbreak detection NIM microservice that adds protection against jailbreak attempts, helping maintain AI integrity in adversarial scenarios.

By applying multiple lightweight, specialized models as guardrails, developers can cover gaps that may occur when only more general global policies and protections exist - as a one-size-fits-all approach doesn't properly secure and control complex agentic AI workflows.

Small language models, like those in the NeMo Guardrails collection, offer lower latency and are designed to run efficiently, even in resource-constrained or distributed environments. This makes them ideal for scaling AI applications in industries such as healthcare, automotive and manufacturing, in locations like hospitals or warehouses.

Industry Leaders and Partners Safeguard AI With NeMo Guardrails

NeMo Guardrails, available to the open-source community, helps developers orchestrate multiple AI software policies - called rails - to enhance LLM application security and control. It works with NVIDIA NIM microservices to offer a robust framework for building AI systems that can be deployed at scale without compromising on safety or performance.

Amdocs, a leading global provider of software and services to communications and media companies, is harnessing NeMo Guardrails to enhance AI-driven customer interactions by delivering safer, more accurate and contextually appropriate responses.

Technologies like NeMo Guardrails are essential for safeguarding generative AI applications, helping make sure they operate securely and ethically, said Anthony Goonetilleke, group president of technology and head of strategy at Amdocs. By integrating NVIDIA NeMo Guardrails into our amAIz platform, we are enhancing the platform's Trusted AI' capabilities to deliver agentic experiences that are safe, reliable and scalable. This empowers service providers to deploy AI solutions safely and with confidence, setting new standards for AI innovation and operational excellence.

Cerence AI, a company specializing in AI solutions for the automotive industry, is using NVIDIA NeMo Guardrails to help ensure its in-car assistants deliver contextually appropriate, safe interactions powered by its CaLLM family of large and small language models.

Cerence AI relies on high-performing, secure solutions from NVIDIA to power our in-car assistant technologies, said Nils Schanz, executive vice president of product and technology at Cerence AI. Using NeMo Guardrails helps us deliver trusted, context-aware solutions to our automaker customers and provide sensible, mindful and hallucination-free responses. In addition, NeMo Guardrails is customizable for our automaker customers and helps us filter harmful or unpleasant requests, securing our CaLLM family of language models from unintended or inappropriate content delivery to end users.

Lowe's, a leading home improvement retailer, is leveraging generative AI to build on the deep expertise of its store associates. By providing enhanced access to comprehensive product knowledge, these tools empower associates to answer customer questions, helping them find the right products to complete their projects and setting a new standard for retail innovation and customer satisfaction.

We're always looking for ways to help associates go above and beyond for our customers, said
LINK: https://blogs.nvidia.com/blog/nemo-guardrails-nim-microservices/...
See more stories from nvidia

North America Stories

04/02/2025

L3Harris Signs Multi-Year Pilot Training Agreement With Thai Airways

L3Harris has signed a two-year agreement with Thai Airways International to provide training service on its A320 Full Flight Simulator (FFS). This significant a...

04/02/2025

US Air Force Completes First Flight of L3Harris Viper Shield Electronic Warfare System

L3Harris' all-digital electronic warfare suite, Viper Shield , completed its...

04/02/2025

Grup Mediapro to Collaborate with Google Cloud on Gen AI

BARCELONA Grup Mediapro and Google Cloud have expanded their collaboration to create an innovation lab focused on generative AI to develop solutions for the med...

04/02/2025

EditShare Receives SOCE 2 Type II Certification

WATERTOWN, Mass. EditShare this week said it has received SOC 2 Type II certification, an independently audited evaluation of an organization's information ...

04/02/2025

Executive Creative Director Halle Petro Named Partner of Sonic Union

Executive Creative Director Halle Petro Named Partner of Sonic Union Brie Clayton February 4, 2025 0 Comments Sonic Union is excited to announce Execu...

04/02/2025

Blackmagic Design Announces Blackmagic Camera for Android 2.0 Update

Blackmagic Design Announces Blackmagic Camera for Android 2.0 Update Brie Clayton February 4, 2025 0 Comments New update adds support for Xiaomi Pad 6...

04/02/2025

CETA Software Launches Artist Access: The Time-Tracking Tool for Creative Teams

CETA Software Launches Artist Access: The Time-Tracking Tool for Creative Teams Brie Clayton February 4, 2025 0 Comments CETA Software, creators of p...

04/02/2025

OWC Announces General Availability Launch of OWC Dock Ejector 2.0

OWC Announces General Availability Launch of OWC Dock Ejector 2.0 Brie Clayton February 4, 2025 0 Comments The Ultimate Tool for Efficiently and Safel...

04/02/2025

Paramount, Nielsen Sign Multiyear Measurement and Analytics Deal

NEW YORK Paramount Global and Nielsen have inked a new, multiyear deal that will provide measurement for all of the company's platforms, including national ...

04/02/2025

2d Animated Short Concerning a Project for Schools

2d Animated Short Concerning a Project for Schools Brie Clayton February 3, 2025 0 Comments 2d animated short concerning a project for schools Febru...

04/02/2025

Step by step guide to using 3D Models in After Effects

Step by step guide to using 3D Models in After Effects Graham Quince February 3, 2025 0 Comments Since 2024, Adobe After Effects has had native suppor...

04/02/2025

Powerful Premiere Automation with new Excalibur Update

Powerful Premiere Automation with new Excalibur Update Colin Smith February 3, 2025 0 Comments This tutorial takes you through the new update for auto...

04/02/2025

Cinematography of A Complete Unknown: Shooting 12,800 iso Sony Venice 2 to create a 1960's era film

Cinematography of A Complete Unknown: Shooting 12,800 iso Sony Venice 2 to creat...

04/02/2025

DIY to DA: Ela Minus Breaks Through

DIY to D A: Ela Minus Breaks Through The electronic artist and producer tells Rolling Stone about her new album, D A, and how shes forged a career outside the...

04/02/2025

The Future of Football? Technology and Entertainment Merge in the Kings World Cup Nations

The future of football? Technology and entertainment merge in the Kings World Cu...

04/02/2025

Virtual Production and AR Graphics: Demystifying the Tools, Technologies, and Trends

Virtual Production and AR Graphics: Demystifying the Tools, Technologies, and Tr...

04/02/2025

SVG All-Stars: Russell Fink, Senior Director, Programming and Content Analytics, SNY

SVG All-Stars: Russell Fink, Senior Director, Programming and Content Analytics,...

04/02/2025

SVG New Sponsor Spotlight: farmerswife's Jodi Clifford on Organizing Your Productions Like a Professional

SVG New Sponsor Spotlight: farmerswife's Jodi Clifford on Organizing Your Pr...

04/02/2025

EA Acquires TRACAB Technologies as It Looks to Move Beyond Games

EA Acquires TRACAB Technologies as It Looks to Move Beyond Games EA believes TRACABs sports tracking/analysis technology will help to make the EA SPORTS App the...

04/02/2025

Kingdom Come: Alamiya Media on Bringing the Supercoppa Italiana and Supercopa de Espaa to Saudi Arabia

Kingdom come: Alamiya Media on bringing the Supercoppa Italiana and Supercopa de...

04/02/2025

Alamiya Media at 50: Preparing for Rapid Change, an International Broadcast Center and the FIFA World Cup

Alamiya Media at 50: Preparing for rapid change, an international broadcast cent...

03/02/2025

L3Harris Technology Enhances US Torpedo Capability

The L3Harris IPLCS is a fiber-optic tether connecting a torpedo to the origin vessel, providing data in real time. Credit: L3Harris...

03/02/2025

VidTrans 2025 to Focus on Security, Dynamic Media Production

BOTHELL, Wash. Video Services Forum (VSF) today announced that the VidTrans 2025 conference and exposition will take place Feb. 25-27 at the Marina del Rey Marr...

03/02/2025

Legislation Proposed to Require Refunds During TV Blackouts

WASHINGTON Last week Rep. Pat Ryan (D-N.Y.) and Sen. Chris Murphy (D-Conn.) introduced the Stop Sports Blackouts Act to make cable and satellite companies ref...

03/02/2025

New Vendors Gain Amazon Prime Video Preferred Certification

Amazon Prime Video has added more companies to its Preferred Vendor Services Program....

03/02/2025

Grand Slam Track Inks Media Rights Deal with The CW, NBC Sports

BURBANK, Calif. The CW, NBC Sports and Grand Slam Track, a new global track competition, have announced a media rights deal that makes The CW the exclusive U.S....

03/02/2025

CJP building virtual production studio for BNU

Adding LED wall to green screen studio expands creative options CJP Broadcast Service Solutions, systems integration, production and content digitisation speci...

03/02/2025

CJP Broadcast Becomes Certified QuickLink Gold Partner to...

CJP Broadcast Service Solutions, a systems integration and content digitisation specialist, has been appointed as a certified QuickLink Gold Partner. This strat...

03/02/2025

2d Animated Short Concerned a Project for Schools

2d Animated Short Concerned a Project for Schools Brie Clayton February 3, 2025 0 Comments 2d animated short concerning a project for schools Februa...

03/02/2025

Academy Award-Winning Production Company Caviar Signs Director Dawit N.M.

Academy Award-Winning Production Company Caviar Signs Director Dawit N.M. Brie Clayton February 3, 2025 0 Comments Academy Award-winning independent p...

03/02/2025

Blackmagic Design Announces Customizable Blackmagic URSA Cine 12K Body

Blackmagic Design Announces Customizable Blackmagic URSA Cine 12K Body Brie Clayton February 3, 2025 0 Comments New body only model of Blackmagic URSA...

03/02/2025

Berklee Alumni Recognized at the 2025 Grammy Awards

Berklee Alumni Recognized at the 2025 Grammy Awards Winners took home trophies in 14 categories, including Album of the Year, Best Pop Vocal Album, and Songwr...

03/02/2025

KVM Advances Simplify Complex Workflows, With More on the Way

For media production companies, the drive for increased efficiency without extensive incremental costs or added complexity is always near the top of the priorit...

03/02/2025

Hybrid Uses of Virtual Production Take Hold Industry-Wide

Any lingering resistance to virtual production involving next-generation elements like LED walls, in-camera visual effects (ICVFX) and mixed reality (MR) is rap...

03/02/2025

Audio Consoles: Surface Still Matters

The physical function of audio mixing remains relatively unchanged today despite technology's onward march. There are now many ways to mix studio and outsid...

03/02/2025

Lightbridge 40 Percent Off CRLS Reflectors

Lightbridge, creators of the renowned Precision Reflectors for motion picture lighting, celebrates 8 years of innovation with a 40% discount on all current CRLS...

03/02/2025

Camera Corps Streamlines Live HDR Sports Production with...

High dynamic range (HDR) has transformed the sports fan experience, enabling broadcasters and OTT providers to deliver live events with remarkably lifelike colo...

03/02/2025

MainConcept Unveils Enhanced Easy Video API with JPEG XS...

MainConcept, the leading provider of video and audio codecs, announces the latest additions to its MainConcept EVA (Easy Video API) technology, set to greatly e...

03/02/2025

Last Samurai Standing' Unveils 14 New Cast Members Ahead of November Debut

Back to All News Last Samurai Standing' Unveils 14 New Cast Members Ahead of November Debut Entertainment 03 February 2025 GlobalJapan Link copied to ...

03/02/2025

Super Bowl LIX: Flown Sound System Adapts Older Stadium for Game, Hip-Hop-Heavy Halftime Show

Super Bowl LIX: Flown Sound System Adapts Older Stadium for Game, Hip-Hop-Heavy ...

03/02/2025

The NAMM Show Continues To Move Beyond the Music

The NAMM Show Continues To Move Beyond the Music Dale Pro Audio had a front-row seat to what has become the major U.S. pro-audio expo By SVG Staff Monday, Fe...

03/02/2025

HPA Tech Retreat Announces: Behind the Scenes of MrBeast, A Conversation

As it heads to its estimable 30th anniversary, the HPA Tech Retreat continues to add one-of-a-kind programming to its schedule. The HPA Tech Retreat committee h...

02/02/2025

Come See Me in the Good Light Wins Festival Favorite Award at 2025 Sundance Film Festival and 2026 Sundance Film Festival Dates Revealed

2026 Edition of Sundance Film Festival to Take Place in Park City and Salt Lake ...

02/02/2025

Toma Ikuta Stars in Demon City' with Music by Tomoyasu Hotei, Streaming on February 27

Back to All News Toma Ikuta Stars in Demon City' with Music by Tomoyasu Ho...

01/02/2025

Cow Job Listing: Calling All Creative Editors! Love Japan? Japan-Inspired Video Editor Application

Cow Job Listing: Calling All Creative Editors! Love Japan? Japan-Inspired Video ...

01/02/2025

DirecTV Expands MySports Package to 122 Markets

DirecTV said it has significantly expanded its MySports package, which includes 40 national sports and local broadcast channels, to 122 Nielsen designated marke...