NVIDIA Launches NIM Microservices for Generative AI in Japan, Taiwan
26/08/2024
In support of these efforts, NVIDIA today announced the availability of four new NVIDIA NIM microservices that enable developers to more easily build and deploy high-performing generative AI applications.
The microservices support popular community models tailored to meet regional needs. They enhance user interactions through accurate understanding and improved responses based on local languages and cultural heritage.
In the Asia-Pacific region alone, generative AI software revenue is expected to reach $48 billion by 2030 - up from $5 billion this year, according to ABI Research.
Llama-3-Swallow-70B, trained on Japanese data, and Llama-3-Taiwan-70B, trained on Mandarin data, are regional language models that provide a deeper understanding of local laws, regulations and other customs.
The RakutenAI 7B family of models, built on Mistral-7B, were trained on English and Japanese datasets, and are available as two different NIM microservices for Chat and Instruct. Rakuten's foundation and instruct models have achieved leading scores among open Japanese large language models, landing the top average score in the LM Evaluation Harness benchmark carried out from January to March 2024.
Training a large language model (LLM) on regional languages enhances the effectiveness of its outputs by ensuring more accurate and nuanced communication, as it better understands and reflects cultural and linguistic subtleties.
The models offer leading performance for Japanese and Mandarin language understanding, regional legal tasks, question-answering, and language translation and summarization compared with base LLMs like Llama 3.
Nations worldwide - from Singapore, the United Arab Emirates, South Korea and Sweden to France, Italy and India - are investing in sovereign AI infrastructure.
The new NIM microservices allow businesses, government agencies and universities to host native LLMs in their own environments, enabling developers to build advanced copilots, chatbots and AI assistants.
Developing Applications With Sovereign AI NIM Microservices Developers can easily deploy the sovereign AI models, packaged as NIM microservices, into production while achieving improved performance.
The microservices, available with NVIDIA AI Enterprise, are optimized for inference with the NVIDIA TensorRT-LLM open-source library.
NIM microservices for Llama 3 70B - which was used as the base model for the new Llama-3-Swallow-70B and Llama-3-Taiwan-70B NIM microservices - can provide up to 5x higher throughput. This lowers the total cost of running the models in production and provides better user experiences by decreasing latency.
The new NIM microservices are available today as hosted application programming interfaces (APIs).
Tapping NVIDIA NIM for Faster, More Accurate Generative AI Outcomes The NIM microservices accelerate deployments, enhance overall performance and provide the necessary security for organizations across global industries, including healthcare, finance, manufacturing, education and legal.
The Tokyo Institute of Technology fine-tuned Llama-3-Swallow 70B using Japanese-language data.
LLMs are not mechanical tools that provide the same benefit for everyone. They are rather intellectual tools that interact with human culture and creativity. The influence is mutual where not only are the models affected by the data we train on, but also our culture and the data we generate will be influenced by LLMs, said Rio Yokota, professor at the Global Scientific Information and Computing Center at the Tokyo Institute of Technology. Therefore, it is of paramount importance to develop sovereign AI models that adhere to our cultural norms. The availability of Llama-3-Swallow as an NVIDIA NIM microservice will allow developers to easily access and deploy the model for Japanese applications across various industries.
For instance, a Japanese AI company, Preferred Networks, uses the model to develop a healthcare specific model trained on a unique corpus of Japanese medical data, called Llama3-Preferred-MedSwallow-70B, that tops scores on the Japan National Examination for Physicians.
Chang Gung Memorial Hospital (CGMH), one of the leading hospitals in Taiwan, is building a custom-made AI Inference Service (AIIS) to centralize all LLM applications within the hospital system. Using Llama 3-Taiwan 70B, it is improving the efficiency of frontline medical staff with more nuanced medical language that patients can understand.
By providing instant, context-appropriate guidance, AI applications built with local-language LLMs streamline workflows and serve as a continuous learning tool to support staff development and improve the quality of patient care, said Dr. Changfu Kuo, director of the Center for Artificial Intelligence in Medicine at CGMH, Linko Branch. NVIDIA NIM is simplifying the development of these applications, allowing for easy access and deployment of models trained on regional languages with minimal engineering expertise.
Taiwan-based Pegatron, a maker of electronic devices, will adopt the Llama 3-Taiwan 70B NIM microservice for internal- and external-facing applications. It has integrated it with its PEGAAi Agentic AI System to automate processes, boosting efficiency in manufacturing and operations.
Llama-3-Taiwan 70B NIM is also being used by global petrochemical manufacturer Chang Chun Group, world-leading printed circuit board company Unimicron, technology-focused media company TechOrange, online contract service company LegalSign.ai and generative AI startup APMIC. These companies are also collaborating on the open model.
Creating Custom Enterprise Models
LINK: | https://blogs.nvidia.com/blog/nim-microservices-generative-ai/... |
See more stories from nvidia |
North America Stories
13/09/2024
Give Me the Backstory: Get to Know Megan Park, the Filmmaker Behind My Old Ass
By Bailey Pennick One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. ...
13/09/2024
SNS Previews New Workflow Innovations At IBC2024
SNS is excited to preview the latest features coming to the award-winning EVO Suite. Be among the first to test drive these workflow innovations at IBC2024, and...
13/09/2024
US Navy Awards L3Harris $587 Million Contract for Next Generation Jammer - Low Band Program
SALT LAKE CITY, Sept. 12, 2024 - L3Harris Technologies (NYSE:LHX) has received a...
13/09/2024
L3Harris Rapidly Advances US Hypersonic Missile Tracking and Defense Capabilities
Rendering of L3Harris Tranche 2 Tracking (T2TRK) imagery for the Space Developme...
13/09/2024
The EA-37B Compass Call: Delivering the Future of Electronic Warfare Today
Last month, L3Harris delivered the third U.S. Air Force EA-37B Compass Call Cross Deck aircraft integrated with sophisticated electromagnetic attack (EA) miss...
13/09/2024
Grass Valley Unveils New Game-Changing Switcher Products for Enhanced Production Efficiency
Targeted at low-to-mid tier productions, the new products set new standards for ...
13/09/2024
Grass Valley Sets the New Standard in High-Density IP and SDI Modular Processing with the launch of ACE-3901 and XIP-3911-GRID
The next generation products will enhance the Densit Modular Platform with unma...
13/09/2024
Calrec Introduces Argo M Compact Broadcast Audio Console At IBC 2024
AMSTERDAM Calrec Audio has unveiled its compact Argo M audio console, ImPulseV cloud audio mixing solution and True Control 2.0 at IBC 2024, Sept. 13-16....
13/09/2024
Media and Broadcast Companies Reveal Confidence In AI Technology
A study of how the media and broadcast industry feels about artificial intelligence (AI) has revealed most media and broadcast companies view its adoption as a ...
13/09/2024
Starchive, Seagate Lyve Cloud Object Storage Announce Collaboration
AMSTERDAM AI-driven digital asset management system (DAM) Starchive announced at IBC 2024 a collaboration with Seagate that fully integrates its toolset with Se...
13/09/2024
DPA Microphones Unveils 2061 Miniature Omnidirectional Mic At IBC 2024
AMSTERDAM DPA Microphones has introduced its 2061 Miniature Omnidirectional Microphone for applications ranging from broadcast studios and ENG to theaters, even...
13/09/2024
Rodney Alejandro Named Dean of Professional Writing and Music Technology
Rodney Alejandro Named Dean of Professional Writing and Music Technology Alejandro, Berklees current Songwriting Department chair and an alumnus of the colleg...
13/09/2024
More Than 67 Million Viewers Watched Presidential Debate
The presidential debate between Vice President Kamala Harris and former President Donald Trump was watched by 67.1 million viewers, according to Nielsen....
13/09/2024
Brightcove Launches AI Suite With Content-Creation Capabilities
Brightcove introduced the Brightcove AI Suite, which uses AI to provide content creation, audience growth and engagement and increased revenue generation....
13/09/2024
Charter Reaches Distribution Deal With Warner Bros. Discovery That Gives Subscribers Streaming Service Max
Warner Bros. Discovery and Charter Communications said the reached a new multi-y...
13/09/2024
History This Week Podcast Returns for Fifth Season
The History Channel's History This Week podcast returns for a fifth season on September 16....
13/09/2024
67.1M Viewers Tune into Harris-Trump Debate
NEW YORK The ABC News Presidential Debate between Vice President Kamala Harris and former President Donald Trump drew an estimated audience of 67.1 million view...
13/09/2024
FCC Chair Rosenworcel Rebuts Trump's Call to Revoke ABC Licenses
WASHINGTON, D.C. In response to Donald Trump's call for ABC stations to lose their broadcast licenses, Federal Communications Commission chairwoman Jessica ...
13/09/2024
Teradek To Introduce Prism 877 4K HEVC Encoder/Decoder Cards At IBC 2024
IRVINE, Calif. Teradek will launch its new Prism 877 4K HEVC encoder/decoder cards at the IBC 2024, Sept. 13-16, at the RAI Amsterdam Convention Center....
13/09/2024
GAB Honors First-Ever Class Of Rising Stars' in Broadcasting
ATLANTA The Georgia Association of Broadcasters honored nine station employees at the early stage of their broadcast career as members of its first-ever class o...
13/09/2024
Grass Valley, ES Broadcast Sign Strategic Partnership Agreement
MONTREAL Grass Valley and broadcast equipment supply and service company ES Broadcast have inked a strategic partnership agreement that continues and expands a ...
13/09/2024
Panasonic Connect Launches New Cameras, Expands NDI Support
NEWARK, N.J. Panasonic Connect has announced the new AK-UCX100 4K studio camera and two new 4K multi-purpose cameras. In addition, the company said it will exte...
13/09/2024
Ross Video Unveils Ultricore Tally
OTTAWA, Canada Ross Video has launched Ultricore Tally, a full-featured, versatile tally control and management solution and will showcase it at IBC 2024, Sept....
13/09/2024
Hollyland Elevates Wireless Communications for Large-Scale Film and TV Productions
Hollyland Elevates Wireless Communications for Large-Scale Film and TV Productio...
13/09/2024
Blackmagic Design Announces Blackmagic PYXIS Monitor!
Blackmagic Design Announces Blackmagic PYXIS Monitor! Brie Clayton September 12, 2024 0 Comments New cinematic monitoring solution for Blackmagic PYXI...
13/09/2024
Sculpting Reimagined: Maxon Releases ZBrush for iPad
Sculpting Reimagined: Maxon Releases ZBrush for iPad Brie Clayton September 13, 2024 0 Comments Take the power of ZBrush on the go with reimagined UI,...
13/09/2024
WCVB Spotlights Berklee Institute for Accessible Arts Education
WCVB Spotlights Berklee Institute for Accessible Arts Education The institutes ABLE summer camp program was featured in the 5 for Good segment. By Daniel Pe...
13/09/2024
Netflix Greenlights Love Untangled': A Nostalgic Korean Youth Romance Set in 1998
Back to All News Netflix Greenlights Love Untangled': A Nostalgic Korean Y...
12/09/2024
Sundance Institute Selects Three Finalists to Host the Sundance Film Festival Beginning in 2027
Final Phase of RFP Process Will See a Decision Announced in Q1 of 2025...
12/09/2024
Skeleton Twins Is 10! Reminisce Over Surprise Musical Moments From the Comedy-Drama and Other Fest Faves
By Jessica Herndon We all have moments from movies that we love to rewatch. Som...
12/09/2024
Legacy Effects Chooses EVO Shared Storage For New Features
St. Louis, MO - September 12, 2024 - Studio Network Solutions (SNS) announced that Legacy Effects, the Oscar-nominated and Emmy-winning FX studio, relies on EVO...
12/09/2024
SNS Announces Updated NDI Plug-in At IBC2024
St. Louis, MO - September 12, 2024 - Studio Network Solutions (SNS) today announced a significant update to its NDI plug-in for Vizrt NRS systems at IBC2024. T...
12/09/2024
SNS Showcases EVO Suite Updates At IBC2024
St. Louis, MO - September 12, 2024 - Studio Network Solutions (SNS) is showcasing significant updates to the EVO Suite at IBC2024. Designed to empower media t...
12/09/2024
L3Harris Joins Australia's Global Supply Chain Program
L3Harris is now one of 13 prime contractors involved in the Australian government's GSC program, designed to support in-country suppliers and bolster global...
12/09/2024
NSF-DOE Rubin Observatory's Secondary Mirror Installed
The 3.5-meter glass mirror, which L3Harris polished and finished, has been lifted onto Rubin Observatory's Simonyi Survey Telescope in Chile. This achieveme...
12/09/2024
Grass Valley to Launch LDX 110 and LDX C110 Entry Level Cameras at IBC 2024
The new LDX 110 and LDX C110 bring the cutting-edge technology of the LDX 100 series to the entry-level market. Montreal, Canada, September 12, 2024 -. Grass V...
12/09/2024
Over 67 Million Viewers Tune In for ABC News Harris-Trump Debate
NEW YORK - September 11, 2024 - The ABC News Presidential Debate between Vice President Kamala Harris and former President Donald Trump drew an estimated audien...
12/09/2024
Nielsen & Video Research renew partnership with goal of cutting-edge, de-duplicated cross-media measurement solution for Japan
Reinvigorated alliance the next step in the evolution of media in Japan and a bi...
12/09/2024
67.1M Viewers Tune into ABC News Harris-Trump Debate
NEW YORK The ABC News Presidential Debate between Vice President Kamala Harris and former President Donald Trump drew an estimated audience of 67.1 million view...
12/09/2024
Boston Conservatory at Berklee to Present Center Stage Production of Jesus Christ Superstar
Boston Conservatory at Berklee to Present Center Stage Production of Jesus Chris...
12/09/2024
Jennifer Hudson' Chooses Joy in Season 3 Return
The Jennifer Hudson Show returns for its third season on Monday, September 16 with a renewed focus on joy, positivity and inspiration, the show said Tuesday....
12/09/2024
Netflix's The Perfect Couple' Opens Atop TVision's Power Score Rankings
Netflix's The Perfect Couple had its debut as the No. 1 show on connected TV...
12/09/2024
FreeWheel Integrates Samba TV's ACR Data for Campaign Targeting
FreeWheel, Comcast's ad-tech company, said it would be integrating Samba TV automatic content recognition viewer data into FreeWheel's Audience Manager,...
12/09/2024
GroupM's Mike Fisher Joins Comcast Advertising
Mike Fisher, who had been executive director of investment innovation at GroupM, has joined Comcast Advertising as executive director, agency development....
12/09/2024
Hispanic TV Summit: John Leguizamo on How American Historia' Came to Be, and What He Hopes to Accomplish With PBS Project
John Leguizamo took the stage at the Hispanic Television Summit, as the session ...
12/09/2024
Revised: 28.3M Homes Watched Trump, Harris Presidential Debate
Samba TV is reporting that 28.3 million homes watched the Presidential Debate hosted by ABC News on Sept. 10. That makes the faceoff between Donald Trump and Ka...
12/09/2024
Dalet Expands Leadership Team with Three New Members
PARIS Dalet has announced three new members of its executive team. Tara Bryant joins as chief revenue officer (CRO) with responsibilities spanning sales, market...
12/09/2024
Avid | Stream IO Ingest & Playout Solution Now Supports SMPTE 2110
BURLINGTON, Mass. Avid has announced improvements to its Avid | Stream IO software subscription solution for broadcast production ingest and playout that are de...
12/09/2024
Nielsen: Hispanic Sports Fans Drive Record Sports Viewing
NEW YORK A new report from Nielsen indicates that the U.S. Hispanic population is having a major influence on the U.S. sports landscape, helping to drive growin...