Sony Pixel Power calrec Sony

Startup Pens Generative AI Success Story With NVIDIA NeMo

08/08/2023

Machine learning helped Waseem Alshikh plow through textbooks in college. Now he's putting generative AI to work, creating content for hundreds of companies.

Born and raised in Syria, Alshikh spoke no English, but he was fluent in software, a talent that served him well when he arrived at college in Lebanon.

The first day they gave me a stack of textbooks, each one a thousand pages thick, and all of it in English, he recalled.

So, he wrote a program - a crude but effective statistical classifier that summarized the books - then he studied the summaries.

From Concept to Company In 2014, he shared his story with May Habib, an entrepreneur he met while working in Dubai. They agreed to create a startup that could help marketing departments - which are always pressured to do more with less - use machine learning to quickly create copy for their web pages, blogs, ads and more.

Initially, the tech was not there, until transformer models were announced - that was something we could build on, said Alshikh, the startup's CTO.

Writer co-founders Habib, CEO, and Alshikh, CTO. We found a few engineers and spent almost six months building our first model, a neural network that barely worked and had about 128 million parameters, an often-used measure of an AI model's capability.

Along the way, the young company won some business, changed its name to Writer and connected with NVIDIA.

A Startup Accelerated Once we got introduced to NVIDIA NeMo, we were able to build industrial-strength models with three, then 20 and now 40 billion parameters, and we're still scaling, he said.

NeMo is an application framework that helps companies curate their training datasets, build and customize large language models (LLMs), and run them in production at scale. Organizations everywhere from Korea to Sweden are using it to customize LLMs for their local languages and industries.

Before NeMo, it took us four and a half months to build a new billion-parameter model. Now we can do it in 16 days - this is mind blowing, Alshikh said.

Models Make Opportunities In the first six months of this year, the startup's team of fewer than 20 AI engineers used NeMo to develop 10 models, each with 30 billion parameters or more.

That translates into big opportunities. Hundreds of businesses now use Writer's models that NeMo customized for finance, healthcare, retail and other vertical markets.

Writer's Recap tool creates written summaries from audio recordings of an interview or event. The startup's customer list includes household names like Deloitte, L'Oreal, Intuit, Uber and many Fortune 500 companies.

Writer's success with NeMo is just the start of the story. Dozens of other companies have already downloaded NeMo.

The software will be available soon for anyone to use. It's part of NVIDIA AI Enterprise, full-stack software optimized to accelerate generative AI workloads and backed by enterprise-grade support, security and application programming interface stability.

Writer offers a full-stack platform for enterprise users. A Trillion API Calls a Month Some customers run Writer's models on their own systems or cloud services. Others ask Writer to host the models, or they use Writer's API.

Our cloud infrastructure, managed basically by two people, hosts a trillion API calls a month - we're generating 90,000 words a second, Alshikh said. We're delivering high-quality models that compete with products from companies with larger teams and bigger budgets.

NVIDIA NeMo supports an end-to-end flow for generative AI from data curation to inference. Writer uses the Triton Inference Server that's packaged with NeMo to run models in production for its customers. Alshikh reports that Triton, used by many companies running LLMs, enables lower latency and greater throughput than alternative programs.

This means you can run a service for $20,000, instead of $100,000, so we can invest more in building meaningful features, he said.

A Wide Horizon Writer is also a member of NVIDIA Inception, a program that nurtures cutting-edge startups. Thanks to Inception, we got early access to NeMo and some amazing people who guided us through the process of finding and using the tools we need, he said.

Now that Writer's text products are getting traction, Alshikh, who splits his time between homes in Florida and California, is searching the horizon for what's next. In today's broad frontier of generative AI, he sees opportunities in images, audio, video, 3D - maybe all of the above.

We see multimodality as the future, he said.

Check out this page to get started with NeMo. And learn about the early access program for multimodal NeMo here.

And if you enjoyed this story, let folks on social networks know using the following, a summary suggested by Writer:

Learn how startup Writer uses NVIDIA NeMo software to generate content for hundreds of companies and rack up impressive revenues with a small staff and budget.
LINK: https://blogs.nvidia.com/blog/2023/08/08/writer-nemo-generative-ai/...
See more stories from nvidia

Most recent headlines

09/12/2024

Dalet Named an IDC Innovator in Media and Entertainment

Dalet, a leading technology and service provider for media-rich organizations, today announced that it has been named an IDC Innovator in the IDC Innovators: ...

09/11/2024

Dalet Expands Leadership Team to Fuel Next Stage of Growth

Dalet, a leading technology and service provider for media-rich organizations, today announced three new members of its executive team. Tara Bryant joins as Chi...

30/10/2024

Drone detection just got a whole lot smarter with ARDRONIS Detect from Rohde & Schwarz

Drone detection just got a whole lot smarter with ARDRONIS Detect from Rohde & S...

25/10/2024

Brighter Eyes

Jenny Priestley talks to the BFI's Douglas Weir who oversaw the restoration of a much-loved animated classic, which returns to UK and Ireland cinemas today ...

25/10/2024

Comercio TV Chooses Broadpeak to Optimize OTT Video Deliv...

Broadpeak , a leading provider of content delivery network (CDN) and video streaming solutions for content providers and pay-TV operators worldwide, announced t...

25/10/2024

Amagi Partners With Allrites to Expand the Global Distrib...

Amagi, the global leader in cloud-based SaaS technology for broadcast and connected TV (CTV), has announced a strategic partnership with Allrites, a premium con...

25/10/2024

Studio Technologies Enhances ST 2110 Integration with Mer...

Studio Technologies, Inc., a pioneer in high-performance audio, video, and fibre-optic solutions, has long been at the forefront of the professional broadcast a...

25/10/2024

QuickLink Improves Remote Production for Saturday Night T...

QuickLink, empowering creatives to exceed modern-day standards of production, has been instrumental in easing the remote production challenges of ITV Studios...

25/10/2024

stYpe AI Glue and StypeCentral Advance the Art of TV Tale...

stYpe, a globally active innovator of virtual studio production resources, reports strong interest in the latest additions to its wide range of broadcast-qualit...

25/10/2024

Top Argentine Music Facility Casa Frida Estudio Chooses P...

Casa Frida Estudio, one of the most prestigious music facilities in Argentina, has upgraded its main control room to Dolby Atmos specifications and installed a ...

25/10/2024

Frequency expands Managed Channel Services to Europe at M...

Frequency, the engine behind many of the world's best-known streaming television channels, announces the European expansion of its Managed Channel Services ...

25/10/2024

InnovateUK and EU Approve Funding for Immersive Technolog...

Disguise, an HPA-Award-winning immersive experience company, has received £1.2 Million in funding from Innovate UK and the EU as part of a larger investment int...

25/10/2024

MASORANGE AND AGILE CONTENT RENEW THEIR COLLABORATION AGR...

Through this agreement, MASORANGE will incorporate new AGILE CONTENT technologies into its television service, enhancing customer experience with optimum servic...

25/10/2024

Swiss Indoors Basel 2024 delivered with Appear X Platform

Appear, a global leader in live production technology, is proud to announce its role as an official provider of cutting-edge broadcast transmission solutions fo...

25/10/2024

MSCTV Chooses Witbes Virtual NOC for Proactive Live TV Mo...

Witbe (Euronext Growth FR0013143872 ALWIT), a global leader in test automation and monitoring technology for video service providers, today announced that M...

25/10/2024

Unified Streaming fortifies customer ties with two hires

Unified Streaming, a leading streaming software company, has hired Valentijn Siebrands, an industry veteran, as its new streaming solutions manager. The company...

25/10/2024

Independent Midwest Broadcaster selects Rohde and Schwarz...

Competitive search leads Toledo's WLMB-TV 40 to TE1 based on energy efficiency and durability As part of its effort to reach a wider audience, the Toledo-b...

25/10/2024

IBC Accelerator Programme 2025 - Call For Industry Challe...

IBC announces the Call for Challenges for the 2025 Accelerator Media Innovation Programme, inviting proposals for transformative, fast-track innovation projects...

25/10/2024

TVN Deploys Lawo AoIP Technology in New OB Truck

HANNOVER, Germany TVN Live Production is using a variety of solutions and technologies from Lawo in its new TVN- 8UHD OB truck, which it unveiled at this year&#...

25/10/2024

LG Ad Solutions Joins Innovid's Harmony Initiative

NEW YORK Innovid, a software platform for the creation, delivery, measurement and optimization of connected TV (CTV), linear and digital advertising, said LG Ad...

25/10/2024

Hightouch Launches New CTV Advertising Offering

SAN FRANCISCO Consumer data platform provider Hightouch has announced a new solution it said will streamline and accelerate connected TV (CTV) advertising....

25/10/2024

Max Adds DAZN's Sports Offering in Spain

MADRID Warner Bros. Discovery's streaming service Max has reached a new agreement with DAZN that will give Max customers in Spain access to the premium spor...

25/10/2024

Beloved Genre-Benders Karate Make a Fitting Comeback

Beloved Genre-Benders Karate Make a Fitting Comeback Its one of the decades feel-good music stories: How the legendary alumni acts rediscovery led to rereleas...

25/10/2024

Berklee Presents Holiday Extravaganza: Duke Ellingtons Nutcracker Suite and Christmas Vibes Featuring Warren Wolf

Berklee Presents Holiday Extravaganza: Duke Ellingtons Nutcracker Suite and Chri...

24/10/2024

Give Yourself a Scare With These Suspenseful Audiobooks

Gather your tricks and treats because Halloween season is upon us. Spotify launched our first Spine-Chilling Audiobooks hub this month featuring the Fear Index...

24/10/2024

PUBLIC INVITATION TO THE INTERVIEW OF NOMINATED CANDIDATE FOR THE COUNCIL OF THE NATIONAL FILM AND VIDEO FOUNDATION (NFVF)

In accordance with Section 6 (2) (c) of the National Film and Video Foundation A...

24/10/2024

L3Harris and Palantir Announce Strategic Partnership

MELBOURNE, Fla., Oct. 23, 2024 - L3Harris Technologies (NYSE: LHX) and Palantir Technologies Inc. (NYSE: PLTR) today announced a strategic partnership to propel...

24/10/2024

FCC Makes a Service Call on Broadband, Cable and Phone Customer Support

WASHINGTON The FCC has launched a formal proceeding to review the quality of support that cable, broadband, satellite TV, and voice service providers give their...

24/10/2024

Scripps Promotes Matt Simon to VP of Scripps News

CINCINNATI E.W. Scripps has named veteran journalist Matt Simon as vice president of Scripps News. In the new role, Simon will be responsible for the vision, ov...

24/10/2024

Cine Gear Film Series Competition is Now Open

Cine Gear Film Series Competition is Now Open Brie Clayton October 24, 2024 0 Comments Each year, thousands of filmmakers of all kinds gather at a maj...

24/10/2024

DaVinci Resolve Studio Integral to Ringling College of Art and Design's Post Program

DaVinci Resolve Studio Integral to Ringling College of Art and Design's Post...

24/10/2024

Krotos Introduces the World's First Dynamic Crowd System in Krotos Studio

Krotos Introduces the World's First Dynamic Crowd System in Krotos Studio Brie Clayton October 24, 2024 0 Comments Krotos, a leader in cutting-edg...

24/10/2024

Technicolor in talks over sale'

According to a report, following a move towards growth, Technicolor has opened talks with potential buyers as shareholders are assessing its long-term future B...

24/10/2024

Meet the VP, business strategy and partnerships

Orfiums Mark Vermaat, VP business strategy and partnerships, tells TVBEurope why remaining curious and challenging the status quo is vital in a career in the me...

24/10/2024

Amagi: Sports Viewing Spikes on FAST Channels

NEW YORK A new study from Amagi highlights both the ongoing shift of viewing to free ad-supported streaming (FAST) channels and the rapidly growing amount of sp...

24/10/2024

Vizrt Deploys Matrox Video DSX LE5 SDI I/O Cards in TriCaster Vizion

MONTREAL Matrox Video has announced that it is supplying DSX LE5 SDI I/O cards for Vizrts latest TriCaster product range....

24/10/2024

FCC Sends Second Round of EEO Audit Letters to TV, Radio Stations

WASHINGTON, D.C. The FCC's Enforcement Bureau has sent out Equal Employment Opportunity (EEO) audit letters to 150 randomly selected TV and radio stations....

24/10/2024

USTelecom: Broadband Providers Invested $94.7 Billion in 2023

Industry group USTelecom has released a study showing broadband providers invested $94.7 billion into the U.S. communications infrastructure in 2023. The annual...

24/10/2024

Curse of the Sin Eater Used DaVinci Resolve Studio and Blackmagic Cloud for End to End Post Production

Curse of the Sin Eater Used DaVinci Resolve Studio and Blackmagic Cloud for End ...

24/10/2024

Michael Shinn Named Executive Director of Boston Conservatory at Berklee

Michael Shinn Named Executive Director of Boston Conservatory at Berklee Shinn, who served as the Conservatory's dean of music for six years, has been int...

24/10/2024

India Should Manufacture Its Own AI,' Declares NVIDIA CEO

Artificial intelligence will be the driving force behind India's digital transformation, fueling innovation, economic growth, and global leadership, NVIDIA ...

24/10/2024

VEON's Jazz Launches FikrFree: An AI-Powered Digital Marketplace to Unlock Affordable Insurance and Healthcare in Pakistan

24 Oct 2024 VEON's Jazz Launches FikrFree: An AI-Powered Digital Marketplac...

24/10/2024

NESN Continues Unobstructed Views Series of Alternate Broadcasts With Six Bruins-Themed Episodes

NESN Continues Unobstructed Views Series of Alternate Broadcasts With Six Bruins...

24/10/2024

Inside the NFL's International Strategy, Broadcast Plans for the Growth of Its Future European Fan Base

Touchdown: Inside the NFL's international strategy and broadcast plans for t...

24/10/2024

SVG New Sponsor Spotlight: AbelCine's Tom Digges on the Growing Trend of Cinematic Cameras in Live Sports

SVG New Sponsor Spotlight: AbelCine's Tom Digges on the Growing Trend of Cin...

24/10/2024

Sweet Home, Carolina: How Charlotte Became a REMI Sports Production Hub

Sweet Home, Carolina: How Charlotte Became a REMI Sports Production Hub Leaders from ESPN, FOX Sports, NASCAR, Van Wagner, and SMT discuss their at-home product...

24/10/2024

SVG Sit-Down: USWNT Star Sydney Leroux on Working With DAZN's Team Whistle, Increased Interest in Women's Sports

SVG Sit-Down: USWNT Star Sydney Leroux on Working With DAZN's Team Whistle, ...

24/10/2024

Sony Sports CEO Rufus Hack on the Impact of the KinaTrax Acquisition

Sony Sports CEO Rufus Hack on the Impact of the KinaTrax Acquisition KinaTrax joins Hawk-Eye, Beyond Sports, and Pulselive under the Sony Sporta umbrella By Br...