Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX workstation and PC users.
Across industries, AI is driving innovation and enabling efficiencies - but to unlock its full potential, the technology must be trained on vast amounts of high-quality data.
Data scientists play a key role in preparing this data, especially in domain-specific fields where specialized, often proprietary data is essential to enhancing AI capabilities.
To help data scientists with increasing workload demands, NVIDIA announced that RAPIDS cuDF, a library that allows users to more easily work with data, accelerates the pandas software library with zero code changes. Pandas is a flexible, powerful and popular data analysis and manipulation library for the Python programming language. With cuDF, data scientists can now use their preferred code base without compromising on data processing speed.
NVIDIA RTX AI hardware and technologies can also deliver data processing speedups. They include powerful GPUs that deliver the computational performance necessary to quickly and efficiently accelerate AI at every level - from data science workflows to model training and customization on PCs and workstations.
The Data Science Bottleneck The most common data format is tabular data, which is organized in rows and columns. Smaller datasets can be managed with spreadsheet tools like Excel, however, datasets and modeling pipelines with tens of millions of rows typically rely on dataframe libraries in programming languages like Python.
Python is a popular choice for data analysis, primarily because of the pandas library, which features an easy-to-use application programming interface (API). However, as dataset sizes grow, pandas struggles with processing speed and efficiency in CPU-only systems. The library also notoriously struggles with text-heavy datasets, which is an important data type for large language models.
When data requirements outgrow pandas' capabilities, data scientists are faced with a dilemma: endure slow processing timelines or take the complex and costly step of switching to more efficient but less user-friendly tools.
Accelerating Preprocessing Pipelines With RAPIDS cuDF RAPIDS cuDF speeds the popular pandas library up to 100x on RTX-powered AI PCs and workstations. With RAPIDS cuDF, data scientists can use their preferred code base without sacrificing processing speed.
RAPIDS is an open-source suite of GPU-accelerated Python libraries designed to improve data science and analytics pipelines. cuDF is a GPU DataFrame library that provides a pandas-like API for loading, filtering and manipulating data.
Using cuDF's pandas accelerator mode, data scientists can run their existing pandas code on GPUs to take advantage of powerful parallel processing, with the assurance that the code will switch to CPUs when necessary. This interoperability delivers advanced, reliable performance.
The latest release of cuDF supports larger datasets and billions of rows of tabular text data. This allows data scientists to use pandas code to preprocess data for generative AI use cases.
Accelerating Data Science on NVIDIA RTX-Powered AI Workstations and PCs According to a recent study, 57% of data scientists use local resources such as PCs, desktops or workstations for data science.
Data scientists can achieve significant speedups starting with the NVIDIA GeForce RTX 4090 GPU. As datasets grow and processing becomes more memory-intensive, they can use cuDF to deliver up to 100x better performance with NVIDIA RTX 6000 Ada Generation GPUs in workstations, compared with traditional CPU-based solutions.
Two common data science operations - join and groupby - are on the y-axis, while the x-axis shows the time it took to run each operation. Data scientists can easily get started with RAPIDS cuDF on NVIDIA AI Workbench. This free developer environment manager powered by containers enables data scientists and developers to create, collaborate and migrate AI and data science workloads across GPU systems. Users can get started with several example projects available on the NVIDIA GitHub repository, such as the cuDF AI Workbench project.
cuDF is also available by default on HP AI Studio, a centralized data science platform designed to help AI developers seamlessly replicate their development environment from workstations to the cloud. This allows them to set up, develop and collaborate on projects without managing multiple environments.
The benefits of cuDF on RTX-powered AI PCs and workstations extend beyond raw performance speedups. It also:
Saves time and money with fixed-cost local development on powerful GPUs that replicates seamlessly to on-premises servers or cloud instances.
Enables faster data processing for quicker iterations, allowing data scientists to experiment, refine and derive insights from datasets at interactive speeds.
Delivers more impactful data processing for better model outcomes further down the pipeline.
Learn more about RAPIDS cuDF.
A New Era of Data Science As AI and data science continue to evolve, the ability to rapidly process and analyze massive datasets will become a key differentiator to enable breakthroughs across industries. Whether for developing sophisticated machine learning models, conducting complex statistical analyses or exploring generative AI, RAPIDS cuDF provides the foundation for next-generation data processing.
NVIDIA is expanding that foundation by adding support for the most popular dataframe tools, including Polars, one of the fastest-growing Python libraries, which significantly accelerates data processing compared with other CPU-only tools out of the box.
Polars announced this month the open beta of the Polars GPU Engine
Most recent headlines
30/12/2024
Digital Domain Creates Groundbreaking VFX for Venom: The Last Dance, Bringing ...
30/12/2024
Internet Giant GMP Builds Tokyo Virtual Event Space with URSA Broadcast G2
Brie Clayton December 30, 2024
0 Comments
Blackmagic URSA Broadcast G2 and ...
30/12/2024
Renderboxes launches Photon, a no-compromise transportable high-performance work...
30/12/2024
Shinobi II Monitor Supports Canon, Sony, Nikon - Touch to Focus with New Feature...
30/12/2024
The pace of technology innovation has accelerated in the past year, most dramati...
29/12/2024
Gyeongnam Culture and Arts Foundation (GCAF), an active promotor of cultural and artistic diversity, has chosen Ikegami UHK-X700 camera chains for integration i...
27/12/2024
After starting 2024 with hopes that the transition to streaming might finally produce a more stable, profitable businesses, the media and entertainment industry...
27/12/2024
Broadcasters ended the year with hopes and fears about how the federal government will regulate the TV industry in 2025. While the incoming Trump administration...
27/12/2024
NVIDIA's AI Podcast gives listeners the inside scoop on the ways AI is transforming nearly every industry. Since the show's debut in 2016, it's gar...
26/12/2024
Talking about artificial intelligence in 2024 is akin to talking about the internet in 1994 everyone's excited about it and thinks it will have an enormous ...
26/12/2024
Back to All News
Netflix NFL Christmas Gameday Reaches 65 Million US Viewers
Entertainment
26 December 2024
GlobalUnited States
Link copied to clipboard
N...
26/12/2024
Back to All News
Check Out All the Must-See Trailers From Netflix's NFL Chr...
26/12/2024
Back to All News
Beyonc Delivers Epic Gift of a Halftime Performance "Beyonc...
26/12/2024
Back to All News
Get in the Game With Squid Game' Season 2 Complete Coverage Guide
Entertainment
26 December 2024
Global
Link copied to clipboard
Are...
26/12/2024
This GFN Thursday wraps up another incredible year for cloud gaming. Take a look back at the top games and new features that made 2024 a standout for GeForce NO...
24/12/2024
The National Film and Video Foundation (NFVF) is calling for applications from South African film and television filmmakers to be part of the NFVF's delegat...
24/12/2024
WASHINGTON, D.C. The Federal Communications Commission Enforcement Bureau said Paramount Global is being fined $244,952 for violations of emergency alerting rul...
24/12/2024
NEW YORK Carnegie Hall's video-streaming channel, Carnegie Hall+, said it will celebrate the holiday season by offering a wide selection of holiday-themed o...
24/12/2024
LOS ANGELES PlayersTV, an athlete and fan-owned media company, has announced the acquisition of Cloud Media Center, an AI-driven sports adtech and media distrib...
24/12/2024
The Best Playlists of 2024 The top playlists we created in 2024, from dad rock to dembow.
By
Tara Bellucci
December 23, 2024
Image by Kelly Davidson
Tak...
24/12/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
23/12/2024
At IBC2024, Grass Valley CTO Ian Fletcher told attendees at GV Forum that broadcast is now an IT industry. During our discussions at the show, TVBEurope heard v...
23/12/2024
According to co-director Nick Park, the production team embraced technology to help create the iconic duos latest adventure
By Jenny Priestley
Published: Dec...
23/12/2024
VFX house Lux Aeterna used wave height data from the National Oceanic & Atmosphe...
23/12/2024
We are committed to supporting and investing in Foxtel's television and streaming services, across both sports and entertainment, using our world-leading te...
23/12/2024
From AI to IP, the cloud to virtual production, key industry executives take a look back at some of the biggest trends that impacted the media and entertainment...
23/12/2024
Boost Graphics, the specialist international graphics and virtual production subsidiary of EMG / Gravity Media, the leading force in production and content & me...
23/12/2024
LucidLink, the leading storage collaboration platform revolutionizing how global teams work, proudly announces its achievement of the prestigious Trusted Partne...
23/12/2024
Mediagenix, a leader in software solutions for content strategy, content value management, and content scheduling, announces the appointment of Bruno Langlais a...
23/12/2024
WCTEPublic Media Venture Group (PMVG) has announced that it is now providing real-time translation of closed captioning from English to Spanish on PMVG's Ne...
23/12/2024
Deltatre, the tech company behind the media and sporting moments that matter, has appointed Charlie Mitchell as Head of Sports for the Americas. Charlie will sp...
23/12/2024
Media Excel, a global leader in real-time video solutions, proudly announces the appointment of Matthew Goldman to its Technical Advisory Board. A distinguished...
23/12/2024
Disguise the company behind the virtual production technology used on commercials for Apple Music and Lenovo, as well as feature film Daddio starring Sean Pen...
23/12/2024
Leading AI and video search company Moments Lab is pleased to announce its integration with Bitcentral. The integration enables Bitcentral Oasis MAM users to en...
23/12/2024
Amagi, the global leader in cloud-based SaaS technology for broadcast and connected TV (CTV), today announced that ABC Commercial has partnered with Amagi to la...
23/12/2024
Digital Alert Systems, the global leader in emergency communications solutions for media providers, today announced that Ed Czarnecki, the company's vice pr...
23/12/2024
Matthews Studio Equipment, known for the heftiest hardware, has a new solution to simplify mounting live production moving lights to standard grip equipment. Th...
23/12/2024
Matthews Studio Equipment expands its trusted Road-line with the launch of RoadBags, durable fillable sandbags available in three sizes. Whether in the studio o...
23/12/2024
Sport Lisboa e Benfica, one of Portugal's most prestigious football clubs, has partnered with Clear-Com to upgrade the communications system at the Est dio...
23/12/2024
At stand B6.734, Black Box will showcase its Emerald KVM-over-IP solution, which enables smarter studio control with secure remote access from anywhere, along...
23/12/2024
OOONA, a leading provider of professional management and production tools for the media localization industry, announced today a partnership with Audio Descript...
23/12/2024
Dunk The Halls: ESPN Refines Animated Altcast Tech and Ops with a Helping Hand F...
23/12/2024
With the holiday season in full swing, we are delighted to bring you a special digital event, Leading Through Change with Technicolor Group's Chief People O...
23/12/2024
Netflix Kicks Off NFL Christmas Games: Behind the Scenes With the Streaming Gian...
23/12/2024
Friendly Confines Go Frozen: TNT Sports Augments 2024 NHL Winter Classic Coverag...
23/12/2024
ESPN's Tina Thornton on Producing The Simpsons Funday Football, Upcoming Dun...
23/12/2024
Dunk The Halls: ESPN Refine Animated Altcast Tech and Ops with a Helping Hand Fr...
23/12/2024
Back to All News
NFL Christmas Gameday Live Comes to Netflix With Blimps, Hot C...
22/12/2024
News Corp Announces Agreement to Sell Foxtel to DAZN for Enterprise Value of A$3...
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX workstation and PC users.
