Nvidia updates programming tools to speed up GPU performance

CUDA 6 adds support for unified memory, which will make programming for GPUs faster and more efficient

Nvidia has made improvements to its underlying software tools to make it easier to write programs for faster execution across CPUs and graphics processors.

The company on Thursday announced CUDA 6, which will make programming easier for supercomputers, servers, PCs and, to a lesser extent, smartphones. The goal of CUDA is to provide underlying tools so programmers can off-load processing from CPUs to GPUs, which is faster for technical and graphics applications.

CUDA 6 offers unified memory, an advanced management feature that makes GPU memory as readily accessible as CPU memory. Previously, data had to be moved from CPUs to GPUs for execution and then moved back, creating two data pools. But with unified memory, a developer doesn't have to manage where data is to take advantage of the GPU.

The memory management feature will figure out whether to dispatch data to CPU or GPU memory, and that will reduce the need for programmers to add lines of code to define where the data should be sent, said Sumit Gupta, general manager of Tesla Accelerated Computing products at Nvidia.

The developer doesn't have to worry about GPU and CPU memory because those won't be handled by programming but by directives in CUDA, said Dan Olds, principal analyst at Gabriel Consulting Group.

"This addition to CUDA is evolutionary, not revolutionary," Olds said.

For example, GPUs are often used in servers for desktop virtualization and automating memory placement could speed up the deployment of OS instances via virtual machines, Olds said.

CUDA's unified memory feature is similar to the HSA (Heterogeneous System Architecture) Foundation's HUMA specification, in which different memory types in a system are shared between processors. The specification allows programmers to write applications without worrying about which memory resource the code is transferred to. Nvidia is not a member of the HSA Foundation, which was founded last year by companies including Advanced Micro Devices, ARM, Qualcomm and others.

The feature also falls in line with Nvidia's goal to make CPU and GPU memory a shared resource at the hardware level. Nvidia's upcoming Tegra 6 mobile processor code-named Parker will pool CPU and GPU memory in devices, servers and PCs to expand the addressable memory available to programs. Currently, GPU and CPU memory are divided, though the unified memory feature in CUDA 6 should alleviate that problem at a software layer until the implementation of upcoming hardware improvements.

Some of the world's fastest supercomputers use GPUs as co-processors to speed up computing. The last CUDA update, version 5.5, added support for ARM CPUs. CUDA 6 has also has improved libraries that could speed up calculations on graphics processors.

Agam Shah covers PCs, tablets, servers, chips and semiconductors for IDG News Service. Follow Agam on Twitter at @agamsh. Agam's e-mail address is agam_shah@idg.com

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags softwareapplication developmentnvidiaComponentsDevelopment toolsGraphics boards

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Agam Shah

IDG News Service
Show Comments

Father’s Day Gift Guide

Brand Post

Bitdefender 2019

Bitdefender solutions stop attacks before they even begin! Get cybersecurity that 500 MILLION users already have and trust.

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Laura Johnston

MSI GS65 Stealth Thin

If you can afford the price tag, it is well worth the money. It out performs any other laptop I have tried for gaming, and the transportable design and incredible display also make it ideal for work.

Andrew Teoh

Brother MFC-L9570CDW Multifunction Printer

Touch screen visibility and operation was great and easy to navigate. Each menu and sub-menu was in an understandable order and category

Louise Coady

Brother MFC-L9570CDW Multifunction Printer

The printer was convenient, produced clear and vibrant images and was very easy to use

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Featured Content

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?