Battle lines drawn over parallel processing

A recent Intel report highlights the push to use GPUs for parallel processing applications

Intel tried to push back at coverage of a recently published paper that found its Core i7 processors couldn't match the parallel processing performance of an Nvidia GPU, saying its rival took the findings of the paper out of context in a blog post that trumpeted the results.

"Nvidia picked up on a small part of the paper and took it out of context," said Nick Knupffer, an Intel spokesman, in an e-mail.

However, the paper's findings were clear. Titled "Debunking the 100x GPU vs. CPU myth: An evaluation of throughput computing on CPU and GPU," the paper was written by Intel engineers and sought to discredit claims that GPUs outperform CPUs by a wide margin in parallel processing applications. Nevertheless, the paper still found that one of Intel's fastest quad-core desktop processors, the 3.2GHz Core i7 960, was markedly slower than an older Nvidia graphics card, the GeForce GTX280, in benchmark tests conducted by the engineers.

"Our data shows that GTX280 only has an average of 2.5X performance advantage over Core i7 in the 14 kernels tested," the paper said, noting that the Nvidia GPU was more than 14 times faster under some circumstances.

Nvidia discussed the paper's findings in a blog post that questioned the magnitude of the GPU performance advantage described in Intel's paper, providing links to 10 customers who documented performance increases of 100 times or more using software that was optimized to run on GPUs.

The company also noted Intel researchers didn't publish the software code and data they used to conduct the benchmark tests. Without that information, it's impossible to repeat Intel's tests to confirm the paper's findings or to understand how the code was optimized for the chips.

"It's just bad science," said Andy Keane, general manager of GPU computing at Nvidia and the author of the blog post, discussing the paper in an interview.

Despite their rivalry, Intel and Nvidia readily agree on the importance of parallel processing capabilities. The only disagreement between them is whether the CPU or GPU is the component that's best suited to handling these parallel processing workloads, an argument largely based on their respective product strengths.

Intel, which dominates the market for x86 CPUs, believes that its chips have the necessary power to handle these workloads, whereas Nvidia -- the world's largest provider of discrete, or standalone, graphics chips -- thinks using the GPU is a better choice. Advanced Micro Devices, which sells both GPUs and x86 CPUs, shares Nvidia's view that GPUs can offer a significant performance boost in certain types of applications.

The Intel paper generally reinforces the position held by Nvidia and AMD by acknowledging that the GTX280 holds a performance advantage over the Core i7 960 when it comes to parallel processing.

The reason for the difference in performance between CPUs and GPUs is that the two chips are designed with fundamentally different purposes in mind. CPUs are designed to handle a series of instructions in sequential order. The addition of multithreading capabilities and multiple cores gives CPUs a significant degree of parallelism, but that pales in comparison to what GPUs from Nvidia and AMD are capable of with certain applications, such as video encoding.

Originally used to draw thousands of polygons and map textures for realistic computer graphics, GPUs are parallel processors designed to handle many operations at the same time. Each GPU processor core may be simpler and less powerful than a CPU core but the latest Nvidia GPUs have hundreds of them, compared to just four cores on the Core i7 960. The ability to process hundreds of operations simultaneously is where GPUs get their parallel processing advantage -- a point that Intel researchers acknowledged in their paper.

"There is little doubt that today's CPUs would provide the best single thread performance for throughput computing workloads. However, the limited number of cores in today's CPUs limits how many pieces of data can be processed simultaneously. On the other hand, GPUs provide many parallel processing units which are ideal for throughput computing," the paper said.

However, hardware alone isn't enough. Getting the most performance requires that an application be optimized to run on a GPU. That can be time-consuming and expensive. As a result, most applications optimized to run on GPUs are typically used in financial analysis and other fields, such as oil exploration and scientific research, where the benefits from higher performance outweigh the added cost of optimization.

GPU acceleration capabilities are increasingly a feature of consumer and business software.

One of the first companies to use the technology was Apple, which added the ability to use GPUs to handle some application workloads in the latest release of MacOS X, called Snow Leopard. Other companies followed suit, including Adobe, which uses GPU acceleration in Premiere Pro CS5, After Affects CS5 and Photoshop CS5.

Microsoft included GPU acceleration capabilities in Windows 7 and is adding the technology to its upcoming Internet Explorer 9 browser.

Smaller software companies are also attracted to GPU acceleration, like Fotegrafik Labs, a Singaporean startup that developed software used to search a database of images or video files.

The image search software was developed on a server that's powered by a single quad-core Intel Xeon processor, but Fotegrafik Labs is considering switching to GPUs because they are more efficient than CPUs for this type of application and would allow the software to be used with very large databases, said Ori Cohen, the company's CEO, citing the relatively low cost of GPUs compared to the high performance they offer.

"If Intel could provide us with a CPU with hundreds of cores at a competitive price, then maybe the CPU would be an alternative to the GPU for video applications," Cohen said.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags intelprocessorsnvidiaComponentsGraphics boards

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Sumner Lemon

IDG News Service
Show Comments

Brand Post

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Laura Johnston

MSI GS65 Stealth Thin

If you can afford the price tag, it is well worth the money. It out performs any other laptop I have tried for gaming, and the transportable design and incredible display also make it ideal for work.

Andrew Teoh

Brother MFC-L9570CDW Multifunction Printer

Touch screen visibility and operation was great and easy to navigate. Each menu and sub-menu was in an understandable order and category

Louise Coady

Brother MFC-L9570CDW Multifunction Printer

The printer was convenient, produced clear and vibrant images and was very easy to use

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Featured Content

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?