Nvidia's monstrous Volta GPU appears, packed with 21 billion transistors and 5,120 cores

Taking the wind out of Radeon Vega's sails.

“We need to find a path forward for life after Moore’s Law,” Nvidia CEO Jen-Hsun Huang said at the beginning of his annual GPU Technology Conference keynote. But Nvidia isn’t hesitant to throw around more iron to make its ferocious graphics processors even more so, as evidenced by the reveal of the first product based on Nvidia’s badass next-gen Volta GPU.

Nvidia’s high-end “Pascal” processors still rule the graphics roost, though AMD’s rival Radeon Vega GPUs are scheduled to launch before the end of June. Volta helps Nvidia take some of the wind out of AMD’s sails before Vega even hits the streets, even though the Tesla V100 GPU is focused on data centers.

This beastly GPU—both in size and capabilities—boasts a whopping 21 billion transistors and 5,120 CUDA cores, built using a 12-nanometer manufacturing process more advanced than that of Nvidia’s current GPUs. By comparison, today’s Pascal GPU flagship, the 14nm Tesla P100, offers 3,840 CUDA cores and 15 billion transistors. To fit all that tech, the Volta GPU in the Tesla V100 measures a borderline ridiculous 815mm square, compared to the Tesla P100’s 600mm GPU. Monstrous.

nvidia volta tesla Nvidia

Nvidia's Volta-based Tesla V100.

Volta is “at the limits of photolithography,” Huang said with a smirk, with an R&D budget of over $3 billion.

Nvidia says it’s redesigned Volta’s streaming microprocessor architecture to be 50 percent more efficient than Pascal's, which is damned impressive if it proves true. That enables “major boosts in FP32 and FP64 performance in the same power envelope,” Nvidia says. The Tesla V100 also includes new “tensor cores” built specifically for deep learning, providing 12 times the teraflops throughput of the Pascal-based Tesla P100, Huang said. It hits a peak of:

  • 7.5 TFLOP/s of double precision floating-point (FP64) performance;
  • 15 TFLOP/s of single precision (FP32) performance;
  • 120 Tensor TFLOP/s of mixed-precision matrix-multiply-and-accumulate.

The Tesla V100 utilizes 16GB of ultra-fast high-bandwidth memory to process data quickly. It’s unknown whether Volta-based consumer graphics cards will feature HBM2, however. Radeon Vega does, but the tech is still relatively new and pricey. The GeForce GTX 10-series graphics cards debuted with new GDDR5X technology based on classic memory designs, and SK Hynix recently said that it’s “planning to mass produce the product for a client to release high-end graphics card by early 2018 equipped with high performance GDDR6 DRAMs.”

That HBM2 memory hits 900GB/s speeds, Nvidia says, and the Tesla V100 features a second-gen version of Nvidia’s NVLink technology. At 300GB/s transfer speeds, Huang claims NVLink is now 10 times faster than standard PCIe connections.

volta die Nvidia

Inside the Tesla V100.

If you want to know more about Volta’s datacenter and architecture details, be sure to check out Nvidia’s Tesla V100 explainer. Look for the Tesla V100 to launch in a revamped version of Nvidia’s pricey DGX-1 system in the third quarter, and more widely in the fourth quarter.

The impact on you at home: None, immediately. But this first glimpse at Volta gives us an idea of what Nvidia’s next-gen GeForce graphics cards will be capable of. Remember, Nvidia revealed its Pascal GPU at GTC 2016 in the form of the Tesla P100, and that full-fat version eventually trickled down into the Titan Xp, with the GeForce GTX 1080 Ti coming damned close. The Tesla V100’s extreme GPU size and strong machine learning focus skews that somewhat when it comes to Volta, though.

One more thing: The GeForce GTX 10-series launched a mere month after Pascal’s GTC reveal, about one year ago. Don’t necessarily expect Nvidia’s Volta-based GeForce cards to launch in the near future, especially if SK Hynix’s GDDR6 memory is indeed headed for Nvidia cards, rather than next-gen Radeons.

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags nvidia

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Brad Chacos

PC World (US online)
Show Comments

Father’s Day Gift Guide

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Matthew Stivala

HP OfficeJet 250 Mobile Printer

The HP OfficeJet 250 Mobile Printer is a great device that fits perfectly into my fast paced and mobile lifestyle. My first impression of the printer itself was how incredibly compact and sleek the device was.

Armand Abogado

HP OfficeJet 250 Mobile Printer

Wireless printing from my iPhone was also a handy feature, the whole experience was quick and seamless with no setup requirements - accessed through the default iOS printing menu options.

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?