Nvidia chief downplays challenge from Google’s AI chip

GPUs are still king for some deep learning tasks, says Nvidia's CEO

Nvidia has staked a big chunk of its future on supplying powerful graphics chips used for artificial intelligence, so it wasn't a great day for the company when Google announced two weeks ago that it had built its own AI chip for use in its data centers.

Google's Tensor Processing Unit, or TPU, was built specifically for deep learning, a branch of AI through which software trains itself to get better at deciphering the world around it, so it can recognize objects or understand spoken language, for example.

TPUs have been in use at Google for more than a year, including for search and to improve navigation in Google Maps. They provide "an order of magnitude better-optimized performance per watt for machine learning" compared to other options, according to Google.

That could be bad news for Nvidia, which designed its new Pascal microarchitecture with machine learning in mind. Having dropped out of the smartphone market, the company is looking to AI for growth, along with gaming and VR.

But Nvidia CEO Jen-Hsun Huang isn't phased by Google's chips, he said at the Computex trade show Monday.

For a start, he said, deep learning has two aspects to it -- training and inferencing -- and GPUs are still much better at the training part, according to Huang. Training involves presenting an algorithm with vast amounts of data so it can get better at recognizing something, while inferencing is when the algorithm applies what it's learned to an unknown input.

"Training is billions of times more complicated that inferencing," he said, and training is where Nvidia's GPUs excel. Google's TPU, on the other hand, is "only for inferencing," according to Huang. Training an algorithm can take weeks or months, he said, while inferencing often happens in a split second.

Besides that distinction, he noted that many of the companies that will need to do inferencing won't have their own processor.

"For companies that want to build their own inferencing chips, that's no problem, we're delighted by that," Huang said. "But there are millions and millions of nodes in the hyperscale data centers of companies that don't build their own TPUs. Pascal is the perfect solution for that."

That Google built its own chip shouldn't be a big surprise. Technology can be a competitive advantage for big online service providers, and companies like Google, Facebook and Microsoft already design their own servers. Designing a processor is the next logical next step, albeit a more challenging one.

Whether Google's development of the TPU has affected its other chip purchases is tough to know.

"We're still buying literally tons of CPUs and GPUs," a Google engineer told The Wall Street Journal. "Whether it's a ton less than we would have otherwise, I can't say."

Meanwhile Nvidia's Huang, like others in the industry, expects deep learning and AI to become pervasive. The last 10 years were the age of the mobile cloud, he said, and we're now in the era of artificial intelligence. Companies want to better understand the masses of data they're collecting, and that will happen through AI.

Join the Good Gear Guide newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags computex

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

James Niccolai

IDG News Service
Show Comments

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Matthew Stivala

HP OfficeJet 250 Mobile Printer

The HP OfficeJet 250 Mobile Printer is a great device that fits perfectly into my fast paced and mobile lifestyle. My first impression of the printer itself was how incredibly compact and sleek the device was.

Armand Abogado

HP OfficeJet 250 Mobile Printer

Wireless printing from my iPhone was also a handy feature, the whole experience was quick and seamless with no setup requirements - accessed through the default iOS printing menu options.

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?