Nvidia chief downplays challenge from Google’s AI chip

GPUs are still king for some deep learning tasks, says Nvidia's CEO

Nvidia has staked a big chunk of its future on supplying powerful graphics chips used for artificial intelligence, so it wasn't a great day for the company when Google announced two weeks ago that it had built its own AI chip for use in its data centers.

Google's Tensor Processing Unit, or TPU, was built specifically for deep learning, a branch of AI through which software trains itself to get better at deciphering the world around it, so it can recognize objects or understand spoken language, for example.

TPUs have been in use at Google for more than a year, including for search and to improve navigation in Google Maps. They provide "an order of magnitude better-optimized performance per watt for machine learning" compared to other options, according to Google.

That could be bad news for Nvidia, which designed its new Pascal microarchitecture with machine learning in mind. Having dropped out of the smartphone market, the company is looking to AI for growth, along with gaming and VR.

But Nvidia CEO Jen-Hsun Huang isn't phased by Google's chips, he said at the Computex trade show Monday.

For a start, he said, deep learning has two aspects to it -- training and inferencing -- and GPUs are still much better at the training part, according to Huang. Training involves presenting an algorithm with vast amounts of data so it can get better at recognizing something, while inferencing is when the algorithm applies what it's learned to an unknown input.

"Training is billions of times more complicated that inferencing," he said, and training is where Nvidia's GPUs excel. Google's TPU, on the other hand, is "only for inferencing," according to Huang. Training an algorithm can take weeks or months, he said, while inferencing often happens in a split second.

Besides that distinction, he noted that many of the companies that will need to do inferencing won't have their own processor.

"For companies that want to build their own inferencing chips, that's no problem, we're delighted by that," Huang said. "But there are millions and millions of nodes in the hyperscale data centers of companies that don't build their own TPUs. Pascal is the perfect solution for that."

That Google built its own chip shouldn't be a big surprise. Technology can be a competitive advantage for big online service providers, and companies like Google, Facebook and Microsoft already design their own servers. Designing a processor is the next logical next step, albeit a more challenging one.

Whether Google's development of the TPU has affected its other chip purchases is tough to know.

"We're still buying literally tons of CPUs and GPUs," a Google engineer told The Wall Street Journal. "Whether it's a ton less than we would have otherwise, I can't say."

Meanwhile Nvidia's Huang, like others in the industry, expects deep learning and AI to become pervasive. The last 10 years were the age of the mobile cloud, he said, and we're now in the era of artificial intelligence. Companies want to better understand the masses of data they're collecting, and that will happen through AI.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags computex

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

James Niccolai

IDG News Service
Show Comments

Brand Post

Bitdefender 2019

Shop safely with our award-winning security solution. Protect yourself this Black Friday and get the exclusive Black Friday discount for Bitdefender 2019!

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Maryellen Rose George

Brother PT-P750W

It’s useful for office tasks as well as pragmatic labelling of equipment and storage – just don’t get too excited and label everything in sight!

Cathy Giles

Brother MFC-L8900CDW

The Brother MFC-L8900CDW is an absolute stand out. I struggle to fault it.

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Laura Johnston

MSI GS65 Stealth Thin

If you can afford the price tag, it is well worth the money. It out performs any other laptop I have tried for gaming, and the transportable design and incredible display also make it ideal for work.

Andrew Teoh

Brother MFC-L9570CDW Multifunction Printer

Touch screen visibility and operation was great and easy to navigate. Each menu and sub-menu was in an understandable order and category

Featured Content

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?