Facebook's Caffe2 AI tools come to iPhone, Android, and Raspberry Pi

Your smartphone may soon be able to recognize objects in images without accessing the cloud

IDG

IDG

New intelligence can be added to mobile devices like the iPhone, Android devices, and low-power computers like Raspberry Pi with Facebook's new open-source Caffe2 deep-learning framework.

Caffe2 can be used to program artificial intelligence features into smartphones and tablets, allowing them to recognize images, video, text, and speech and be more situationally aware.

It's important to note that Caffe2 is not an AI program, but a tool allowing AI to be programmed into smartphones. It takes just a few lines of code to write learning models, which can then be bundled into apps.

The release of Caffe2 is significant. It means users will be able to get image recognition, natural language processing, and computer vision directly on their phone. That task is typically offloaded to remote servers in the cloud, with smartphones then connecting to it.

Mobile devices are getting more artificial intelligence capabilities. More phones are being bundled with Amazon's Alexa and Google Assistant, while Apple's Siri has been a staple in the iPhone for years. Samsung's Galaxy S8 smartphones are due to get the Bixby voice assistant, which should make using the handsets much easier.

Caffe2 can work within the power constraints of mobile devices. It works with mobile hardware to speed up AI applications and create neural networks.

Caffe2 takes advantage of the computing power of new mobile hardware to speed up deep-learning tasks. For example, in smartphones, Caffe2 will harness the computing power of Adreno GPUs and Hexagon DSPs on Qualcomm's Snapdragon mobile chips.

The new machine-learning framework succeeds Caffe, which excelled at image recognition. Caffe was mainly used for machine learning in data centers, and Caffe2 is a complete overhaul so it can work on mobile devices.

"We're committed to providing the community with high-performance machine learning tools so that everyone can create intelligent apps and services," Facebook said in a blog entry on the Caffe2 website.

Caffe2 could also be used to create chatbots. The Caffe2 website has some pre-trained models that could be used to create learning models.

Before this announcement, it was already possible to create deep learning models on mobile devices through Google's TensorFlow. TensorFlow could be ported to devices like drones to add image recognition to cameras. Like with TensorFlow, the code in Caffe2 can be easily ported between multiple environments.

The open-source framework is also a lot faster than the original Caffe. Benchmarks by Intel, Qualcomm, and Nvidia boast significant speed boosts compared to Caffe and other machine-learning frameworks.

There are other machine-learning frameworks like Theano and Microsoft's Cognitive Toolkit (CNTK). Companies deploying machine learning sometimes mix and match frameworks depending on applications.

But the major appeal of Caffe2 still remains tied to mega data centers. For example, servers with GPUs are used to create the rich data sets needed for image recognition. Image recognition involves the classification and labeling of pixels, which can help identify an object accurately. The learning model gets more accurate as more data is fed. That's especially handy in applications like self-driving cars, which need to identify objects to avoid collisions.

Nvidia claims that Caffe2 will be significantly faster than on its high-end GPUs than the original Caffe. Some Nvidia GPUs designed for machine learning have low-level floating computing capabilities, instrumental in creating a powerful neural network to make accurate assumptions.

Facebook is expected to share more details on Caffe2 on Wednesday during the F8 conference being held in San Jose, California.

Join the Good Gear Guide newsletter!

Error: Please check your email address.

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Agam Shah

IDG News Service
Show Comments

Most Popular Reviews

Latest News Articles

Resources

PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?