Elgan: When the iPhone feels your pain

Smartphones are smart, but tomorrow's gadgets will have emotional intelligence

We love our gadgets. But they treat us with an indifference that sometimes feels like contempt. They're like cats.

But soon, they'll act more like dogs -- perceptive of how we feel, and reacting to our moods by joining in on our elation or treading lightly when we're angry.

Such capabilities are nearly inevitable, either sooner or later, because the trajectory of interface design is always toward making machines increasingly "human-compatible," which means they'll interact with us like another human being would. And that requires some level of empathy.

In a CES 2011 keynote address last week, Samsung President B.K. Yoon said, "Digital humanism will characterize the new decade that has begun." He said that "adding emotional value to digital technology" is central to Samsung's mission. And they're not the only ones.

MIT has a research division called the Affective Computing group that "aims to bridge the gap between computational systems and human emotions."

One of the group's more interesting projects resulted in a gadget called the Emotional Social Intelligence Prosthetic , or ESP -- there's no "I" in social intelligence, apparently. The purpose of the ESP is to inform the user about the emotional state of the person he or she is talking to.

The device is a tiny, handheld computer with special sensors and a camera. It looks for signs of boredom and other emotions, and informs the user so he can change the subject if he's getting on the listener's nerves.

Of course, the ESP project will never result in a product. But it's an example of research devoted to the engineering problem of detecting human emotions with a handheld device.

Cambridge University researchers have developed a technology they call EmotionSense that uses both speech-recognition software and special sensors in the phone to figure out how the user is feeling.

Their goal is to develop a nonintrusive way to accurately gauge the emotional state of a person holding a smartphone .

Their initial aim is to use the technology for social science research. The idea is to find correlations between how a user feels and various locations, people or other factors that are linked to a particular state of mind. Not surprisingly, people tended to be "happy" at home and "sad" at work.

In an initial trial, the researchers found that the system was roughly 70 per cent accurate in perceiving the emotional states reported by test subjects in a follow-up survey.

Although the initial aims are scientific, it's clear that the first step in the development of an emotionally perceptive smartphone is accurate, nonintrusive sensors, which the Cambridge researchers are demonstrating.

Another, related project at Cambridge is looking at building emotional detection into GPS car navigation devices . Their vision is a dashboard GPS device that uses special sensors to monitor facial expressions, voice intonation and hand movements to perceive the emotions of the driver. For example, if the driver were stressed out, it could hold incoming calls, delay giving additional instructions or turn off the sound system. (Personally, I think a dashboard that did all this would actually make me angry.)

Research In Motion unveiled a concept design for a phone called the BlackBerry Empathy , which is based on a wireless "mood ring." (No, I'm not making this up.)

The ring somehow gathers your biometric data, which is sent to the phone. The phone would also detect the emotions of people near you, and would let you know if they're angry, sad or bored; it would do the same with your social networking contacts. The idea is that everyone would know via Facebook how everyone else was feeling, based on biometric data.

The German giant Siemens announced in September a phone called the CX70 EMOTY , which can communicate emotions via MMS text messages, according to the company.

The phone has sensors on the side of the handset that interpret stroking, shaking and pressing to control the emotional expression of an animated character on the screen, which can then be sent to someone else.

The applications that researchers, designers and technology dreamers envision for emotion detection technology, whether it's friendlier GPS or automatic status updates, are largely irrelevant. What matters is the technology to detect emotion.

Once somebody builds a commercial smartphone that can figure out how you feel, any number of apps can be built to use that data.

Possible applications could include advice and suggestions from your phone to help you deal with your emotional state. For example, if your phone detected boredom, it could interrupt you with the latest Internet meme video. If you were feeling angry or worried or sad, it could display inspirational quotes or suggest some remedy, such as driving more carefully, going to a movie or suggesting "it might be better to not send that e-mail just now."

Most likely, however, your iPhone of the future will use your emotional state to subtly change how it interacts with you, making it more intuitive and appealing to use.

Emotional smartphones and other gadgets are going to change how we interact with machines. They'll know when you're happy and when you're sad, and will respond accordingly. How do you feel about that?

Mike Elgan writes about technology and tech culture. Contact and learn more about Mike at Elgan.com , or subscribe to his free e-mail newsletter, Mike's List .

Read more about emerging technologies in Computerworld's Emerging Technologies Topic Center.

Join the Good Gear Guide newsletter!

Error: Please check your email address.

Tags telecommunicationconsumer electronicsMobile and WirelessMobile Apps and ServicesEmerging Technologiessmartphoneshardware systemsPhonesmobileintel

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Mike Elgan

Computerworld (US)
Show Comments

Most Popular Reviews

Latest News Articles


PCW Evaluation Team

Azadeh Williams

HP OfficeJet Pro 8730

A smarter way to print for busy small business owners, combining speedy printing with scanning and copying, making it easier to produce high quality documents and images at a touch of a button.

Andrew Grant

HP OfficeJet Pro 8730

I've had a multifunction printer in the office going on 10 years now. It was a neat bit of kit back in the day -- print, copy, scan, fax -- when printing over WiFi felt a bit like magic. It’s seen better days though and an upgrade’s well overdue. This HP OfficeJet Pro 8730 looks like it ticks all the same boxes: print, copy, scan, and fax. (Really? Does anyone fax anything any more? I guess it's good to know the facility’s there, just in case.) Printing over WiFi is more-or- less standard these days.

Ed Dawson

HP OfficeJet Pro 8730

As a freelance writer who is always on the go, I like my technology to be both efficient and effective so I can do my job well. The HP OfficeJet Pro 8730 Inkjet Printer ticks all the boxes in terms of form factor, performance and user interface.

Michael Hargreaves

Windows 10 for Business / Dell XPS 13

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre x360

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga 910

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?