Researchers hack Sony headset to simulate autism

The work is aimed at helping people understand what it's like to live with ASD

Japanese researchers want to show people what it's like to have autism by using an augmented reality headset that distorts imagery of people nearby. The researchers mounted a forward-facing Wi-Fi webcam on a Sony HMZ-T3W headset, which is designed for watching movies and covers the eyes with two screens.

Japanese researchers want to show people what it's like to have autism by using an augmented reality headset that distorts imagery of people nearby. The researchers mounted a forward-facing Wi-Fi webcam on a Sony HMZ-T3W headset, which is designed for watching movies and covers the eyes with two screens.

Japanese researchers want to show people what it's like to have autism by using a headset that distorts imagery of people nearby.

The researchers from Osaka University and the University of Tokyo mounted a forward-facing Wi-Fi webcam on a Sony HMZ-T3W headset, which is designed for watching movies and covers the eyes with two screens.

The webcam's video is relayed to the screens, but when the simulation's image-processing program is activated, the faces of people become washed out and fuzzy, making their expressions impossible to see.

White dots like swirling snow also appear on the screens in response to loud noise, distorting the high-contrast image. Earphones linked to a microphone in the webcam also relay a distorted audio signal.

The effect is aimed at simulating the vision and hearing of people with autism spectrum disorder (ASD), who can experience sensory overload and deficit. They can also struggle to understand the emotional states of others.

Based on augmented reality techniques, the image processing is done in a separate computer that receives the webcam's signal by Wi-Fi and then wirelessly transmits the altered image to the Sony headset.

The researchers published a paper on the concept of the autism headset at a conference of the Institute of Electrical and Electronics Engineers (IEEE) last year.

"We hypothesize that (people without autism) experiencing an artificial ASD perceptual system would have the same difficulty with environment recognition and taking action," the researchers wrote.

They are planning to publish more detailed papers of the experimental device, said Yukie Nagai, an associate professor at Osaka University's Emergent Robotics Lab.

The work follows a prototype video game developed in 2013 called Auti-Sim that presented the player with a distorted playground and loud screams. The developers, however, did not claim to present a scientifically accurate portrayal of autism.

Tim Hornyak covers Japan and emerging technologies for The IDG News Service. Follow Tim on Twitter at @robotopia.

Join the Good Gear Guide newsletter!

Error: Please check your email address.

Tags popular scienceconsumer electronicsOsaka UniversityUniversity of Tokyosony

Our Back to Business guide highlights the best products for you to boost your productivity at home, on the road, at the office, or in the classroom.

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Tim Hornyak

IDG News Service
Show Comments

Essentials

Lexar® JumpDrive® S57 USB 3.0 flash drive

Learn more >

Microsoft L5V-00027 Sculpt Ergonomic Keyboard Desktop

Learn more >

Mobile

Lexar® JumpDrive® S45 USB 3.0 flash drive 

Learn more >

Exec

HD Pan/Tilt Wi-Fi Camera with Night Vision NC450

Learn more >

Audio-Technica ATH-ANC70 Noise Cancelling Headphones

Learn more >

Lexar® JumpDrive® C20c USB Type-C flash drive 

Learn more >

Lexar® Professional 1800x microSDHC™/microSDXC™ UHS-II cards 

Learn more >

Budget

Back To Business Guide

Click for more ›

Most Popular Reviews

Latest News Articles

Resources

GGG Evaluation Team

Michael Hargreaves

Windows 10 for Business / Dell XPS

I’d happily recommend this touchscreen laptop and Windows 10 as a great way to get serious work done at a desk or on the road.

Aysha Strobbe

Windows 10 / HP Spectre

Ultimately, I think the Windows 10 environment is excellent for me as it caters for so many different uses. The inclusion of the Xbox app is also great for when you need some downtime too!

Mark Escubio

Windows 10 / Lenovo Yoga

For me, the Xbox Play Anywhere is a great new feature as it allows you to play your current Xbox games with higher resolutions and better graphics without forking out extra cash for another copy. Although available titles are still scarce, but I’m sure it will grow in time.

Kathy Cassidy

STYLISTIC Q702

First impression on unpacking the Q702 test unit was the solid feel and clean, minimalist styling.

Anthony Grifoni

STYLISTIC Q572

For work use, Microsoft Word and Excel programs pre-installed on the device are adequate for preparing short documents.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?