Google AI program masters classic Atari video games

By remembering and learning, the DeepMind algorithm excels at retro games such as Breakout

In this screenshot of a Google DeepMind artificial intelligence program playing the Atari game Breakout, the program has learned to create a tunnel through the wall of blocks and send a ball through it to destroy more blocks, improving its score.

In this screenshot of a Google DeepMind artificial intelligence program playing the Atari game Breakout, the program has learned to create a tunnel through the wall of blocks and send a ball through it to destroy more blocks, improving its score.

Scientists at Google have produced an artificial intelligence program that can ace classic Atari video games.

The Deep Q-network (DQN) developed at London-based AI firm DeepMind, which was acquired by Google last year, can teach itself to play Atari 2600 video games using only the score and the pixel display as input information.

In a study published in the journal Nature, Demis Hassabis and other Google DeepMind collaborators said the program was able to surpass the performance of previous algorithms on most of the 49 games it tested on. It was also able to match the skill of a professional human games tester.

The program did not know the rules beforehand and was armed only with the motivation to maximize its score and the ability to learn from previous gaming sessions. It was able to excel at games including Video Pinball and Breakout, through the use of an algorithm that aims to imitate aspects of human thinking and learning.

The scientists used an approach known as reinforcement learning, which involves offering rewards as motivation for an AI system to learn. They combined that with a kind of artificial neural network, called a deep neural network, which makes use of various computational layers to represent increasingly abstract representations of data.

The team focused on a biologically inspired architecture known as a deep convolutional network, an approach similar to that taken by University of Maryland scientists who have been getting robots to teach themselves to cook by watching videos on YouTube.

The DQN algorithm did well on a variety of games, including side-scrolling shooter games, boxing matches and 3D car racing. It was also able to achieve more than 75 percent of the human score in 29 of the 49 games.

More significantly, however, it was able to learn strategy over many sessions. After 600 sessions playing Breakout, it learned the winning strategy of tunneling behind a wall of bricks that the player must destroy. It repeatedly sent the ball into the tunnel so it bounced around, destroying many bricks.

It's not the first time algorithms have been trained to play video games with minimal input, and DQN fared poorly on games such as Montezuma's Revenge, which requires a long-term planning strategy.

But the researchers said a single architecture has been shown to be able to learn and adapt when faced with various gaming challenges. They view it as another step in building effective, general-purpose AI programs.

"Taken together, our work illustrates the power of harnessing state-of-the-art machine learning techniques with biologically inspired mechanisms to create agents that are capable of learning to master a diverse array of challenging tasks," the authors wrote.

Tim Hornyak covers Japan and emerging technologies for The IDG News Service. Follow Tim on Twitter at @robotopia.

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags popular scienceGooglegamesDeepMindinternetsearch engines

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Tim Hornyak

IDG News Service
Show Comments

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?