Google's new AI aims to end abusive online comments using 'Perspective'

The service is a collaboration between the tech giant and an incubator at its parent company

The internet is a tough place to have a conversation. Abuse has driven celebrities and ordinary folks from social media platforms that are ill-equipped to deal with it, and some publishers have switched off comment sections.

That’s why Google and Jigsaw (an early stage incubator at Google parent company Alphabet) are working on a project called Perspective. It uses artificial intelligence to try to identify toxic comments, with an aim of reducing them. The Perspective API released Thursday will provide developers with a score of how likely users are to perceive a comment as toxic.

In turn, that score could be used to develop features like automatic post filtering or to provide users with feedback about what they're writing before they submit it for publication. Starting on Thursday, developers can request access to Perspective's API for use in projects they're working on, and Jigsaw will approve them on a rolling basis.

Many publishers have been unwilling or unable to spend the time aggressively moderating comments on their articles and have instead opted to shut them down entirely and cede the discussion to social media platforms. The New York Times, which helped with the development of Perspective, opens comments on roughly 10 percent of its articles because of the effort needed to manually moderate them.

Google also has a vested interest in better filtering abuse. Its YouTube comment sections can get filled with vitriol, leaving online video creators to add moderation duties to their already-long list of responsibilities. Using Perspective's API to do the filtering could help alleviate that burden.

Perspective's interpretation of comments is imperfect, at best. A series of profane statements intended to forcefully express approval got flagged as likely to be toxic. The system marketed "This is some kick-ass music right here" as 85 percent similar to comments other people said were toxic, for example.

Jigsaw, for its part, acknowledges the potential problems. Perspective's website gives users a way to test out comments and provide feedback about whether or not they're toxic. The implication there is that the team will take in that feedback to help with further iterations on the abuse recognition technology.

"It's still early days and we will get a lot of things wrong," the company said on its website.

Right now, Perspective is only available in English, though it does seem to contextually understand some toxic comments in other languages. Jigsaw is taking applications from developers working in a wide variety of languages and will use that feedback to inform what Perspective will be compatible with in the future.

In addition, Jigsaw said that it plans to release additional Perspective APIs that perform other functions.

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags AIGoogle

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Blair Hanley Frank

IDG News Service
Show Comments

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Matthew Stivala

HP OfficeJet 250 Mobile Printer

The HP OfficeJet 250 Mobile Printer is a great device that fits perfectly into my fast paced and mobile lifestyle. My first impression of the printer itself was how incredibly compact and sleek the device was.

Featured Content

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?