Skip to main content
Add as a preferred source on Google


Google Debuts Troll-Fighting AI Tool to Moderate Online Comments

Image Credit: Google Jigsaw.

Trolls are commonplace online, with close to a third of American internet users witnessing harassment online and nearly half personally experiencing it. To help combat internet trolls, Google’s technology incubator Jigsaw and Counter Abuse Technology Team last Friday launched Perspective, “an early-stage technology that uses machine learning to help identify toxic comments,” according to the blog post announcement.

Perspective works by reviewing comments and scoring them based on how similar they are to comments that are typically considered negative or “toxic,” the blog post explained. “To learn how to spot potentially toxic language, Perspective examined hundreds of thousands of comments that had been labeled by human reviewers. Each time Perspective finds new examples of potentially toxic comments, or is provided with corrections from users, it can get better at scoring future comments.”

Available through an API, Perspective is intended for members of the Digital News Initiative and other publishers and platforms. The New York Times, The Economist and more news organizations have already tested Perspective for their comment sections and found that it has significantly reduced labor-intensive work for staff, who have to sort through tens of thousands of comments each day.

Ultimately, however, publishers can decide what to do with the API, Google’s Conversation AI product manager told Wired. The tool could easily be adopted for higher education and K–12 district websites, social media pages and anywhere else comment sections exist, as a way to prevent online harassment and cyberbullying. Google said in the post that it hopes the tool will help improve conversations online.

Perspective is available in the TensorFlow open source library and Google’s Cloud Machine Learning Platform. It is in the early stages of research and development and interested developers can request API access.

To learn more, visit the Google blog.

About the Author

Sri Ravipati is Web producer for THE Journal and Campus Technology. She can be reached at [email protected].

Featured

  • child stands with a laptop, in front of various drawings related to math and science

    Why Screen Time Limits Are Not the Answer

    At a fundamental level, screen time policies and laws aim to address academic achievement by balancing digital instruction with traditional teaching methods. But they do not tackle how devices are used.

  • Digital document and folder warning alert with error

    When Cyber Attacks Disrupt Learning, Recovery Matters More than Ever

    As schools become more dependent on digital platforms for instruction, grading, student services, and family communication, resilience depends not only on preventing attacks, but on how quickly leaders can restore trusted data, recover essential services, and keep disruptions from cascading across the school community.

  • Blurred silhouettes of business people in a modern office with a glowing blue network overlay

    Open Secure AI Alliance Moving Under Linux Foundation

    Governance of the Open Secure AI Alliance has moved to the Linux Foundation, giving the initiative what the organizations describe as a neutral home for developing open source tools, shared standards and defensive practices. The Alliance was launched by NVIDIA in July to develop open security technologies for AI systems and agents.

  • education funding and graduation symbols on wooden dice

    What Is the Education Freedom Tax Credit and How Will It Work?

    The federal Education Freedom Tax Credit (EFTC) is a new source of funding for education that could benefit 90% of students in states that have opted in to the program. However, some confusion and misconceptions exist surrounding details of the program, including which programs may qualify, how parents can apply for scholarships, and how public school students can benefit.