Google Debuts Troll-Fighting AI Tool to Moderate Online Comments

Image Credit: Google Jigsaw.

Trolls are commonplace online, with close to a third of American internet users witnessing harassment online and nearly half personally experiencing it. To help combat internet trolls, Google’s technology incubator Jigsaw and Counter Abuse Technology Team last Friday launched Perspective, “an early-stage technology that uses machine learning to help identify toxic comments,” according to the blog post announcement.

Perspective works by reviewing comments and scoring them based on how similar they are to comments that are typically considered negative or “toxic,” the blog post explained. “To learn how to spot potentially toxic language, Perspective examined hundreds of thousands of comments that had been labeled by human reviewers. Each time Perspective finds new examples of potentially toxic comments, or is provided with corrections from users, it can get better at scoring future comments.”

Available through an API, Perspective is intended for members of the Digital News Initiative and other publishers and platforms. The New York Times, The Economist and more news organizations have already tested Perspective for their comment sections and found that it has significantly reduced labor-intensive work for staff, who have to sort through tens of thousands of comments each day.

Ultimately, however, publishers can decide what to do with the API, Google’s Conversation AI product manager told Wired. The tool could easily be adopted for higher education and K–12 district websites, social media pages and anywhere else comment sections exist, as a way to prevent online harassment and cyberbullying. Google said in the post that it hopes the tool will help improve conversations online.

Perspective is available in the TensorFlow open source library and Google’s Cloud Machine Learning Platform. It is in the early stages of research and development and interested developers can request API access.

To learn more, visit the Google blog.

About the Author

Sri Ravipati is Web producer for THE Journal and Campus Technology. She can be reached at [email protected].

Featured

  • Abstract AI circuit board pattern

    Nonprofit LawZero to Work Toward Safer, Truthful AI

    Turing Award-winning AI researcher Yoshua Bengio has launched LawZero, a nonprofit aimed at developing AI systems that prioritize safety and truthfulness over autonomy.

  • abstract pattern of cybersecurity, ai and cloud imagery

    Report Identifies Malicious Use of AI in Cloud-Based Cyber Threats

    A recent report from OpenAI identifies the misuse of artificial intelligence in cybercrime, social engineering, and influence operations, particularly those targeting or operating through cloud infrastructure. In "Disrupting Malicious Uses of AI: June 2025," the company outlines how threat actors are weaponizing large language models for malicious ends — and how OpenAI is pushing back.

  • tutor and student working together at a laptop

    You've Paid for Tutoring. Here's How to Make Sure It Works.

    As districts and states nationwide invest in tutoring, it remains one of the best tools in our educational toolkit, yielding positive impacts on student learning at scale. But to maximize return on investment, both financially and academically, we must focus on improving implementation.

  • red brick school building with a large yellow "AI" sign above its main entrance

    New National Academy for AI Instruction to Provide Free AI Training for Educators

    In an effort to "transform how artificial intelligence is taught and integrated into classrooms across the United States," the American Federation of Teachers (AFT), in partnership with Microsoft, OpenAI, Anthropic, and the United Federation of Teachers, is launching the National Academy for AI Instruction, a $23 million initiative that will provide access to free AI training and curriculum for all AFT members, beginning with K-12 educators.