Google Debuts Troll-Fighting AI Tool to Moderate Online Comments

Image Credit: Google Jigsaw.

Trolls are commonplace online, with close to a third of American internet users witnessing harassment online and nearly half personally experiencing it. To help combat internet trolls, Google’s technology incubator Jigsaw and Counter Abuse Technology Team last Friday launched Perspective, “an early-stage technology that uses machine learning to help identify toxic comments,” according to the blog post announcement.

Perspective works by reviewing comments and scoring them based on how similar they are to comments that are typically considered negative or “toxic,” the blog post explained. “To learn how to spot potentially toxic language, Perspective examined hundreds of thousands of comments that had been labeled by human reviewers. Each time Perspective finds new examples of potentially toxic comments, or is provided with corrections from users, it can get better at scoring future comments.”

Available through an API, Perspective is intended for members of the Digital News Initiative and other publishers and platforms. The New York Times, The Economist and more news organizations have already tested Perspective for their comment sections and found that it has significantly reduced labor-intensive work for staff, who have to sort through tens of thousands of comments each day.

Ultimately, however, publishers can decide what to do with the API, Google’s Conversation AI product manager told Wired. The tool could easily be adopted for higher education and K–12 district websites, social media pages and anywhere else comment sections exist, as a way to prevent online harassment and cyberbullying. Google said in the post that it hopes the tool will help improve conversations online.

Perspective is available in the TensorFlow open source library and Google’s Cloud Machine Learning Platform. It is in the early stages of research and development and interested developers can request API access.

To learn more, visit the Google blog.

About the Author

Sri Ravipati is Web producer for THE Journal and Campus Technology. She can be reached at [email protected].

Featured

  • hand touching glowing connected dots

    Registration Now Open for Tech Tactics in Education: Thriving in the Age of AI

    Tech Tactics in Education has officially opened registration for its May 7 virtual conference on "Thriving in the Age of AI." The annual event, brought to you by the producers of Campus Technology and THE Journal, offers hands-on learning and interactive discussions on the most critical technology issues and practices across K–12 and higher education.

  • teenager interacts with a chatbot on a computer screen

    Character.AI Rolls Out New Parental Insights Feature Amid Safety Concerns

    Chatbot platform Character.AI has introduced a new Parental Insights feature aimed at giving parents a window into their children's activity on the platform. The feature allows users under 18 to share a weekly report of their chatbot interactions directly with a parent's e-mail address.

  • laptop screen displaying a typed essay, on a child

    McGraw Hill Acquires Essaypop Digital Learning Tool

    Education company McGraw Hill has announced the acquisition of Essaypop, a cloud-based writing tool that will enhance the former's portfolio of personalized learning capabilities.

  • a professional worker in business casual attire interacting with a large screen displaying a generative AI interface in a modern office

    Study Finds Generative AI Could Inhibit Critical Thinking

    A new study on how knowledge workers engage in critical thinking found that workers with higher confidence in generative AI technology tend to employ less critical thinking to AI-generated outputs than workers with higher confidence in personal skills.