Google Releases Learning-Themed AI Mode Features for Search

Ahead of back-to-school season, Google has introduced new features for AI Mode in Search, aimed at enhancing learning and exploration.

Image and PDF Interactions

Users can now ask questions about images on desktop browsers, a capability previously available on Android and iOS devices. Support for PDF uploads on desktop will be added "in the coming weeks," allowing users to query detailed information from documents. For example, a user could upload psychology lecture slides and ask follow-up questions.

File Upload in AI Mode
[Click on image for larger view.] File Upload in AI Mode (source: Google).

AI Mode will analyze the file content and cross-reference it with web information to provide a response with linked sources. Image and PDF uploads on desktop are launching in the U.S. Future updates will include support for additional file types, such as those from Google Drive.

Canvas for Organization

The new Canvas feature in AI Mode assists with planning and organizing information. Users can create study plans or other projects, with AI Mode populating a dynamic side panel that updates with refinements. The upcoming upload feature will enable customization with context from files like class notes. Canvas projects can be revisited across sessions.

Canvas in AI Mode
[Click on image for larger view.] Canvas in AI Mode (source: Google).

This feature is also rolling out "in the coming weeks" to users in the AI Mode Labs experiment in the U.S., accessible via a "Create Canvas" option when planning is requested.

Real-time Assistance with Search Live

Search Live with video input is being introduced, incorporating capabilities from Project Astra. This feature allows users to engage in real-time, back-and-forth conversations with Search in AI Mode, utilizing live camera feed for visual context. It integrates with Google Lens.

Search Live with Video
[Click on image for larger view.] Search Live with Video (source: Google).

To use it, users open Lens in the Google app, tap the Live icon, and ask questions while pointing their camera. Search Live with video input is rolling out "this week" on mobile in the U.S. for users in the AI Mode Labs experiment.

Browse Integration with Lens in Chrome

Google Lens in Chrome and AI Mode will allow users to search and learn about content on their desktop screen, including websites and PDFs. Soon, clicking the Chrome address bar will present an option to "Ask Google about this page."

Lens in Chrome
[Click on image for larger view.] Lens in Chrome (source: Google).

Users can select a specific element, such as a diagram, to receive an AI Overview in the side panel. This week, users will be able to ask follow-up questions through AI Mode by selecting AI Mode at the top of Lens search results or via a "Dive deeper" button at the bottom of the AI Overview.

Back to School

A Google exec characterized the new features as being "just in time for the back-to-school season."

"Whether you're a student, a parent or an educator — or just wrapping up a busy summer — AI Mode can help you explore complex questions and discover high-quality information from across the web. To get started today on desktop, look for the new AI Mode button on the Google homepage," the company said in a blog post.

For more information, go to the Google site.

About the Author

David Ramel is an editor and writer at Converge 360.

Featured

  • Man offers stem word sign on virtual screen

    Immersive Workforce Development Initiative Connects Students with Real-World STEM Careers

    The Center of Science and Industry, a science museum and research center in Central Ohio, has launched The HIVE, a workforce development initiative designed to help students across the country explore real-world career pathways in aerospace, advanced manufacturing, engineering, and emerging technologies.

  • digital lock

    CoSN: Cybersecurity and Data Privacy Remain Top AI Concerns in Education

    A leading concern for education technology leaders across the United States is the potential for AI to enable new forms of cyber attacks, according to the latest State of Ed Tech report from CoSN.

  • broken digital lock and glowing chain

    Check Point Researchers: AI Has Crossed into the Live Attack Chain

    AI is moving beyond assisting cybercriminals and beginning to operate within live attacks, according to a recent report from Check Point Research. The technology is making sophisticated capabilities faster and more accessible while creating new security risks for businesses deploying their own AI systems.

  • circuit patterns

    Anthropic Intros Lower-Cost Claude Sonnet 5

    Anthropic has launched Claude Sonnet 5, positioning the model as its most autonomous mid-tier offering to date and a lower-cost alternative to its flagship Opus 4.8 system. The company said the model can plan multi-step tasks, operate tools such as browsers and terminals, and complete agentic work at a level that previously required larger and more expensive models.