Google expands AI Mode with 4 major features including video support

Google is expanding its AI Mode with four major features, including video capabilities for Search Live, a new Canvas planning tool, PDF upload support, and integration with Google Lens on desktop Chrome. These updates position Google’s AI search experience as a more comprehensive workspace for research, planning, and document analysis, directly competing with ChatGPT’s similar features.

What you should know: AI Mode will soon support file uploads beyond just text and images, allowing users to upload PDFs and ask detailed questions about documents.
• Uploaded files will be analyzed and cross-referenced with relevant web information, rolling out to stable in the coming weeks.
• Support for additional file types, including Google Drive integration, is planned for the future.
• The PDF upload feature joins existing image upload capabilities already available on mobile.

The Canvas feature: Google is introducing a dynamic side panel called Canvas that helps users build plans and organize information across multiple sessions.
• Users can create study guides, trip plans, and other organized content by asking AI Mode and tapping the “Create Canvas” button.
• The feature allows follow-up questions and edits by highlighting specific portions of generated text.
• Canvas will integrate with the new upload feature, enabling users to customize their creations with context from personal files like class notes or course syllabi.

Video capabilities expanding: Search Live is gaining video input functionality, allowing users to show AI Mode what they’re seeing in real-world situations.
• The feature launches from the redesigned Google Lens interface with a new “Live” tab alongside existing “Search” and “Translate” options.
• Google is rolling out Search Live with video this week to testers in the US on Android and iOS devices.
• This builds on the voice input feature that launched last month.

Desktop integration: AI Mode is coming to Google Lens in desktop Chrome browsers through a new address bar integration.
• Clicking the Chrome address bar will display an “Ask Google about this page” chip.
• Users can select portions of web pages, with AI Overview results appearing in a side panel.
• A “Dive deeper” AI Mode button will appear at the bottom for extended analysis.

Availability timeline: Most features are rolling out in phases to users enrolled in Google’s AI Mode Labs experiment.
• Canvas will be available in the coming weeks on desktop web in the US for Labs participants.
• Video Search Live is launching this week for US testers on mobile platforms.
• The desktop Chrome integration timeline wasn’t specified in the announcement.