At I/O 2024, Google gave us glimpses of the upcoming AI features likely to come in Android 15. With Google AI at the core of Android’s operating system, users can expect to interact with their devices in entirely new ways, harnessing the power of on-device AI for various tasks.
Circle to search rollout with new capabilities on more devices
One highlighted feature is Circle to Search, which enables users to search for anything they see on their phone using a simple gesture. This feature, already available on some devices, has been enhanced to aid students with homework. By circling a prompt they’re stuck on, students will receive step-by-step instructions to solve physics and math word problems directly from their phones or tablets. The feature will further expand its capabilities to tackle more complex issues later this year.
CHECK: Best Laptops Under 50000
Gemini AI assistant with contextual understanding
Gemini, the AI assistant integrated into Android, is also getting an upgrade. Gemini will better understand the context of what’s on the screen and what app the user is using. Users can bring up Gemini’s overlay on top of the current app to perform various tasks, such as dragging and dropping generated images into Gmail or tapping “Ask this video” to find specific information in a YouTube video. The update will roll out to hundreds of millions of devices over the next few months.
CHECK: Cars With Power Steering
Gemini Nano powered Accesbity features
For users with blindness or low vision, TalkBack, an accessibility feature, will receive clearer descriptions thanks to Gemini Nano’s multimodal capabilities. This update will provide more detailed descriptions of images encountered daily, helping to fill in the missing information.
ALSO READ: Google Photos To Get “Ask Photos” Feature Soon
Gemini Nano-powered scam detection
Android is testing a new feature to protect users from scams during phone calls. Powered by Gemini Nano, this feature provides real-time alerts if conversation patterns commonly associated with scams are detected. Users will receive alerts if a caller requests urgent fund transfers, payments with gift cards, or personal information like card PINs or passwords. Importantly, this protection happens on-device, ensuring privacy.
ALSO READ: Google I/0 2024: AI-Powered Scam Call Detection Arrives on Android Phones This Year
You can follow Smartprix on Twitter, Facebook, Instagram, and Google News. Visit smartprix.com for the latest tech and auto news, reviews, and guides.