Samsung unveiled its latest flagship phone, the Galaxy S24, at its Unpacked event on January 17th. The star of the show was Google’s new Circle to Search feature, enabled by advanced AI, which allows users to search for anything by simply circling it with their finger. This has the potential to revolutionize how we search and interact with our devices.
Circle to Search Leverages Google’s Powerful AI Models
Circle to Search utilizes Google’s most advanced AI models yet, Gemini and Imagen, to analyze visual information and generate informative overviews instantly. Users can circle any object or text through the viewfinder in the camera app or on any image to get started (The Verge). The AI will then provide contextual information, relevant web results, and useful functionality.
For example, circling an appliance could show manuals or tutorials, while circling a poster may prompt movie showtimes nearby. The AI even handles complex scenes with multiple objects. This works for foreign languages and translates text detected in images in real-time too (FOX 5 DC).
The Galaxy S24 and Pixel 8 will be the first phones capable of Circle to Search when it rolls out with an update later this year. It will also come to older Pixel devices, while availability on other Android phones remains to be seen (Engadget).
Intuitive Gesture-Based Interface Prioritizes Relevance
A key benefit of Circle to Search is that it allows users to precisely indicate what they want to search for. The AI generates tailored results for the circled item itself, not just the entire scene. This prevents getting overwhelmed with irrelevant information in busy environments (Android Authority).
The gesture is intuitive and user testing shows that people find it fun too. Circling objects comes naturally and feels more personal than typing queries according to Google (CNN). Results load almost instantly as well.
Users can still run standard text or voice searches alongside Circle to Search for maximum flexibility. Switching between modes is seamless thanks to AI underpinning everything behind the scenes (Medium).
| Search Method | Description | Use Cases |
|---|---|---|
| Circle to Search | Circle any object or text with finger to search | Identifying objects, translations, nearby services, product information |
| Text Search | Type text queries as normal | Researching topics, browsing the web |
| Voice Search | Speak queries out loud | Hands-free searching when typing isn’t practical |
Table 1 – Comparison of Galaxy S24 search methods enabled by Google’s AI
All-New Multisearch Experience via Google Lens
In addition to Circle to Search, Google announced Multisearch capabilities coming to Lens imaging recognition. Users can combine images with text prompts for extremely precise searches.
For example, snapping a photo of a shirt and asking “Where can I buy this in a size medium?” will surface retailers carrying that exact product in the desired size. This works across fashion, furniture, appliances, and more according to Google (FoneArena).
Lens uses AI to analyze attributes and details imperceptible to humans, delivering superior accuracy. Errors are far less likely than typing manually as the computer vision handles the hard parts automatically (Business Today).
Power users can even search multiple images simultaneously with a single text query. This tackles highly complex informational needs not possible previously.
Privacy & Security Remain Paramount
As AI capabilities grow more advanced, so do concerns around data privacy and security. Google states that all processing happens securely on users’ devices for Circle to Search and Lens Multisearch functions. Images and interactions never get saved or sent to Google’s servers (TechCrunch).
Independent security experts will thoroughly audit the software too. Google maintains a vulnerability rewards program paying researchers who discover flaws in its platforms (Reuters).
Users ultimately have control over what images they share with the AI. Erasing the circled area or captured photos instantly cancels any processing or tracking.
The Future of Mobile Search
Circle to Search marks a paradigm shift in mobile search technology. No longer limited by typing or speech, users can now query the world’s information simply by pointing AI-powered cameras at it. This enables search to break free from apps and web pages for the first time.
Upcoming hands-free improvements to Lens combined with augmented reality integration will only increase functionality going forward. Over time, searching could disappear as a distinct action altogether. Relevant knowledge may eventually surface automatically based on environmental context (Search Engine Land).
For now, the Galaxy S24 stands poised to deliver a taste of that future with Circle to Search later this year. If well received, the feature could expand across Android’s substantial market share rapidly. While availability on iOS remains uncertain due to Apple’s restrictions, iPhone users may find themselves hoping for access to some of AI’s latest wonders.
To err is human, but AI does it too. Whilst factual data is used in the production of these articles, the content is written entirely by AI. Double check any facts you intend to rely on with another source.
