Siri AI gets real-world tests: Apple's revamped assistant shows promise but faces accuracy issues

Reviewed byNidhi Govil

11 Sources

Share

Tech journalists spent a week testing Siri AI in the iOS 27 developer beta, revealing a voice assistant that's finally conversational and hyper-personalized. The new Siri AI leverages Google Gemini and on-device data to deliver contextual responses, but early reviews highlight persistent accuracy problems and limitations in third-party app integration that keep it behind competitors.

Apple's Revamped Siri Gets Its First Real-World Test

Multiple tech journalists have spent the past week putting Siri AI through extensive real-world testing, and the verdict is cautiously optimistic. Apple's revamped voice assistant, unveiled at WWDC and now available through a waitlist in the iOS 27 developer beta, represents a significant departure from the limited assistant iPhone users have tolerated for years

1

. The new Siri AI is conversational, hyper-personalized based on on-device data from messages and photos, and integrated directly into the iPhone search bar

1

.

Google Gemini now powers the underlying model for Apple Intelligence, enabling Siri to deliver more contextually relevant responses rather than simply serving up website links

1

. When WIRED tested Siri AI as a travel guide around San Francisco, the voice assistant provided succinct recommendations and bolded key words for easy scanning. Users can now swipe down on answers to ask follow-up questions, and all conversations are stored in a dedicated Siri app for later review

1

.

Source: Geeky Gadgets

Source: Geeky Gadgets

Conversational Capabilities Show Clear Improvement

The AI-powered Siri finally enables actual back-and-forth conversations, addressing one of the biggest complaints about the old assistant that offered no room for clarifying questions

3

. Joanna Stern's hands-on review demonstrated impressive contextual awareness when she asked Siri to suggest souvenirs for her kids based on what it knew about them. The assistant pulled information from her Messages app to deliver a "dead-on" personalized response

4

.

Source: 9to5Mac

Source: 9to5Mac

In another scenario, Siri AI accessed Stern's calendar, Messages, and even voicemail to provide informed suggestions about what she could work on that day

4

. This hyper-personalization showcases Apple's unique advantage: access to a wealth of on-device data through Private Cloud Compute, which the company claims doesn't store user information and only accesses it when Siri is queried

1

.

Accuracy Issues and Spotlight Search Complaints

Despite improvements, hands-on reviews reveal persistent accuracy problems. ZDNET conducted a 10-round test on Mac and found the new Siri AI gave incorrect or inaccurate answers to several queries

2

. When WIRED showed Siri a photo of a foggy path, the assistant correctly identified Monterey cypress trees but referenced a Cypress Tree Tunnel an hour away from the actual location, potentially confusing users unfamiliar with the area

1

.

A more controversial change involves Spotlight search functionality. The Register's hands-on review criticized Apple for transforming Spotlight into a "Siri-first interface" that presumes users want AI-generated responses rather than traditional search results

3

. Getting to a web search from Spotlight now requires multiple taps instead of the previous swipe-type-tap workflow, with the experience resembling Google's AI Overviews that push actual search results down the page

3

.

Source: ZDNet

Source: ZDNet

Task Automation Lags Behind Competitors

Tom's Guide's hands-on review highlighted a critical gap: task automation remains restricted to native apps. While Google Gemini can handle complex cross-app tasks like ordering coffee through DoorDash with a single voice command, Siri AI failed to deliver similar functionality

5

. The assistant also couldn't execute photo editing requests like changing backgrounds or generating infographics from PDFs—tasks that Gemini handles routinely

5

.

On-screen contextual awareness shows promise, with Siri AI suggesting reminders in Messages and creating calendar events from emails

5

. However, it often requires manual input for details that an advanced AI should handle automatically. The updated Camera app combines Visual Intelligence with Siri AI to identify objects, but lacks the fluid conversational experience of Gemini Live or Meta AI

5

.

Device Compatibility and Availability

Siri AI in iOS 27 requires specific hardware. Every iPhone 16 and iPhone 17 model will run the new assistant, along with iPhone 15 Pro and Pro Max, but older models won't support it

1

. Only the iPhone Air, iPhone 17 Pro, and iPhone 17 Max will access all features, including varied voice options

1

. Access requires joining a waitlist through Settings, and the system needs over a week to fully index device data for personalization

1

3

.

Apple plans to roll out Siri AI to the public later this year, likely in September

2

. Users who aren't interested can disable the assistant in settings

1

. The AI integration stems from Apple's partnership with Google and leadership changes, including hiring Amar Subramanya, former head of Gemini engineering at Google, as VP of AI

3

. While this first developer beta shows promise, Apple has several months to address accuracy issues and improve third-party app integration before the public launch.

Today's Top Stories

© 2026 TheOutpost.AI All rights reserved