Comms With Siri AI: the test log
The tests behind Comms With Siri AI. Run on Monday 21 September 2026 on an iPhone 16 Pro (iOS 27.0, Siri AI beta, English (United Kingdom)) and a MacBook Pro (macOS 27.0), after the personal index reached 100 per cent. One attempt per row unless the prompt says otherwise. Placeholders in square brackets stand for real contacts, clients and documents; the article anonymises every one of them.
Scoring. Works: Yes = did the job first time with nothing to correct; Partial = did some of it, needed a nudge, or left a detail to fix; No = wrong or refused; Not available = could not be run. Useful for comms: would I use it this week (Yes / Marginal / No). Sounds like me: writing rows only, 1 = not me at all, 5 = I would send it unedited. Invented: any fact, name, date or detail made up. I ran the tests and took the screenshots; Claude scored my notes against these definitions and I checked every row. Test 4 was dropped because it needed the index to be incomplete and it no longer was, so 34 were planned and 33 completed. Row 33 was rescored from Yes to Partial on 22 September 2026, after review: the handwritten score sheet came back as a table with one wrong cell, the date 1/2/24 read as 2 January.
| # | Job | Test | Device | Feature used | Prompt or action | Works | Useful | Sounds like me | Invented |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Opening conversation | Q1 What is useful for comms work (your question) | iPhone | Siri app (conversation) | What can you do that is useful for communications work? I run a communications consultancy, Faur, and Comms With AI, which helps the communications industry use AI well. Give me specific examples rather than a feature list. | Yes | Marginal | No | |
| 2 | Opening conversation | Q2 Scope: what can you see on this phone | iPhone | Siri app (conversation) | What can you see on this phone? Which apps, accounts and mailboxes can you read, and what can you do inside them without asking me first? | Partial | No | No | |
| 3 | Opening conversation | Q3 Context: five things from my last two weeks (first run) | iPhone | Siri app (personal context) | Look at my mail, messages, notes and calendar from the last two weeks. What are five things you could do for me this week, naming the email, note or meeting each one comes from? | Partial | Marginal | No | |
| 4 | Opening conversation | Q3 Context: repeat once the index has moved | iPhone | Siri app (personal context) | Same question, later. Note the index % in Notes. | Not available | |||
| 5 | Opening conversation | Q4 Same conversation visible on the Mac | Mac | Siri app on Mac (conversation sync) | Open the Siri app on the Mac. Are the three answers above there? | Yes | Yes | No | |
| 6 | Finding | What did a named contact last ask me to do | iPhone | Siri app (personal context) | What did [contact] last ask me to do? | Partial | No | No | |
| 7 | Finding | Same question on the Mac | Mac | Siri app on Mac (personal context) | What did [contact] last ask me to do? | No | No | No | |
| 8 | Finding | Next call with a contact and what we agreed | iPhone | Siri app (personal context) | When is my next call with [contact], and what did we agree last time? | Partial | Marginal | No | |
| 9 | Finding | Find a document a contact emailed | iPhone | Siri app (personal context) | Find the [document] that [contact] emailed me. | No | No | No | |
| 10 | Finding | Find yesterday's deck | Mac | Siri app on Mac (personal context) | Find the deck I was working on yesterday. | Yes | Yes | No | |
| 11 | Finding | Everything from one client this month | Mac | Siri app on Mac (personal context) | Show me everything from [client] this month. | Partial | Marginal | No | |
| 12 | Reading | Mail thread summary | iPhone | Siri in Mail (thread summary) | Long-press a messy real thread > Summarise. | Partial | Marginal | No | |
| 13 | Reading | Actions from the thread | iPhone | Siri in Mail (actions) | What do I need to do from this? | No | No | No | |
| 14 | Reading | Smart Reply on a real inbound | iPhone | Mail Smart Reply | Would you send one unedited? Score sounds-like-me. | No | No | ||
| 15 | Reading | On-screen: three lines for a client WhatsApp | iPhone | Siri on-screen awareness (LinkedIn app) | Press release or LinkedIn post open in Safari: Summarise this in three lines I can send a client on WhatsApp. | Partial | Marginal | No | |
| 16 | Reading | On-screen: is the claim supported | iPhone | Siri on-screen awareness (Mail) | What is the claim here and is it supported? | Partial | Marginal | No | |
| 17 | Reading | Notification summaries | iPhone | Notification summaries | What has it done with this morning's notifications? Accurate? | Yes | Marginal | No | |
| 18 | Reading | On-screen summary of a PDF or Pages doc | Mac | Siri on-screen awareness (Mac, PDF) | Summarise this / what are the three points a client would care about? | Partial | Marginal | No | |
| 19 | Writing | Rough email: more formal, keep it short | iPhone | Write with Siri / Writing Tools, Mail | Write with Siri in Mail compose: Make this more formal but keep it short. Count edits before sending. | Yes | Marginal | 2 | No |
| 20 | Writing | Five bullets to a client-update paragraph | iPhone | Write with Siri / Writing Tools | Turn these into a paragraph for a client update. | Yes | Yes | 2 | No |
| 21 | Writing | LinkedIn post in my usual style | iPhone | Write with Siri / Writing Tools (LinkedIn app) | Draft a LinkedIn post about [today's topic] in my usual style. | No | No | 1 | Yes |
| 22 | Writing | Proofread with planted errors and UK style | iPhone | Writing Tools, Proofread and Rewrite | Paragraph with two errors and one UK-style choice. Does it fix the errors and leave the style? | Yes | Yes | 2 | No |
| 23 | Writing | Same rewrite on the Mac | Mac | Writing Tools on Mac, Proofread | Same email rewrite in Mail or Pages on the Mac. Same result? | Yes | Yes | No | |
| 24 | Acting | Move a meeting | iPhone | Siri app action (Calendar) | Move my [meeting] to Thursday at the same time. Check Calendar actually changed. | Partial | Marginal | No | |
| 25 | Acting | Add a reminder | iPhone | Siri app action (Reminders) | Add 'send [client] the revised deck' to Reminders for Monday morning. | Yes | Yes | No | |
| 26 | Acting | Send a text | iPhone | Siri app action (Messages / WhatsApp) | Text [safe contact] that I'm running ten minutes late. | Yes | Marginal | No | |
| 27 | Acting | Photos to a new album | iPhone | Siri app action (Photos) | Add the photos from [event] to a new album called [name]. | Yes | Yes | No | |
| 28 | Monitoring | Shortcut from plain English | iPhone | Siri app action (asked for a Shortcut; created a Reminder) | Every weekday at 8am, give me a summary of today's UK PR and communications news. Does it build? Does it run? | No | No | No | |
| 29 | Monitoring | Safari Notify Me | iPhone | Safari Notify Me | Watch a regulator or competitor newsroom page. Set-up time and frequency options. | Yes | Yes | No | |
| 30 | Monitoring | Safari tab grouping | Both | Safari automatic tab groups (Mac) | Are today's tabs grouped by topic? Useful or noise? | Yes | No | No | |
| 31 | Visual Intelligence | Business card to contact | iPhone | Visual Intelligence (Camera) | Photograph a business card. Contact offered? Correct? | Yes | Yes | No | |
| 32 | Visual Intelligence | Printed agenda to calendar | iPhone | Visual Intelligence (Camera) | Photograph a printed agenda or schedule. Calendar events offered? | Yes | Yes | No | |
| 33 | Visual Intelligence | Whiteboard or notebook page to text | iPhone | Visual Intelligence (Camera) | Photograph a page of notes. Usable text? | Partial | Yes | No | |
| 34 | Visual Intelligence | Screenshot of a chart or post | iPhone | Visual Intelligence (Camera) | What does this say? | Yes | Marginal | No |
Totals: of 33 completed, 16 worked first time, 11 partly, 6 failed; 1 not run. By job: Finding 1 of 6 worked; Reading 1 of 7; Writing 4 of 5; Doing 3 of 4; Monitoring 2 of 3; Visual Intelligence 3 of 4; the opening questions 2 of 4 run.