Bench · Claude models · October 3, 2026

Which Claude should answer the phone?

Holly thinks with your own Claude. So we timed every model and effort on one spoken turn: how soon it starts talking, and whether it gets a simple sum right.

to the first word for Opus 5.5 at low effort, right on the time sum times
right for Sonnet 5.5 on the same sum, at any effort, about as fast
to start a fresh session before the first reply, so Holly starts one as soon as a call starts

Speed and accuracy

Typical of 10 fresh sessions each. The first word is when Holly could start speaking. The time sum: "a meeting at 2:45 pm that runs 95 minutes, then a 25 minute drive. What time do I get home?" (4:45 pm).

Start-up is a new session's first reply, counted from starting it. Cost is one warm turn at Anthropic's API prices; on a Claude subscription it comes out of your usage instead. "Thinking off" uses Claude Code's switch, MAX_THINKING_TOKENS=0.

Without tools, and the thinking switch

A second run an hour later, 9 or 10 sessions each: the same turns with no tools loaded (talk only), and Claude Code's thinking switch on Sonnet. Its own with-tools row is the fair comparison, because times drift between runs.

Context is what each turn sends: Claude Code's instructions, the tester's own settings and the tool definitions. Output tokens include any thinking, which is billed as output even when it isn't shown.

Every reply

Pick a model and effort, then a question, to read every answer exactly as written, with their times.

What we learned

How we tested

What this test can't tell you

From this test, Holly's calls now use Opus 5.5 at low effort.