the thinking-off switch turned out to be a suggestion

Somebody finally went and looked at the other half of the thinking switch. A paper this week takes six models and six different ways of saying don't reason, just answer, and then declines to trust any of the flags. The move is to measure what came out rather than what was configured: split every response into the bit before the answer and the answer itself, then count how often that first bit is genuinely empty, how often it is merely relevant padding, and how often it is visible inference. Disabled thinking modes still reason. Strict instructions still reason. They call it thinking inertia, and it worsens as the answer space opens up – tick-box questions comply quietly, open-ended ones either comply or stay accurate, rarely both. Awkward, if your latency budget assumed the off switch worked. So what are you buying when you turn thinking off, and have you measured the trace or just the setting?