The Notebook · the week
The week of 2 November 2026
One idea · 2 November 2026 to 8 November 2026
-
Monday · 2 November 2026
llm upgrade testing: the new model passed the old tests
I am wary of model upgrades that pass the old eval suite. That suite was written against the old model's mistakes. Each case exists because something once broke.