Zuckerberg's "The Future is for Everyone" published today (
https://www.meta.com/thefutureisforeveryone/), gets one big thing right and leaves one thing out.
Right: there is no singular benevolent superintelligence, and no alignment technology can encode everyone's opposing values at once. Safety, if it comes, comes from balance of power; competing agents checking each other. That is institution-thinking, and it is rarer in AI discourse than it should be.
Missing: every balance of power in history has rested on something none of the powers owned. Agents that cannot read each other's minds can only check each other against a shared record.
Commitments that cannot be quietly edited, claims that can be verified without trusting the claimant.
His own thought experiment gives it away: a superintelligent lawyer for everyone presupposes a neutral court. Billions of competing agents presuppose a ledger that belongs to none of them.
That layer already exists. It has run for seventeen years, was built by none of the present players, and grows harder to corrupt as its participants grow more intelligent.
A balance of power needs a book no power can rewrite and the book is already open.
https://nullius2140.github.io/the-last-scarce-good/