A few years ago I asked the devs to run the benchmark on how much better (if at all) outbox is over using large relays. No one took up this question, so I started running benchmarks.

A few learnings for me:
1. Outbox is proven better than using large relays
2. Three relays is the optimum for each npub
3. Three year old notes have an incredibly low survival rate, and are barely findable by the best outbox implementations (~~20%)
4. There are half a dozen algos not yet implemented by any nostr app to my knowledge that are superior to current algos for finding year old notes
5. No nostr app has implemented nip-66 relay liveness checks in outbox implementations to my knowledge
6. It could be measurement or methodology error - the relay/note indexer performs worse than outbox and large relays
7. There are poor performing outbox implementations

Cc @balas @KernelKind @fiatjaf