You have to trust the cryptographic rules. You can't trivially count the coins.

You are right though, it's sloppy to say "cannot audit", but it points towards a significant tradeoff that Monero accepts.