It's clearer when you view having bitcoins as "possessing" it rather than "owning" it.

You possess the private keys. Someone else can possess them too, at the same time.