Not even that, acschually.
A private key is but a very big number.
Can you own numbers like you own a bicycle?
Exactly.
If you have something that no one can take from you, you own it.