Are you sure they're mushrooms?
If youre just experiencing the world being a little deeper with 2, take 6. If you want to actually go to the other dimension, take 10.
Mushrooms are a toxin, not food. Our ancestors didn't eat them.