Larger blocks require more processing power and storage. The more processing power required, the more money and resources are required, thereby creating a centralizing effect, thereby making it easier for a cabal to take control of the network and change it's operation or parameters.