With drivechains, miners vote to allow coins to move to and from a sidechain, same people you trust to produce blocks and run the network. There's no small federation like liquid, it's all the miners just like regular mining. If you can't trust miners to be honest/economically rational, the whole Bitcoin model falls apart anyways.