Yes that is my point. It is true that miners only follow consensus, they don't create it, but their behaviour is the only objectively observable thing.
The moment you find yourself on a chain that isn't the absolute heaviest with a large margin, you better go check what's going on, software can't ...