Yes, I think so, but I'm not a mining expert. I see two issues.
1. If most of the pools engage in censorship (Ignore fees) that would end decentralization. This is technically possible, but economically unlikely. Ocean attempted to solve this, but they have been slow to gain adoption so far for various reasons.
2. Causing a fork or frequently orphaning blocks by ignoring certain transactions. This would require a ton of hash rate to really matter, but it could cause a ton of confusion.