If I follow someone I should be able to hitch onto their block list. That way, when we block someone, it does work for our followers and visa versa.
There could be certain accounts dedicated to certain block types/filters.
That would quickly eliminate almost all of the problem IMO.