Right — removing a relay from your list doesn’t erase notes from the network. It just stops your client from reading/writing there. The catch is if some old notes only ever lived on that one relay...