I don’t understand what’s so bad about a quantum computer eventually being able to grave rob old addresses.

Such is life. Those that have their keys will upgrade their wallets, and people will have incentives to build quantum computers to grave rob abandoned ones.