Gandalf is like five bajillion years old. If it doesn't happen in his time then it just doesn't happen. Gandalf is just greedy tbh. First he gets to live forever, and then he wishes that life could AL...
I always read that "so do I" to mean that he wishes Frodo hadn't had to live through it all, not Gandalf himself.
1