I'll be honest, I'm not totally sure. Newer blocks are going to be heavier, just because they have more transactions in them.

I was thinking about this some more and it's definitely a bandwidth limitation because if I synchronize over the clear net it goes much much faster so clearly compute is not the bottleneck it's bandwidth.