Damus
Open in Damus
David Chisnall (*Now with 50% more sarcasm!*) · 10w
I really like the Pentium 4 as an analogy here. The NetBurst architecture in the P4 was designed to be able to scale to 10 GHz. It initially shipped in the 1-2 GHz range. The performance was not th...
 wraptile profile picture
wraptile @wraptile
@nprofile1q... I think people were aware that transistor size will be a limiting factor in this example, so the limit was well known. Also this is physical limitation not a software one, LLMs are mostly just information (compression/code).
1
David Chisnall (*Now with 50% more sarcasm!*) · 10w
nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpq5nw5evkeefrzezpznfp28sx7rzyhhdc0gam6rfwhrqjq5qcdrehstvax0t As I said, transistor size was not a limiting factor and it has continued to shrink in line with the projections at the time the P4 was introduced.