I think the frontier models are actually just a couple servers racks in a back room and it’s not a grandiose as they are making it out to be.
The reasons the models are so good is because they train them on vast amount of artificial data; it’s not real and it has a shelf life. The window for ...