nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpq5fkerqqyp9mlh7n8xd6d5k9s27etuvaarvnp2vqed83dw9c603pq6alvck
Nah, just get a used Mac M2 max with lots of ram and storage.
@nprofile1q... the current high end models have a realistic floor of about 400 GB of vram to be usable. that's with heavy quantization and a small context window
1