Get two dgx sparks and you can run it fully locally and nearly as fast as the cloud API when using dspark speculative decoding
The current ds flash (0731) actually beats even ds pro!
yeah, i have been looking at those things. not gonna happen until i get a proper gig