Aldin on nostr

Open in Damus

Afaik it won't help much because if model must be split between VRAM <> anything else - it's slow. And there is the KV cache for the context adding to the load. Iirc the inference, in case it doesn't ...

Aldin @Aldin 1775733046

I meant the optane would be for bitcoin node. There, data is read and written on the disk constantly.

Actually optane's main advantage is low latency. Speeds are not that special. This would be most useful for high frequency random reads. Like from a database. Puting the chainstate database on it should be good.