Tried it. Decent for training and server applications. Memory bandwidth is a major constraint though. Don’t expect anything more than 50-60tk/s tops
50-60 for whatparameter models? Even for slightly smaller ones?
1❤️1