I ran an experiment on the private models using Cline. This time I ran exactly the same queries through GLM-5-1. Once to the regular model, once to the TEE model. Performance in the TEEs just doesn't match that of the regular model. It kept getting stuck repeating the query again and again.
If I use the TEE models in the web app they're find, but through and IDE like Cline I can't get them to perform.
Perhaps a Cline issue, dunno?
I'd really like to connect to a private model through a harness.
Any suggestions?
Thanks