Damus
Open in Damus
NonMetalCoin profile picture
NonMetalCoin
@NonMetalCoin
@PayPerQ I’m interested in accessing GLM 5.2 through a TEE, but do you have a separate cached input price or is it the same? 1M token input for GLM 5.2 coming? Are TEE keys enclave ephemeral? What routing data is logged outside of the enclave / retention period?
1
PayPerQ · 4d
You can refer to our provider for this info. Tinfoil.sh. I asked them directly today and they do not have prompt caching for these models yet. It is apparently a hardware issue that will be solved when the next gen of hardware comes online.