nostr:npub16g4umvwj2pduqc8kt2rv6heq2vhvtulyrsr2a20d4suldwnkl4hquekv4h I’m interested in accessing GLM 5.2 through a TEE, but do you have a separate cached input price or is it the same? 1M token in...
You can refer to our provider for this info. Tinfoil.sh. I asked them directly today and they do not have prompt caching for these models yet. It is apparently a hardware issue that will be solved when the next gen of hardware comes online.
❤️1