Routstr confidential mode, protocol v3, is live on routstr.cypherpunk.today.

Confidential mode lets a Routstr node sell you LLM inference without seeing your prompt or the answer, and without giving you its provider API key. Your device is the TLS client of the provider. The node only relays encrypted records and writes its key into one record. The two sides compute the TLS keys together, and zero-knowledge proofs keep both of them honest. No trusted hardware.

What's new in v3:

- One handshake, many requests. Over HTTP/2 the node writes its API key once, into the provider's header table, and every later request refers to it by index. The expensive two-party setup now happens once per connection instead of once per request. On a kept connection a message needs about 15 kB from the node and starts streaming in about a second.
- A smaller key schedule: 16 MB to set up a connection instead of 22 MB.
- HTTP/1.1 is still there. Node operators list what their provider supports, clients fall back, and you can switch HTTP/2 off.
- Fairer money: a small deposit per connection, released with your first answer. The session fee is paid once per connection, and each request is reserved and settled on its own, from the provider's own usage report.
- Images work in the same connection as chat.

Try it in the browser: https://jooray.github.io/routstr-confidential-pwa/

Want to test it, run routstrd with it, build on the JS library, or run your own confidential node? The testing guide covers all of it:
https://jooray.github.io/routstr-confidential-pwa/testing/

It is experimental and the new cryptography has not been externally reviewed yet, so test with small amounts. Bug reports welcome.

Also, please run your agents and try to break it. You can be part of the future of private, decentralized inference markets. Break it, please.

Paper and spec: https://github.com/jooray/routstr-confidential

@routstr

Routstr is decentralized inference. Routstr-confidential goes further: it is multiparty computation, where the routing node and the endpoint act simultaneously as clients of the TLS connection to the backend provider.

Through various tricks, they ensure that each party only sees what it needs to. The routing node sees the API key, parameters (model, maximum output), and billing. The client sees the model, maximum output, billing, the prompt, and the response, but not the API key.

Both parties verify this against the TLS certificate and cooperate with each other.

In practice: you can buy inference from a reseller without them seeing your prompts and responses, and without them being able to cheat you by selling you a different model.

https://github.com/jooray/routstr-confidential/

Routstr je decentralizovaná inferencia. Routstr-confidential ide ďalej: je to multiparty computation, kde sú klientmi TLS spojenia na backend providera, routing nodu aj endpoint súčasne.

Rôznymi trikmi riešia, aby každý videl len to, čo musí. Routovacia noda vidí API kľúč, parametre (model, maximálny output) a zúčtovanie. Klient vidí model, maximálny output, zúčtovanie, prompt a odpoveď, ale nie API kľúč.

Obe strany to overujú voči TLS certifikátu a spolu kooperujú.

Prakticky: môžeš si kupovať inferenciu u prepredajcu bez toho, aby videl tvoje prompty a odpovede, a bez toho, aby ťa mohol oklamať a predať ti iný model.

https://github.com/jooray/routstr-confidential/

The uncensored models are from China

Let that thought flow in your mind for a moment...

Calle is kind of a decentralized spiritual leader of the cypherpunks. Leading by showing the way. Always a pleasure to listen and great inspiration.

https://fountain.fm/episode/1Q17yntZitfbLF4Fm2vx

Yes, the Lambo bros are louder.

But there are currently more cypherpunks, more hacktivists and a lot more code, good code.

We have country wide decentralized networks built on MeshCore. We have ecash, zero knowledge proofs deployed at scale, we have GrapheneOS, usable Linux desktop distributions, anonymization networks.

There has never been a better time to live the cypherpunk dream than now.

Because. Cypherpunk future (that we all wanted) is now.

People, masses of people, are just loud. That's what always happens. But that's a feature of history, it doesn't go in one direction, there are subsets that do their thing and they thrive.

And we do thrive now, more than ever.

"🎶...and don't search for freedom in the fucking states...🎶"

https://www.youtube.com/watch?v=37JtkmslLEI

If you use GN ReSound hearing aids and don't like the official app, I made one that I think is better. Especially better use of the buttons. I can now interact with my agents, record notes, transcribe on device. Everything is either happening on my phone (running @GrapheneOS ) or is sent end-to-end encrypted through Marmot to my agent.

But even if you are not using agents, at least for me, my app is better. It can pause podcast/music with a button, etc.

Available through Obtainium or @Zapstore - free and open-source.

This is a predecesor to @Third Ear – the voice recorder for the space age - which has features for other users, but does not allow "do not touch phone" control, because I don't know of standard way to handle the buttons. And "I hear you" can change all the hearing aid settings. So I use both.

https://jooray.github.io/i-hear-you/