Damus
Open in Damus
Alan Siefert profile picture
Alan Siefert
@Alan Siefert
npub17fnqdce37y5ryhkfnnfc0qhdhmqnff0ez84fltd84h8ze2gptvtqd9j4zsnpub
[email protected]lnurl
Relays (8)
  • wss://nos.lol/ – read & write
  • wss://nostr.bitcoiner.social/ – read & write
  • wss://nostr.mutinywallet.com/ – read & write
  • wss://nostr.wine/ – read
  • wss://relay.mostr.pub/ – read & write
  • wss://relay.nostr.band/ – read & write
  • wss://relay.snort.social/ – read & write
  • wss://xmr.usenostr.org/ – read & write

Recent Notes

BitcoinconManolito · 2w
You can try mid size qwen 3.5 28b, for instance. But it will be useless unless you own over 50GB of vram. Let alone larger 80b models. I'm sure llm training technology will improve overtime, using fea...
 Alan Siefert profile picture
Alan Siefert @Alan Siefert
I’ve seen evidence that unified memory computers like Apple Studio and AMD Strix Halo can be clustered with RDMA over Ethernet to achieve usable tokens per second, like ~15 t/s with fairly large models. Of course these clusters are not cheap for most consumers especially at today’s hardware prices. I think once “the bubble pops” we will see a lot more interesting developments for locally hosting larger LLMs, like decommissioned servers ending up on eBay and just generally lower hardware costs for DIY AI clusters.
G Force G · 2w
Plebs need to try and buy very powerful GPUs and then we can train our own models. Or maybe the stuff tether is coming out with will allow plebs to distribute GPU. We need to learn to make our own models. Or LORAs for specific tasks.
Hazey · 2w
They do
RecoveringSelfTorturer · 2w
The chinese are sitting on an economic nuke in this regard. Steal our models (or wait until they accidentally leak themselves) release forks open source, rinse, repeat. Uppercut us right in the bubble
Neigsendoig Cocules · 2w
People will fight this, so it'll already fail. Oh wait, not if the Jesuits had anything to say about it.
Ľḭṿḙśƫṟãɖãṁṹṧ💫#RunCoreV30 · 6w
Iranians have already won, a great deal for the world. The world’s population knows clearly who is the terrorist and how to hurt them. This is only the beginning.
Hazey · 7w
Holy crap even the CPU hardware is open source
Alan Siefert profile picture
I’m considering familiarizing with git.idk.i2p since we’re probably going to need an anonymous GitHub in California. Unrestricted 3D printer firmware and Linux without ID verification are couple types of software about to become illegal to share here. 3DP gun files are already illegal to share.
1❤️1
Troy · 7w
Jurisdiction
Enki · 7w
Kinda. Ive been messing with it.