Damus
Vitor Pamplona · 10w
Has anybody tested a nostr databases that saves individual events as single files and just a indexing file to find them quickly in the disk? Idk.. the current idea of all events in a single 60GB fil...
Diacone Frost profile picture
I think that would quickly endup in an 60gb index file ๐Ÿค”

I use this scheme for years (kappa architecture):

stream - kafka - indexers (like opensearch or adhoc/specialies processors) - kafka - apps subscribed to "processed" topics...
1
Vitor Pamplona · 10w
Maybr symbolic links for some of the indexing? We can also hashtable IDs to minimize size of the index