Damus
iefan ๐Ÿ•Š๏ธ profile picture
iefan ๐Ÿ•Š๏ธ
@iefan ๐Ÿ•Š๏ธ
Lol, did the open-source community accidentally just fix the LLM hallucination problem? ๐Ÿ˜ณ

Context:
It seems like the Shrek entropy sampler with early exit solves, if not significantly reduces, the hallucination problem with big boy models. Some people are running evaluations now, and so far, it seems promising. ๐Ÿ‘€
8โค๏ธ2๐Ÿ‘€2๐Ÿ’œ2โค๏ธ1๐Ÿค™1
jb55 · 71w
> Shrek entropy sampler https://i.nostr.build/XTMmUeKPPRdDy2Vc.jpg
Guy Swann · 71w
Can you share a link or expand on this? What does the entropy sampler do here?
BootyDust · 71w
What's the Shrek entropy sampler? Is this related to your earlier note? @nostr:nevent1qqsq72y32j707ugtgu26h77marmzrsu0t6dtfpw500q6j49fp3hzckgppemhxue69uhkummn9ekx7mp0qgsvdac80utfn4gvly4fv54la0l6cp0udpptnm3ezzyajkdc44w53lgrqsqqqqqpm0mux9
The Bitruvian Man · 71w
OSS for the win ๐Ÿ˜ƒ Turns out that people working on things they find interesting is pretty cool ๐Ÿ˜Ž