Damus
iefan ๐Ÿ•Š๏ธ profile picture
iefan ๐Ÿ•Š๏ธ
@iefan ๐Ÿ•Š๏ธ
Lol, did the open-source community accidentally just fix the LLM hallucination problem? ๐Ÿ˜ณ

Context:
It seems like the Shrek entropy sampler with early exit solves, if not significantly reduces, the hallucination problem with big boy models. Some people are running evaluations now, and so far, it seems promising. ๐Ÿ‘€
2
Guy Swann · 71w
Can you share a link or expand on this? What does the entropy sampler do here?
BootyDust · 71w
What's the Shrek entropy sampler? Is this related to your earlier note? @nostr:nevent1qqsq72y32j707ugtgu26h77marmzrsu0t6dtfpw500q6j49fp3hzckgppemhxue69uhkummn9ekx7mp0qgsvdac80utfn4gvly4fv54la0l6cp0udpptnm3ezzyajkdc44w53lgrqsqqqqqpm0mux9