why does nobody talk about the fact that google's gemini models have a 2M context window but they ALWAYS go into a lobotomized death loop after 20%?
I've never reached 30% without it turning into a s...
even at 20% thats about 400k tokens? Maybe just too much noise for the probability machine. drowns out the signal.