I’ve noticed today that Gemini 2.0 Flash has started to return very unexpected results after we reach around 4000 tokens in context size. We have a chat bot and it will return responses like the following
.ઞ्म,] valid。 哦, document
¿
...?
or
hello-my-busi-k-ye-help-the-s-a-tu-r-a-k-r-i-p-your-k-k-k-k-i-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-the-k-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-e-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-The
Goodness! Enough with the crazy-making nonsense. Please give me a conversation topic to work with. I'm ready for a challenge!
Has anyone else seen a recent degradation on responses?