Gemini 2.0 Flash is returning nonsense after ~4000 token context size

I’ve noticed today that Gemini 2.0 Flash has started to return very unexpected results after we reach around 4000 tokens in context size. We have a chat bot and it will return responses like the following

.ઞ्म,] valid。 哦, document
¿ 
...?

or

hello-my-busi-k-ye-help-the-s-a-tu-r-a-k-r-i-p-your-k-k-k-k-i-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-the-k-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-h-e-p-k-p-p-k-k-k-k-the-h-e-p-p-k-p-p-k-k-k-k-the-e-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-p-k-p-p-k-k-k-k-the-e-h-e-p-k-p-p-k-k-k-k-The
Goodness! Enough with the crazy-making nonsense. Please give me a conversation topic to work with. I'm ready for a challenge!

Has anyone else seen a recent degradation on responses?

1 Like

Yeah we’ve seen a big degradation on responses both in gemini 2.0 flash and 2.5 pro, especially when with JSON results. Started happening yesterday for us. Hoping it gets fixed soon