We are also seeing the same error while using 2.5 flash. Randomly but very frequently, the output is cut-off in the middle. What’s weird is that, we are using structured output with function call on langchain, and the json output is complete(we can parse it, the braces are balanced and complete etc. etc.) but the response we are aiming to receive, located on a key of the json, is truncated mid-sentence. We have also implemented a recheck mechanism to re-generate if this occurs, but after the detection, when we re-generate it, it again truncates in approximately the same part. The output tokens are around 2k, input is around 12k and thinking is around 1k, so it is not a max token issue. The finish reason is “STOP”. Is there a planned update or a proposed solution by google for this? This is a very breaking condition for our system!
We have exactly the same issue.
The value of a key is abruptly cut. The JSON itself is intact, hence never gets detected in any validations that are based on the JSON schema.