Hi,
I’ve recently run into a very odd problem when using the gemini 2.5 flash lite model.
After detecting the tool call and the necessary parameters for it, I send it back the response
and in return it generates an empty string.
This happens only with some tools more than others, and it is consistently reproducible
for specific inputs.
I’ve tried both the OpenAI SDK and the Vertex AI one and the result is the same.
Notably, none of this happens for the gemini 2.5 flash model, but I need the low latency
of the lite variant, so I’m trying to get to the bottom of this.
Any ideas on why this could happen or what we could try investigating?
Thank you,
Danut