Hello everyone,
I am currently facing an issue where the “logprobs” feature does not seem to work with the latest Gemini models (such as Gemini 3.1 Pro and Gemini 3.6 Flash). I have tested this across both the Vertex AI API and the Google AI Studio API, but the log probabilities are not being returned.
For context, this feature works perfectly when I use older models, such as Gemini 2.5 Flash. I am aware of the original blog post announcing logprobs on Vertex AI and have seen some discussions about it being disabled in previous versions, but there is no clear conclusion regarding the newest models.
Could anyone from google clarify the current status? Specifically:
-
Is this a known bug that the engineering team is currently working on?
-
Or is this a strategic/intentional decision to disable logprobs for newer models?
-
And most importantly: Should we expect this feature to be re-enabled and supported in future model releases or in currently released models?
I am happy for any information on this. Thank you a lot!