For context, I have been trying to use Gemini’s logprobs for almost a year now for different important projects. TLDR: It is very, very inconsistent. They will allow access sometimes. Then, it only works with Vertex AI. Then, it works with the standard gemini api. But wait, the package updates and the API usage is completely different. Then, there was a brief period of peace these past few months where it would work on both VertexAI and GenAI apis. Now, we are back to square one as far as I can see
….
Would appreciate if anyone has a solution that works.