I am migrating a project from Gemini API to Vertex AI. When using Gemini API I’d set the top_k in generation_config to 64. However when I try the same generation with Vertex AI, it throws this error: { "error": { "code": 400, "message": "Unable to submit request because it has a topK va…

Inconsistant Top K limit in Gemini API and Vertex AI

innovatix February 15, 2025, 2:17pm 3

A previous discussion confirms that vertex has a maximum top_k limit of 41:

However, this limit is not mentioned in the official documentation:

Topic		Replies	Views
Is someone tell me what is topK and why it's accouring Gemini API api	2	286	October 29, 2024
Rate Limit Increase Gemini API gemini	4	179	June 6, 2025
Vertex Error in multiple GC Projects Gemini API gemini-15 , vertexai	2	167	March 26, 2025
Which Gemini API Models Support top_k Sampling? Gemini API api	1	126	March 5, 2025
400 Invalid argument while using candidate_count>2 and long json in the prompt Gemini API prompt	2	347	February 28, 2025