I was searching about Context Catching support in Batch API, Does Batch API support Implicit and Explicit Context Catching
Hii @Gauravmahto
Welcome to the AI Forum!!!
Yes, The Gemini API does support implicit caching and explicit caching, but there are important limitations when using the Batch API.
Kindly please refer to this Batch API, Context caching documents for more information.
Is it applicable for Vertex AI Batch API, If yes, Is Implicit and Explicit Context Catching both supported, Can’t find details about it anywhere
Hi @Gauravmahto
Vertex AI partially supports context caching in batch prediction mode. Implicit caching works, but explicit caching is not available for batch jobs.
For more information, please refer to the Context Caching Overview.