Output/Input tokens - model gemini-1.5-flash-001

Gemini API
,
1

We are having a problem with our Agent in Dialog flow.

We are using the gemini-1.5-flash-001 model, and as we can see in the documentation, the token output limit is 8192, and this limit is always exceeded, resulting in the agent not responding.

We wanted to know if there is a way to increase this limit or another way to get around this problem.

Ps.: In the agent builder we can increase the token output limit, but in the dialog flow we cannot.

1 Like
2

There is a way to increase output token limit using Prompt Chaining and Iterative Generation. Please check the cookbook link provided here. Link

1 Like