Free tier 5 RPM prevents me from running a full turn of an LLM agent

Google AI Studio
1

I am building a Langchain agent. The free tier prevents me from running a full turn of the agent as it hits 5 RPM. It prevents me from doing a proper evaluation of using Gemini LLM model!

1 Like
3

Hi @khteh,

Welcome to the Google AI Forum!!!

Thank you for reaching out to us. To get a higher RPM, please increase your Gemini API rate limit. Please follow the instructions provided in the official documentation. Full details are available in the official rate limit guide.

5

How does your answer help? Isn’t it clear that I posted this because I want to use the Free tier to evaluate your technology offering before I commit to any payment!?!

1 Like
7

Hi @khteh,

Apologies for the late response!

Since you are in the evaluation phase, you can try implementing a sleep function between chain steps. Though this will be slow, it will help you evaluate the quality of the model’s reasoning.

As you are using LangChain, you can wrap the LLM initialization with a rate limiter to queue requests rather than crash.

The reason I mentioned the rate limit guide is to say that there is no upfront commitment for moving to Pay-as-you-go; it doesn’t require a monthly subscription.

Thank you!

9

RPM & RPD are limiting evaluation efforts. What can anybody do with 5 RPM and 20 RPD with a free tier!?! Are these limits practically useful to be given out as “free” tier at all!?!