API rate limits don’t reset.
We are tier 3 and use Gemini in production. We have spikes in traffic and sometimes we get close or at maximum TPM/RPM. TPMs remain locked at maximum level for days and weeks without any reset. By definition, TPM quota should reset every minute. Same problem with RPM and RPD. Once we’ve hit a certain level they remain locket at that level and we get 429 status code for following requests, even though we have days that passed since the TPM/RPM limit.
How do you expect the API to be used since 429 are actually preventing the usage of the API?
3 Likes
Agreed completely. My TPM has been maxed out since yesterday and still has not reset. I keep seeing things online that it resets at midnight PT but it didn’t reset then either.
2 Likes