Why is there a “rate limit” in Ai studio? Also, why can’t i filter out saftey settings in GEMINI? Add this feature for creative writing content! Thanks
Rate limits are a common feature in server based applications accessible over the internet. A classroom of teenagers can otherwise crash the server farm by flooding it with scripted nonsense requests, just as a prank. They are there to make the service more available for all of us. In your code, you can safely classify the 429 HTTP response (‘congestion’) as retry-able, with exponential backoff. Personally, I have 500 as retry-able as well.
Hope that helps.
1 Like