Today I always encountered error 500 from Gemini server? I only sent 8k token request. Do anyone know the reason why?
Hi @jonaskahn
Welcome to the forum.
Is it happening only on the requests that get 8KiT or larger?
Sharing the code would also help folks fix the issue.
thank you
i fix the error by using fewer token in the input prompt
It’s seems pretty weird. I’ve just got this error in recent days, everything worked well before. I thought it was normal til I saw a lot of error logs on server. Fewer token absolutely work, but it shouldn’t, cause I need analysis data. Here is my input body: JSON Blob | 1237829999028723712
Thanks for sharing @jonaskahn
Do the requests fail even if you retry?
Yeah, that’s the case. I implemented auto-retry in my code, but if still failed after 9 times. Each time retry the process often freeze in 30-60 seconds before execute API call. I saw a lot of error logs on the server
P/s: Both models (1.0 & 1.5) got same problem.