I encounter frequently error 500 from "An internal error has occurred" with 8k input tokens

,

Today I always encountered error 500 from Gemini server? I only sent 8k token request. Do anyone know the reason why?

Hi @jonaskahn

Welcome to the forum.

Is it happening only on the requests that get 8KiT or larger?

Sharing the code would also help folks fix the issue.

1 Like

thank you
i fix the error by using fewer token in the input prompt

It’s seems pretty weird. I’ve just got this error in recent days, everything worked well before. I thought it was normal til I saw a lot of error logs on server. Fewer token absolutely work, but it shouldn’t, cause I need analysis data. Here is my input body: JSON Blob | 1237829999028723712

Thanks for sharing @jonaskahn

Do the requests fail even if you retry?

Yeah, that’s the case. I implemented auto-retry in my code, but if still failed after 9 times. Each time retry the process often freeze in 30-60 seconds before execute API call. I saw a lot of error logs on the server :expressionless:
P/s: Both models (1.0 & 1.5) got same problem.