I’m having an issue using gemini flash 1.5 through apis, it is providing a response in my local system, but when I’m pushing the code to our vps, it is not at all responding, we are currently using Django + react and also utilizing wsgi (synchronous) application. Every single time I’m not getting a response from my backend after some time I’m getting 504 gateway time out error. What may be the issue
The output tokens from the model may be crossing the default token size, it can be one of the issues. Also RPM(requests for minute) for flash are 15 so do checkout how many times you are requesting. Here is the Gemini-1.5-flash card. Also check for response timeout setup for your app, if the response is taking much longer than expected you may get timeout error from you DJANGO application.
Thanks!