I developed an app with Nano Banana Pro API served via the Vertex AI API but the service is so unreliable that my app is unusable.
Yesterday images were being generated at lightening fast speeds and today its a constant resource exhausted error. I understand the feature is in preview mode but can we justify this level of instability?
INFO:backoff:Backing off _attempt_image_generation(…) for 0.5s (google.genai.errors.ClientError: 429 RESOURCE_EXHAUSTED. {‘error’: {‘code’: 429, ‘message’: ‘Resource exhausted. Please try again later. Please refer to Error code 429 | Generative AI on Vertex AI | Google Cloud Documentation for more details.’, ‘status’: ‘RESOURCE_EXHAUSTED’}})
Can someone from Vertex AI please add some TPU’s for improving the inference service? Slow is fine but throwing 429 errors is making it impossible to serve my users.
INFO:backoff:Backing off _attempt_image_generation(…) for 0.5s (google.genai.errors.ClientError: 429 RESOURCE_EXHAUSTED. {‘error’: {‘code’: 429, ‘message’: ‘Resource exhausted. Please try again later. Please refer to Error code 429 | Generative AI on Vertex AI | Google Cloud Documentation for more details.’, ‘status’: ‘RESOURCE_EXHAUSTED’}})
File “/code/.venv/lib/python3.11/site-packages/google/genai/errors.py”, line 131, in raise_error
raise ClientError(status_code, response_json, response)
google.genai.errors.ClientError: 429 RESOURCE_EXHAUSTED. {‘error’: {‘code’: 429, ‘message’: ‘Resource exhausted. Please try again later. Please refer to Error code 429 | Generative AI on Vertex AI | Google Cloud Documentation for more details.’, ‘status’: ‘RESOURCE_EXHAUSTED’}}
I made a simple switch to Gemini API and these issues no longer appear.
os.environ[“GOOGLE_GENAI_USE_VERTEXAI”] = “False”
which makes it clear that the issue is with Vertex AI API and probably resources allocated to these models on this path.
My quotas for these services are also within limits. The usage was extremely sparse and such errors should not have been encountered.
Hi @DataSiens_AI , We apologize for the inconvenience. Could you please provide the project number (not the project ID) via direct message if you have not yet done so?
@DataSiens_AI, Click on my Profile Picture or Username, a small pop-up will appear. Then, click the Message button and share your project number there. I’ve attached a screenshot for your reference.
Hi @DataSiens_AI , We truly appreciate you flagging this issue and apologize for the issues. We have escalated this issue to our internal team for further investigation.
