Still 503 UNAVAILABLE. {'error': {'code': 503, 'message': 'The model is overloaded. Please try again later.', 'status': 'UNAVAILABLE'

,
503 UNAVAILABLE. {‘error’: {‘code’: 503, ‘message’: ‘The model is overloaded. Please try again later.’, ‘status’: ‘UNAVAILABLE’

This error has been reported all around this forum, and is still happening don’t matter free or paid tier, even though not even hitting the limits. Is the team working on it? Seems it has been a recurring problem since 2024 and now my prod application is just UNUSABLE! Said we should implement a retry, I’ve done, but how is it helpful if 95% of calls fails to 503??? Thanks.

2 Likes

Hey Anthony,

Did you find any fix? I have switched to 2.0 and it has not failed yet.

Thanks

Hi @Anthony_Kewin
Could you please tell us the specific model you were calling when these 503 errors were returned? Recommended step is to briefly switch to a different model as 503 errors are typically temporary. If the error continues over time, please provide your region so we can escalate the issue.
Thanks