I got the following error when using a fine-tuned model from Vertex.
And the weirdest thing was that, sometimes the request succeeded.
rpc error: code = Invalid Argument desc = Request contains an invalid argument.
It also happens in the vertex AI studio.
It is very random but I see that some prompts cause more than others. Some prompts rarely return a prediction.
Hi @seungduk ,
The error rpc error: code = InvalidArgument is the gRPC version of an HTTP 400 Bad Request. It usually means your request format or content doesn’t match what the fine tuned model expects. Try the following steps:
Removing extra keys like “user_message” if not used during tuning
Using a simpler prompt
Ensuring your request matches the format used in training
Official reference:
Generative AI on Vertex AI inference API errors | Google Cloud
