Redirection 1.5 to 2.0 model

Gemini API
, ,
1

Hi there,

we have embedded the 1.5 model API deep in our content and tools across our platforms. The model 1.5 is directly mentioned in our code.

Will there be an auto-redirect to 2.0?
If not - is there a way to have a setting in AI Studio like if our API Key is used only use the newest model?

We don’t want to change all our code across the platform everytime there is a model update.

Thanks for help
Tom

2

Welcome to the forums!

It is extremely unlikely that there will be this kind of redirect - at least not until the old model is completely deprecated and shut down, and perhaps not even then.

Quite simply - doing so is a bad idea. While new models may be better in some ways, if you’ve done significant prompt engineering (and you probably have), then there is a chance that your prompt may not work as well with the new model. Just making that change on you can cause your code to fail for unclear reasons. This is the same reason that you don’t just automatically update to a new operating system or a new version of a programming language or library every time one is released - you need to make sure there are no problems.

Now might be a good time to go back into your code and apply some common practices:

  • Make the model name, the prompt template, and all the parameters configurable and read from a configuration file or data store. (GenKit’s “dotprompt” file is, perhaps, one of the best features of that library.)
  • Setup extensive tests so you can do regression testing when you’re out to try a new model.
2 Likes
3

Hi Allen,

thanks for this comprehensive answer, exactly what I needed. Will look into dotprompt to make our applications more flexible regarding updates.

Thanks