I submitted an entry into the Gemini Developer competition that uses gemini-1.5-pro-preview-0514, specifically its function calling capabilities.
I just opened it up to show a friend of mine, and the code broke. Upon back tracing the issue, I found that Google had updated the model to fix a problem with required fields not being properly checked. Unfortunately, this caused a previously harmless bug in my program to become catastrophic.
My question is, will the version of the API at the time of submission be used to test my program, or the new version?
If the latter is the case, is there a way I can push a one-line patch? I realize I am using an experimental feature, which is subject to change. That said, I really wanted to show off what I was able to do with Google Gemini, and it feels bad that a change (a good one, but nonetheless) on Google’s side prevents this.
Same situation here. I can’t believe the amount of time I spent on my submission and sleepless nights could potentially be wasted for nothing :(.
In my case I was using the gemini-1.5-flash model and everything was working as expected (function calling), then it stopped working with internal error 500, I tried to change to gemini-1.5-pro and it worked as it should so I submitted my project, today I’m checking my app and I can see “Function calling mode ANY
is not enabled for api version v1beta”.
I think the video Demo and what you capture in it about your app is the most important thing in this competition. That’s what gets your foot into the door.
I agree, these tools that Google created are so new that I suspect (or rather hope) they won’t be so harsh on submissions, especially if you are using brand new features.
My submission uses Context Caching, but whether it works at all plus the latency can vary from day to day, even with the exact same code and cached content. To be clear, it mostly works, but I have noticed great variation, through hundreds of hours of testing.
So, I assume if a model update broke your submission, you should be OK.
As I’ve said before and confirmed by Google as well, judges will not be judging based on testing your apps unless your video was shortlisted to be a winner of any category. In that case, they will be asking you for access to test it if it’s not a live product already.