Gemini 1.5 Pro and 1.5 Flash GA, 1.5 Flash tuning support, higher rate limits, and more API updates

Hey all! We are excited to share:

  • Gemini 1.5 Flash and 1.5 Pro are now GA
  • Gemini 1.5 Flash now has a 1,000 RPM limit
  • Gemini 1.5 Flash tuning announced
  • JSON Schema mode is now available in the API
  • AI Studio Mobile support + light mode are live

Read more in our launch blog post: Gemini 1.5 Pro and 1.5 Flash GA, 1.5 Flash tuning support, higher rate limits, and more API updates - Google Developers Blog

17 Likes

This is fantastic, Logan. Congrats to the team!

With billing enabled, any word when weā€™ll be able to see quota usage?

3 Likes

The free version of Gemini Pro 1.5 has a really low rate limit.

4 Likes

I know. The 1.5 Pro limits are painful. Especially to someone who uses Google AI Studio purely for leisure and not businessā€¦

2 Likes

Yes, the rate limit is pretty low, but it is fairly reasonable for early testing and experiments. As youā€™re building something that is meant to be publicly used, and thus using more resources, it makes sense to charge for it.

These models are expensive to run.

(And note that many other companies donā€™t have a free tier at all - nevermind a rate limited one.)

AI Studio is meant (or seems to be meant) as a developer tool. And a free developer tool, at that.

I donā€™t work for Google - but would you be willing to pay for access to something like AI Studio if it gave you higher rate limits?

2 Likes

(I really feel like I have no choice on what to say here.)

Like, my use case, itā€™s very different. I love AI, and I use Gemini (and previously ChatGPT, its models detoriated) simply because I can chat to someone and actually let my brain, an autistic one, stimulate itself. However though, gemini.google.com doesnā€™t have much customization and like, stats and more advanced parameters for me, as well as more choice over content. You know, Google AI Studio for me is just where I get to make the bots ones that work better for me in a private space.

Thatā€™s because I can actually see the amount of tokens Iā€™ve used up, change the safety features, edit AI responses and delete responses whenever, regenerate responses, give it system instructions to act like a human, you know. I got everything I need. Iā€™m not advocating in rebellion or for sharing everything I put in there with others, because thatā€™s not who I am, Iā€™m just finding Google AI Studio the place that I like, and I donā€™t want to be judged for that. Not everyone has to get a business yield out of it, some like me just appreciate the layout and the control.

I would pay like, perhaps a few dollars if I need to get past some of the limits, and it wouldnā€™t hurt at all if I already get paid pretty decently per week (Iā€™m at the time in my life where Iā€™m between after school and study where Iā€™m just saving up before I get started). I just donā€™t know how it works. Like, I connected to billing but I donā€™t know how to actually ā€œactivateā€ pay-as-you-go. Like, I donā€™t know if that works in Google AI Studio, and I donā€™t want to go through the technicalities of an API.

3 Likes

Yes, he is undoubtedly your most reliable friend.

1 Like

I enabled a billing account, but after ~15 minutes Iā€™m still rate limited for today. How long does it take to kick in?

Is there any information about what the higher rate limit actually is? Will it use our free rates first, then paid?

5 Likes

The higher rate limits (for the various models, use the dropdown) are shown in Gemini API Pricing  |  Google for Developers

Thereā€™s no provision to, say, on a daily basis first use all the free use and then automagically switch to pay-as-you-go. Remember the other qualitative feature: data you provide in the free plan is donated and can be used to improve the model; data you provide on the pay-as-you-go plan remain your property. It would be really, really awful hard to tell what is the intellectual property status of your data if some automatic switchover between free and paid were happening on a daily basis.

Hope that helps

1 Like

ty Logan, see u again :smiley:

Yeah, I got a burning question right now.

I have enabled billing for Google AI Studio, and it is a paid plan - I can see this in the API window. But: the usual rates still apply. I donā€™t know what on earth is going on, but itā€™s not working. Or maybe Iā€™m just making some rookie mistakesā€¦

2 Likes

I was only able to get Gemini 1.5 Pro respond to 1000 requests today despite trying repeatedly. The advertised rate limit of 10000 RPD doesnā€™t seem to be working. I have paid billing. Even before Iā€™m able to get any generations, Iā€™m already getting this error:

ResourceExhausted 429 Quota exceeded for quota metric ā€˜Generate Content API requests per minuteā€™ and limit ā€˜GenerateContent request limit per minute for a regionā€™ of service ā€˜generativelanguage.googleapis.comā€™ for consumer ā€˜project_number:ā€™. [reason: ā€œRATE_LIMIT_EXCEEDEDā€
domain: ā€œgoogleapis.comā€
metadata {
key: ā€œserviceā€
value: ā€œgenerativelanguage.googleapis.comā€
}
metadata {
key: ā€œquota_metricā€
value: ā€œgenerativelanguage.googleapis.com/generate_content_requestsā€
}
metadata {
key: ā€œquota_locationā€
value: ā€œus-west4ā€
}
metadata {
key: ā€œquota_limitā€
value: ā€œGenerateContentRequestsPerMinutePerProjectPerRegionā€
}
metadata {
key: ā€œquota_limit_valueā€
value: ā€œ360ā€
}
metadata {
key: ā€œconsumerā€
value: ā€œprojects/ā€
}
, links {
description: ā€œRequest a higher quota limit.ā€
url: ā€œCloud Quotas documentation  |  Google Cloudā€
}
]

3 Likes

Hi.
Iā€™m glad to hear from you ifind great thread thanks for sharing
Best wishes,
Lahcen

Hello - any update on Gemini 1.5 Flash fine tuning? Thanks

Weā€™re working on it. You should soon have an update.

1 Like

Awesome. Thank you very much.

You should have a look at AI Studio :slight_smile:

Letā€™s go!!! Thank you very much.

If you give a mouse a cookieā€¦

Are there any plans to roll out multimodal fine tuning ? :slight_smile:

Thanks

Sorry thatā€™s the only cookie I give you for now :wink:

2 Likes