Anyone experiencing google.api_core.exceptions.Cancelled: 499 The operation was cancelled

Gemini API
,
1

it happens intermittently, I am well within my rpm, rpd and tokens. Currently happening with gemini flash 2.0

11 Likes
3

yes, I keep getting it with no client changes.
I’m about to give up on Gemini API. Great models but absolutely unreliable for anything serious at the moment. Pretty sad.

Error: Google API error: Client Closed Request. {“error”:{“code”:499,“message”:“The operation was cancelled.”,“status”:“CANCELLED”}}

3 Likes
5

Happens to me as well

1 Like
7

I have gone back to 1.5 flash as this is not happening in the older model

1 Like
8

same here, no code changes, second outage ive experienced using gem. first was gem flash 1.5 , different problem but took 4 days for google to fix
now this, I expect another another week before they recognize this thread and fix.
sad because its a great ai but no stability…

2 Likes
10

Happening here as well and it happens quite frequently. Using Gemini Flash 2.0.

1 Like
12

Getting the same issue since yesterday. Is this on a specific SDK or something?

We noticed this on Gemini SDK: “npm:@google/generative-ai@0.24” package on Deno.

2 Likes
13

is anyone experiencing this using the latest SDK?

14

Happening to us as well (for the last ~2 days). We reached out to Google to make them aware of the issue but it hasn’t helped. Hoping for a fast resolution.

1 Like
15

Yes - we tried the latest version of @google-cloud/vertexai and it didn’t help.

1 Like
16

Same. Seeing it specifically when the payload is large.

1 Like
18

also experiencing this issue - using @ai-sdk/google.

other notes:

  • we’re on Tier 1 billing.
  • request wise it seems to be specific to:
    google.ai.generativelanguage.v1beta.GenerativeService.StreamGenerateContent

we’re also using the following api’s with no issues:

  1. google.ai.generativelanguage.v1beta.GenerativeService.GenerateContent
  2. google.ai.generativelanguage.v1.GenerativeService.BatchEmbedContents
  3. google.ai.generativelanguage.v1main.GenerativeService.StreamGenerateContent

:upside_down_face:

1 Like
19

Hey folks! Looking into this.

2 Likes
20

Ack, we are able to see this on our side clearly, engineering team is investigating right now and looking into a fix.

5 Likes
21

Getting this right now, Im in Pakistan. Using Gemini for producing SaaS Product Documentation on Oracle APEX.

22

Thank you for the update Logan !

23

Same thing here, I get this error constantly and randomly here, using 2.0 flash and 2.0 flash experimental in the python SDK.

1 Like
25

Have not experienced any 499 errors today - will share if we do.

26

timing out for us now. rolled back to gem1.5 flash,
it has been almost a week now 2.0 flash is near unusable..

27

I am still experiencing this…have not been able to use the functionality we built since last night…