Not sure if worth posting this but I swear I’ve seen a significant behavioral change in 1.5 pro this past week. We use 1 model call to lay out an outline for something then a 2nd call to 1.5 pro to add content around the outline. In the past week it only completes like 1/2 of the task. It is not rea…

Can you confirm exactly which model you’re using? An example that demonstrated it would help as well.

when I pump it back into another call (using json mode btw to structure the output) it only used about 1,400 tokens (of the 8,192 I set) and only created content for handful of the sections. [image]

I even have a “reviewer” persona where I put the content back into LLM and ask it to reconcile the outline and the content and this example summarizes nicely how it “quit”: [image] We are changing the code to make it an iterative process BUT that is beside the point. This had been working fine fo…

I’m not doing much with gemini right now so I cant add any real value, however if it makes you feel any better, I know exactly what you mean. You cant actually say anything for 100% sure, but you can feel the model has changed. I tried desperately to work out what it was in that specific OAI case. …

Change in GEMINI 1.5 pro behavior?

Gemini API

cagey August 16, 2024, 9:33pm 3

gemini-1.5-pro (even though I’ve experimented with flash to troubleshoot). We’ve been using for a couple months, then all of a sudden this week it started half-a$$ing it.

Here is an outline created by gemini-1.5-pro

Topic		Replies	Views
Gemini-1.5-pro-latest performs WORSE since yesterday. How to use its previous version? Gemini API	35	1184	September 2, 2024
Gemini 3.1 vs 2.5 Pro: weaker reasoning, instruction-following, and long-document coverage Gemini API bug , api , models , gemini	1	650	March 31, 2026
Is Quick Parsing making Gemini stupid? Gemini API models , open-models	3	93	April 17, 2026
Did anything change with gemini-2.0-flash yesterday? Gemini API models , gemini-20	7	215	June 25, 2025
Gemini Flash Model Ignoring JSON Schema in Prompts Gemini API gemini-15 , api , models , gemini-api	2	390	November 21, 2024

Change in GEMINI 1.5 pro behavior?

Related topics