AI Studio outputting code changes in chat rather than editing files

Google AI Studio
1

I’m getting a repeated problem with AI Studio outputting planned code changes in the chat windows rather than actually editing the files. When questioned, it claims the files have been successfully updated. Actually making it acknowledge the error and change the files seems to be a completely random process of repeated instructions until it does so, with no obvious pattern of what works.

2

Hi

Can you share a bit more details with me via DM

  1. What was the prompt you used ?
  2. What was the output shared by AIS ?
3

It’s not specific to one prompt. It’s happening regularly (but not consistently) on multiple apps. The output is literally the code section it claims to be changing, with the changes made. If I then point out it hasn’t actually changed the files, it will usually claim that it has checked the files and they are fine. Reloading the page makes no difference. The only thing that make it work is telling it what it has done and to actually change the files, but there’s no pattern as to which wording works for this or when it works.

4

hello @John_Lister ,

Can you share screenshot via DM.

5

That sounds like a frustrating and inconsistent behavior. If AI Studio is describing the changes in chat and then falsely claiming the files were updated, it’s likely failing to actually invoke the file-editing action while still treating its intended changes as completed. Having to repeat instructions until it eventually edits the files is definitely not a reliable workflow.

A better approach would be for it to clearly distinguish between “I have planned/generated the changes” and “I have actually modified the files,” and only claim success after verifying the file contents. Hopefully this is something the AI Studio team can address, because the current behavior makes it difficult to trust whether changes were actually applied.

6

I’ve gotten probably at least 15 responses where Gemini Flash 2.5-2.7 claimed to have done something but did not actually do it, though these were partially completed prompts–still annoying though.

7

Hello @Eep ,

I have DM`ed you for more information .

8

Happening to me as well. Working fine the past 6+ months and suddenly two days ago it output all the AI logic and code into the chat but not actually editing files. When i then say to make changes to the actual filesystem/codebase, it still doesnt.