I tried everything. I tried putting it into the system prompt. I tried asking it to actively use the thinking mode. I really tried everything, trust me. It’s not working with high-context chats, nor with -100K context chats. I tried Ctrl+F5, tried changing the model, tried saving the prompt with the thinking budget active, then deactivating, saving, activating, saving, nothing. I tried giving negative feedback with specifics, nothing. I really tried all the things I could come up with, even 10 more than these listed down. I need help.
The “Thinking Mode” toggle is still experimental and its behavior towards running high context chats i.e., with 100k+ tokens or non-English technical prompts are non-deterministic in nature.
What we can do instead would be:
- Explicitly instruct long-form planning in the user prompt.
- Avoid toggling the Thinking Mode repeatedly in-session,
i.e., once set, reload the session to ensure stability. - Use Gemini1.5pro if determinism is required so that this experimental behavior will be avoided, and we can get more consistent output.
I’m already doing all of this. My system prompt is particularly detailed and follows all the state-of-the-art best practices for prompt engineering. The thinking mode does not work, even if set and not modified during the session. I need 2.5pro for the coding computational capabilities. So, this, unfortunately, is not helpful.
Hello @Arcadia_Domus
Could you please share some of your prompts so that we can try to recreate your issue?
Can i send dms? Or somewhere else?
I always have to ask directly for the usage of the active tools, or for similar ways of being straightforward about it in the requests, when it starts not using the thinking. I have tried all different ways.
Another chat, same problem. Thinking mode does not get called until I beg for it and ask it not to hallucinate, or similar things, but this is also unreliable as, after a while, it always stops listening, even to those solutions.
Same problem even when just booting up. I just logged in and I got 2 errors. The first was the ‘permission denied’ error, and I learned to just F5 and try again. The second one is the usual problem of the bot not thinking even if it is active. Sometimes I have to make it send an ‘I understood’ message only to skip to the next message where sometimes it starts to think again.
It also says that the feedback feature with the thumb up/down is a deprecated feature…
Getting this on reload.
After it starts working again. I don’t know if this helps, but I hope so…
Hi,
We have observed that thinking struggles after long chats. We have escalated this to our internal team, they will look into this. Thank you for your patience.
Thanks . If you need anything else from my side to make it easier, feel free to send me DMs. By the way, the problem seems to start a bit after 100k and then a lot after 300k tokens.