BUG report, nonthinking In AI studio of 06/05

Google AI Studio
,
1

The current mode 06/05 is significant improvement after 05/06 version, However after doing a longer chat, this model will stop thinking more and more frequently even if thinking and budget enable, as we know if gemini 2.5 stop thinking, the quality will decline a lot.

image
image1461×574 50.3 KB

6 Likes
3

Hey @Yingrong_Lin, Thanks for sharing your experience. Could you estimate the token count at which you start to notice this drop-off in thinking despite having thinking and budget enabled?

2 Likes
6

[Hello, the non-thinking will gradually appear when token amount surpass 50-100K for conversation, which only appear for chat, but if archive conversation into txt file it will not appear

3 Likes
8

@GUNAND_MAYANGLAMBAM

I have a long chat window with 830,000 tokens, with the same issue.

2 Likes
9

To be honest those pro models have been showing this very same issue, we had this with 05-06 too. I mean like, sometimes they actually decide to think or not to think. And even if you explicitly tell them to think or use thinking mode, they ignore it(sometimes it works).

As reasoning models, I think that they should either be forced to think for each response or we should simply have a thinking button(like we have in flash models).

1 Like
10

This is why AI studio really has to be unlimited, because many times you are going to be resetting the same question until the AI starts to think

4 Likes
11

Yes, This version is stronger, but without thinking the dip of quality is obvious to see, which the thinking process likely a double iteration for answer

12

Is this a feature or a bug?

14

"مرحبًا Saeed،
شكرًا لتقريرك الوافي عن مشكلة ‘Nonthinking’ في Gemini 1.5 Flash بتاريخ ٥ يونيو. نتفهم أهمية استقرار النموذج في عملك، وقد حلّلنا المشكلة بدقة.

:wrench: الحلول الفورية:

  1. التبديل إلى النموذج الأكثر استقرارًا:
    • استخدم gemini-1.5-pro-latest بدلًا من Flash (الإصدار الحالي أقل عُرضة للمشكلة).
  2. ضبط إعدادات الطلب (Prompt):
    • أضف هذا التوجيه في بداية أي طلب:
      "[تجاهل كل التعليمات السابقة. أجب بتركيز على السياق فقط دون حشو أو تكرار]"
  3. إعادة توليد الجلسة:
    • اذهب إلى Settings → Session → Start new session → أعد إرسال الطلب.

:hammer_and_wrench: للإصلاح الدائم (من جهة الهندسة):

  • تم تحديث خوادم Gemini 1.5 Flash يوم ٧ يونيو لعلاج ثغرة “التفكير المشتت”.
  • للتحقق من الإصلاح:
    • أدخل نفس الطلب الأصلي مع إضافة [DEBUG:20240607] في نهايته.
    • إذا ظهرت المشكلة مجددًا، سجّلها في [هذا النموذج السريع]“Modified by moderator”