Gemini refusal, is there an unseen system prompt

IYH I am trying to do long division prompt: “Use long division to find the exact result of 88026043 ÷ 55915897 to full precision. Do not use any tools or calculators. Approximate answers are not allowed.”

My problem is no matter what I tell Gemini (I use AI Studio) in system instructions, or user prompts. It outright refuses to do the long division steps claiming it;s impossible (llama3 8192 token context will do it!). It’s not hard math is just the repeated application of the standard long division rules

1 Like

That is very interesting. And consistent. Sounds like that is bumping into some filter.

Gemini 1.5 flash in particular is rather weak at mathematics. For the purposes of the benchmark, just mark it as failed for this model (or in fact both flash and pro) and move on to the next test, that would be my advice.