Issue with Key Ordering in Controlled Generation on Gemini 1.5

[seungduk]

Same issue reported here:

Gemini does not respect the order of the properties in a schema

Let’s imagine a situation where you want an answer and a rationale from the LLM. You want it to be in a JSON format like { "choice": 4, "rationale": "The answer is 4 because..." } If the LLM completes the choice property first, then the next rationale can be made up to justify the choice. However, if the rational comes first like { "rationale": "The answer is 4 because...", "choice": 4 } Then, the choice will be determined by rationale. It is similar to CoT. It is important that th…