As I understand the issue is at the moment Gemini(test on gemini-exp-1206, not sure about other branch) can only render LaTeX equations in inline mode($...$). It treats equations in display mode(\begin{equation}...\end{equation}) as code section, but if you specifically ask Gemini to show equations in inline mode it will actually get it right.
