Gemini Live API Response Delay Issue

I have integrated the Gemini Live API via WebSocket in my backend. However, I am noticing that the responses from the Gemini Live API are consistently slow — approximately 2–3 seconds delay before receiving output.

Could you please help me understand the reason for this delay and suggest how it can be improved?