Gemini Live API Session closing instantly

I am currently trying to interact with Live Native Audio API with Python. But, I keep getting sending 1000 (OK) and receiving 1000 (OK), meaning the session closes right before audio chunks are even sent. Anybody know any solutions?