Is there any near future plans to have native WebRTC support in the Gemini 2.0 flash live multimodal API servers?

Gemini API
,
1

websockets are good but hoping to have better experience with the webRTC for the live vision and audio communication between Gemini 2.0 flash API servers and clients like UDP to skip frames if it lost, echo cancellation

2 Likes
3

We currently do not have the details for native WebRTC at the moment. However, there is an example on using Gemini Multimodal Live API and WebRTC from this external GitHub. Please check.

1 Like
5

The relevant connection to your API still uses Websockets in that example repo tho