Function Calling Multimodal Live API

Hi everyone,

I’m using the websockets and audio streaming for the API and there are times when the model makes a function call but after returning the response to the model it seems like the model didn’t even process it. Is anyone else facing this issue?

Thanks

4 Likes

I’ve been encountering the same issue. I’m trying to integrate a knowledge base and have a Python API that analyzes queries and retrieves similar content using Sentence Transformers. While the API returns responses correctly, the model doesn’t seem to reference them at all.