Specifically, the OpenAI compatible endpoint is including role name in the delta when streaming the response, causing corrupted output for clients that expect OpenAI compatible chunks (OpenAI stream does not repeat the role name in subsequent stream chunks).
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Gemini OpenAI compatibility issue with tool_call + streaming | 0 | 367 | January 10, 2025 | |
| New endpoints Chat, Embedding and OpenAI | 9 | 279 | November 25, 2024 | |
| Issue with Systematic Line Break at the End of Each Response with the OpenAI and Gemini Library | 0 | 75 | January 7, 2025 | |
| Streaming not working with OpenAI contract | 0 | 44 | January 10, 2025 | |
| OpenAI Compatibilioty with JNodeJS - Error | 27 | 587 | March 28, 2025 |