Hello,
The new OpenAI API format is very convenient – thank you for adding it! Does it support context caching?
I was unable to find the answer from (a) the docs, (b) searching this forum, and (c) the internet, so I am asking here.
Thanks!
Yes, it’s documented here:
Ahh, sorry, that’s for the Gemini API directly, you are referring to the OpenAI API.
No, then I haven’t seen that feature yet. Perhaps it’s on the roadmap of the compatibility. Right now, I guess we have to be patient.