I am wondering if there is a good open source python chat client that plays well with Gemini API?
Second question is whether there are any other good (even non-open-source) clients that are fully integrated with Gemini API?
The reason I ask is that I need to access the full context window (using enterprise plan pay as you go etc.) in a chat interface for working on large code refactoring projects. I need it to see my whole app in context and then work on refactoring various modules, with the whole context there. Would ideally want streaming, access to temperature and Top-P, file uploads, etc.
Gemini Advanced is - I’m sorry to say - almost entirely unusable for real work. It’s so dumbed down that it’s painful (not to mention no streaming … what’s up with that?). Plus the context window there is too small and it appears you cannot really use all of it (when I tried uploading a few files - collectively way smaller than the context window) it said they exceeded the limit, so there must be other limits at play there). Plus the rate limit kicks in almost immediately because I’m trying to use 250,000 tokens in the window. So that’s not an option at all.
I want to work on refactoring code in a chat interface that can work with the full long-context window of Gemini Pro. I also want control over temperature and top-P in the UI if possible because for coding I find temp of 0.1 and Top-P of 0.95 seem to work better.
Basically I want something close to what Google AI Studio chat is … which I would use except unfortunately that is also not an option because it seems you cannot hook up your enterprise API key to that … and the “free” rate limit kicks in almost immediately if you actually use a decent amount of the context window it seems. I am only able to do a few requests on 250,000 tokens in context and then get locked out for like half a day (?).
So ideally I don’t have to build my own chat app… there must be something out there that is good for this. Any ideas?
(note - it’s really too bad we can’t just hook up our API keys to Google AI Studio chat in Chrome – even though Chrome crashes after a while, it’s still not a bad option compared to what’s out there. Claude is too small and the rate limit kicks in. OpenAI is even smaller and same rate limit issue. For doing real work on a decent amout of code there doesn’t seem to be a great option … has anyone found one?)