Threads API Suggestion

Gemini API
,
1

Threads API

As a Developer I’d like to suggest some sort of stateful API that keeps track of chat message turns. Like how OpenAI does with their assistants api.

just posting this here with the hopes that it gets seen - I think it would be really useful especially for new developers to build on, assuming there’s reasonable control like context window configs in terms of tokens or message turn counts etc.

Love the progress that is already being made, especially with context caching. Keep at it! :+1:

1 Like
2

Can you point to the OpenAI reference for its state management API?

A few thoughts:

  • The official APIs have support for this already with start_chat(), which is a purely local implementation that lets you manage the history however you wish.
  • Tools like LangChain and LangChain.js have history management as a first-class feature
  • Genkit has direct support for this as a local implementation as well.