Does the data send in the “history =” also count as tokens in
chat_session = model.start_chat(history=) ?
Yes.
When it is sent to the LLM itself, the system instructions, tools, history, and current prompt are all turned into a stream of tokens for processing.
1 Like