Regarding token caching, I understand that the Time to Live (TTL) determines how long the cached tokens are retained before being automatically deleted (defaulting to 1 hour if not set). If I manually delete the cached content before the TTL expires, will the pricing be based on the duration from the content’s creation time to its manual deletion time, rather than the full TTL? Or is the pricing calculated based on the entire TTL period, regardless of when the cached content is deleted?
3 Likes
In my experience, it has been from the content’s creation time to its manual deletion time.
2 Likes
I’m also wondering about this. Specifically, is it computed by seconds, minutes, or a minimum cache time?
It’s very unclear based on the documentations or usage_metadata response for the cache. Trying to dig the usage details through the cloud console is also not that easy since I could only get summary by SKU and date.
I wish they make this clear in the documentation, for now I’m hesitant to use this. I know it’s really cheap especially if using Flash 1.5, but I would like to get super clear feedback on the unit cost per call → e.g. if after deletion of ‘cache’, make the total cache time present in the ‘cache’.usage_metadata.
1 Like