FR version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
50% Positive
Analyzed from 113 words in the discussion.
Trending Topics
#cache#token#providers#pricing#efficiency#calculate#effect#caching#sometimes#breaks

Discussion (3 Comments)Read Original on HackerNews
Sometimes, I take breaks in the middle of a session and end up losing the prompt cache which drives up the token usage a ton. Don't all the providers have different cache times and behavior? If one person takes 20 minutes between messages, some services will keep that cache while some won't. Is there a way to factor that in?