Long Conversations Without the Wait: How Suzent Compacts Context
When a long conversation outgrows the context window, most agents stop, re-read everything at full price, and make you wait for a summary. Suzent writes that summary from the prompt cache, prepares it in the background, and knows when the cache has gone cold.
阅读文章 ↗