Nate B Jones explains that long conversations repeatedly send the same accumulated input back to the model. That reused context can dominate token consumption, so the biggest savings come from controlling what remains in the conversation rather than merely shortening the newest prompt.
Nate B Jones recommends editing an incorrect prompt instead of appending a correction, grouping related questions and starting a fresh conversation when the task changes. When work continues across sessions, preserve the accepted artifact or decision rather than the entire exploratory history that produced it.
The workflow also benefits from concise outputs, lightweight source formats and deliberate retrieval. Users should search files before loading them, keep approved answers easy to find and expose only the tools and documents needed for the current task. These practices reduce noise as well as cost.
Compaction and context editing can extend a session, but they are approximations rather than perfect memory. Nate B Jones therefore treats them as supporting controls and uses smaller models or prompt caching only when the task and repeated workload make those choices appropriate.
Watch the original on YouTube