3 ms·
Now that Astra is moving to a new compaction model (aka, ditching compaction altogether), is there any need for this sort of thing still?
by nullbio 1mo ago
Now that Astra is moving to a new compaction model (aka, ditching compaction altogether), is there any need for this sort of thing still?
- pdimitar 1mo agoHuh? Can you show source on the "it will not compact"? Very interesting.
- esafak 1mo ago"With Astra, we’re introducing a new way for Codex to preserve and retrieve context when the context window fills. Historically, models have used compaction to summarize work during long sessions, such as when debugging complex issues or tackling large refactors. Each compaction can leave out details about why a fix failed or how a component behaves. In Codex, Astra can keep notes across context windows, preserving accumulated details without repeatedly compressing them into a single summary. Earlier context windows remain searchable, so Astra can find requirements or test results from previous messages and tool outputs—even if that information wasn’t captured in its notes. You can enable this experimental feature in your Codex config.toml, (opens in a new window) and it will become the default for Astra in the coming weeks." https://openai.com/index/gpt-6-astra/ https://openai.com/index/gpt-6-astra/
- bayesianbot 1mo agoThis clearly is Codex-specific, not as much a feature of the model (though obviously they probably have trained it to be great at working with their own tools). Sounds somewhat similar to pi-observational-memory I'm using with Pi.