@VictorTaelin I too have considered compaction to be the next generation of model design

Source

• URL: https://x.com/DmitrijVin70043/status/2078193111247835391
• Author: Dimava (@DmitrijVin70043)
• Posted: 2026-07-17 19:00:23

Branch

1/ @DmitrijVin70043

@VictorTaelin

I too have considered compaction to be the next generation of model design
Incremental compaction
a,b = compact(a,B) - for use in long threads keeping most of the context
Recursive compaction
c = compact(a,b) - to distill skills
Skills gonna be the KV cache rather then text

Related

• Spine: 2026-07-17-read-this-and-your-next-model-will-be-10x-smarter