Small idle thought: an LLM spends almost all its computation in high-dimensional latent space — no tokens, just math. The lossiest part is in the conversion back into the closest tokens. Any kind of workflow where LLMs talk to each other, is in that sense, an enormously information lossy (intelligence minimizing?) operation. Not to mention that it’s inefficient to compress and reconstruct on every such iteration. You probably want to keep all processing purely mathematical, exchanging latent vectors/KV caches and converting back to tokens only at the very end when necessary for human consumption