2 ms·
This isn't really an interchange formula so much as something you'd JIT compile down to when handing things off to an LLM, right?
by tptacek 1y ago
This isn't really an interchange formula so much as something you'd JIT compile down to when handing things off to an LLM, right?
- furyofantares 1y agoAnd on the way out of the LLM. Token savings nice on the way out too, and then also I have to imagine it's better for the LLM to see one format in all of it's context instead of two. It seems like a nice idea to me if restricted to that. Although I guess I am not sure if it's really intended that way - the array count for example is probably pretty bad for LLM output.
- tptacek 1y agoI feel like on the output side you might be working against LLM training? But I don't know.