4 ms·
Do you mean the [0] Token Benchmarks section? I only see token count numbers. Which doesn't address the question: do LLMs understand TOON the same as they woul
by Mumps 11mo ago
Do you mean the [0] Token Benchmarks section? I only see token count numbers.
Which doesn't address the question: do LLMs understand TOON the same as they would JSON? It's quite likely that this notation is not interpreted the same by most LLM, as they would JSON. So benchmarks on, say, data processing tasks, would be warranted.
[0] https://github.com/johannschopplich/toon?tab=readme-ov-file#token-benchmarks https://github.com/johannschopplich/toon?tab=readme-ov-file#...
- tujux 11mo agoI think they're talking about these sections: 1. Retrieval Accuracy - https://github.com/johannschopplich/toon?tab=readme-ov-file#retrieval-accuracy https://github.com/johannschopplich/toon?tab=readme-ov-file#... 2. Performance by dataset - https://github.com/johannschopplich/toon?tab=readme-ov-file#performance-by-dataset https://github.com/johannschopplich/toon?tab=readme-ov-file#...