5 ms·
I think we're already way beyond the point where anyone really understands how a response is produced, even without this.
by IshKebab 2y ago
I think we're already way beyond the point where anyone really understands how a response is produced, even without this.
- nfw2 2y agothe token generation part isn't well understood, but the output "chain-of-thought" used to produce the final answer can be scrutinized for correctness with a traditional CoT model (although this would require model providers to not hide reasoning tokens)
- anon373839 2y agoIndeed. Even if an LLM tells you its “reasoning” process step by step, it’s not actually an exposition of the model’s internal decision process. It’s just more text that, when generated, improves the chances of a good final output.
- deleted 2y ago[deleted]