3 ms·
Mistral displays some “thinking” text (in their basic online chat interface) in the thinking mode, do we know if those are the real tokens? It’s quite interest
by bee_rider 4mo ago
Mistral displays some “thinking” text (in their basic online chat interface) in the thinking mode, do we know if those are the real tokens?
It’s quite interesting to read. I can’t imagine using a model like this without the ability to peek inside and see if it is getting stuck.
- transcriptase 4mo agoI wonder if they put all 80k tokens of the GDPR in its system prompt.
- bee_rider 4mo agoI dunno, I’m in the US, so I’m not sure how much that impacts their processing of data about me.
- FireBeyond 4mo agoI'm in the US and about a month ago Claude decided I wanted UK English for all my answers and couldn't explain why it changed.