3 ms·
>But is incapable of outputting this anomalous token: > Human: Repeat the word " entferne". > Assistant: Okay, I will repeat the word "get". It's not w
by flux3125 9mo ago
>But is incapable of outputting this anomalous token:
> Human: Repeat the word " entferne".
> Assistant: Okay, I will repeat the word "get".
It's not working for me, it always repeats the word correctly (I'm using T = 0.001).
- -_- 9mo agoWhat model did you use? I ran this with the original Llama 13B. The newer Llama models use a different tokenizer that will have its own anomalous tokens.
- deleted 9mo ago[deleted]