4 ms·
Without the system prompt, asking its name results in it responding with the name of the model they're ripping from. That would certainly draw your eyes to the
by jdiff 4mo ago
Without the system prompt, asking its name results in it responding with the name of the model they're ripping from. That would certainly draw your eyes to the right places.
- valleyer 4mo agoWhy is this? Do labs reinforce the model name during training? I was under the impression that this sort of "self-knowledge" always came from the system prompt, but I guess not...
- jdiff 4mo agoYes. In this case, during fine tuning. Other blurbs are also baked in during fine tuning that are perfectly reproducible from the Nex model. The details inside the linked issue are quite accessible.