2 ms·
There are some differences. For example ChatGPT underwent an extra finetuning step using reinforcement learning and it supports 8k tokens instead of 4k.
by ailef 4y ago
There are some differences. For example ChatGPT underwent an extra finetuning step using reinforcement learning and it supports 8k tokens instead of 4k.