4 ms·
Could be the same base multipurpose models, but finetuned to be somewhat specialized.
by jamilton 3y ago
Could be the same base multipurpose models, but finetuned to be somewhat specialized.
- regularfry 3y agoYeah, same principle. If you're passing messages between things that will react exactly the same to the same prompt, there's not a lot of point (unless the parallelism is important). If you've got fine-tunes, the whole point is that they will be better at some questions than the baseline. Mind you, there's another idea there about mixture of experts as implemented by deciding which fine-tune to load, depending on the prompt itself... I'm sure that's been looked at.