3 ms·
Totally. But they aren't fine tuning these afaict- but comparing general purpose capabilities.
by jasonjmcghee 2y ago
Totally. But they aren't fine tuning these afaict- but comparing general purpose capabilities.
- Der_Einzige 2y agoThe point still stands, Phi3 is an excellent model and shows that good models don’t need that many parameters You should see the work on ReFT coming from mannings group showing that you can instruction fine tune models by modifying like, 0.00001% of the parameters. By doing it this way, you significantly mitigate the risk of catastrophic forgetting.