4 ms·
> Running inference does not change the trained weights. That's true today. I don't know how many days (or hours) away we are from GPT-4 running a LoRA-pass t
by fl7305 4y ago
> Running inference does not change the trained weights.
That's true today.
I don't know how many days (or hours) away we are from GPT-4 running a LoRA-pass to update its weights after each round though?
- Cyphase 4y agoThat would be an explicit decision by OpenAI, not a result of immature tech.
- fl7305 4y agoSure. But my point was that it is not an inherent feature in LLMs that they are frozen in time. Fine-tuning the entire model is very expensive. But fine-tuning a tiny parallell piece using LoRA is cheap both in CPU cycles and storage. OpenAI could already have implemented an auto-update feature without telling us. In the future, I can see them selling a premium feature where you have your own LoRA-addon that gets constantly trained on your interactions with it, so you get your own personalized GPT-4.