4 ms·
Is there an equivalent of LORA using RL instead of supervised fine tuning? In other words, if RL is so important, is there some way for me as an end user to imp
by anonymousDan 2y ago
Is there an equivalent of LORA using RL instead of supervised fine tuning? In other words, if RL is so important, is there some way for me as an end user to improve a SOTA model with RL using my own data (i.e. without access to the resources needed to train an LLM from scratch) ?
- fpgaminer 2y agoLORA can be used in RL; it's indifferent to the training scheme. LORA is just a way of lowering the number of trainable parameters.