Hopefully the beginning of finally growing beyond RLHF. While it was useful with the less complex earlier models, at this point it's an approach that's likely

Hopefully the beginning of finally growing beyond RLHF. While it was useful with the less complex earlier models, at this point it's an approach that's likely holding the SotA back. I'd much rather see systems designed with a core untouched pretrained model that's connected to find tuned input and output manglers taking user request and turning them into text completion prompts and parsing output rewording it to match user expectations. Let's not inadvertently sabotage the capabilities of the hundred million dollar general purpose model in trying to fine tune it to fit user expectations in tone and format and instead create dedicated interfaces for translating between user/corporate expectations and the raw model. With only a small handful of companies actually building the SotA pretrained models, we're far too exposed to poor decision making or carrying forward obsolete approaches as being unduly impactful on the entire field.