RL changes the weights which is a big deal. RL is expensive using HF. This could cut costs alot. You could have models learning different specialities. One cou

RL changes the weights which is a big deal. RL is expensive using HF. This could cut costs alot. You could have models learning different specialities. One could play with Redis and only do that for example.