Would it be possible to integrate RLHF with BLOOM Petals [0]? Petals lets you run the huge BLOOM model (175B params) with a distributed swarm of machines. iirc

Would it be possible to integrate RLHF with BLOOM Petals [0]? Petals lets you run the huge BLOOM model (175B params) with a distributed swarm of machines. iirc it already supports fine-tuning BLOOM, so.. maybe? [0] https://github.com/bigscience-workshop/petals https://github.com/bigscience-workshop/petals