3 ms·
There’s now an open source alternative to ChatGPT, but good luck running it
- permo-w 4y agoI like how this says there’s “now” an open source alternative to chatgpt, as if chatgpt was the first ever language generation model that’s been routed into a chatbot
- version_five 4y agoMy read was the novelty lies in the combination of a language model plus a reinforcement learning layer on top, just like chatgpt.
- pizza 4y agoWould it be possible to integrate RLHF with BLOOM Petals [0]? Petals lets you run the huge BLOOM model (175B params) with a distributed swarm of machines. iirc it already supports fine-tuning BLOOM, so.. maybe? [0] https://github.com/bigscience-workshop/petals https://github.com/bigscience-workshop/petals
- Kab1r 4y agoAre they calculating the cost of training these models based on cloud computing costs? I would think it's more economical to just buy a couple DXG stations.