3 ms·

Could this work well with distributed solutions like petals? https://github.com/bigscience-workshop/petals https://github.com/bigscience-workshop/petals I don

Could this work well with distributed solutions like petals? https://github.com/bigscience-workshop/petals https://github.com/bigscience-workshop/petals I don't understand how petals can work though. I thought LLMs were typically quite monolithic.

osmarks 3y ago
Petals does a layerwise split I think. You could probably run separate experts on each system. I don't think this sort of tech is very promising so I haven't looked.