3 ms·
It's a reference implementation, other people are supposed to pick it up and apply the techniques to their own work I would love to see some links to any where
by anentropic 4y ago
It's a reference implementation, other people are supposed to pick it up and apply the techniques to their own work
I would love to see some links to any where it has been used?
So far the most promising codebases for running LLMs on Mac have been the 'cpp' reimplementations, which ditch Pytorch and run on the CPU, using other tricks to fit the model into available RAM.