4 ms·

Reading the patch: https://github.com/facebookresearch/llama/compare/main...markasoftware:llama-cpu:main https://github.com/facebookresearch/llama/compare/main.

Reading the patch: https://github.com/facebookresearch/llama/compare/main...markasoftware:llama-cpu:main https://github.com/facebookresearch/llama/compare/main...mar... Looks like this is just tweaking some defaults and commenting out some code that enables cuda. It also switches to something called gloo, which I'm not familiar with. Seems like an alternate backend.

markasoftware 4y ago
you don't actually need to switch to gloo, I just have no idea what I'm doing.
- refulgentis 4y ago
  Lol, all my best work has been when I don’t know what I’m doing and it’s refreshing to see someone moving the ball forward and feeling the same way. Kudos
rajman187 4y ago
Gloo is a communication protocol for distributed computation (think along the lines of MPI)