3 ms·

lachlan_gray asked whether anyone has got a LLM to run on bare metal. tomrod replied to lachlan_gray that the huggingface.co libraries make it pretty simple.

by kgwgk 3y ago

lachlan_gray asked whether anyone has got a LLM to run on bare metal. tomrod replied to lachlan_gray that the huggingface.co libraries make it pretty simple. I pointed out to tomrod what is the meaning of the expression “bare metal”. I don’t understand what’s the point of your reply to me in that context.

tomrod 3y ago
I can't speak for the p___g contest others want to engage in, but why not, lets make bare metal LLMs happen! https://github.com/rreilink/PiPyOS https://github.com/rreilink/PiPyOS <-- seems like a good starting point, bare metal python. I appreciate the clarification earlier in the comment chain for what you meant by bare metal -- I had interpreted it as on-prem.
- kgwgk 3y ago
  I didn’t know that there was a bare metal implementation of python, thanks for the link. I doubt it can run pytorch though.
  - tomrod 3y ago
    As with all things, the key word is "yet" :)