3 ms·

Would you say that running on bare metal the huggingface.co libraries - as the comment that I replied to suggested - is pretty simple?

• immibis 3y ago
  It doesn't use the huggingface.co libraries?
  • kgwgk 3y ago
    lachlan_gray asked whether anyone has got a LLM to run on bare metal. tomrod replied to lachlan_gray that the huggingface.co libraries make it pretty simple. I pointed out to tomrod what is the meaning of the expression “bare metal”. I don’t understand what’s the point of your reply to me in that context.
    • tomrod 3y ago
      I can't speak for the p___g contest others want to engage in, but why not, lets make bare metal LLMs happen! https://github.com/rreilink/PiPyOS https://github.com/rreilink/PiPyOS <-- seems like a good starting point, bare metal python. I appreciate the clarification earlier in the comment chain for what you meant by bare metal -- I had interpreted it as on-prem.
      • kgwgk 3y ago
        I didn’t know that there was a bare metal implementation of python, thanks for the link. I doubt it can run pytorch though.
        • tomrod 3y ago
          As with all things, the key word is "yet" :)