2 ms·
It doesn't use the huggingface.co libraries?
by immibis 3y ago
It doesn't use the huggingface.co libraries?
- kgwgk 3y agolachlan_gray asked whether anyone has got a LLM to run on bare metal. tomrod replied to lachlan_gray that the huggingface.co libraries make it pretty simple. I pointed out to tomrod what is the meaning of the expression “bare metal”. I don’t understand what’s the point of your reply to me in that context.
- tomrod 3y agoI can't speak for the p___g contest others want to engage in, but why not, lets make bare metal LLMs happen! https://github.com/rreilink/PiPyOS https://github.com/rreilink/PiPyOS <-- seems like a good starting point, bare metal python. I appreciate the clarification earlier in the comment chain for what you meant by bare metal -- I had interpreted it as on-prem.