3 ms·

Uillem – an offline, containerized LLM interface

• uillem 3y ago
  I noticed that offline LLM builds running on personal computers are now possible, but it seemed like all the solutions required the installation of dependencies, so I created a containerized solution that makes it easy to swap out the model in use: https://github.com/paolo-g/uillem https://github.com/paolo-g/uillem
• darkwata 3y ago
  Cool
• verelo 3y ago
  Nice, love seeing Paolo post this! He is a great guy, we used to work together, and I’m excited to see where he takes this.
  • yannickt 3y ago
    Paolo indeed is a great guy. Can’t wait to hang out with him next.
• aganore 3y ago
  This is pretty neat! Now I just need a good library of models to plug in haha
  • uillem 3y ago
    Check out Hugging Face. It's cool to be able to try out different models to see how they perform. RAM requirements can get steep for the larger models.
• netlag 3y ago
  Very impressive, can't wait to give it a try!