sarthaksaxena

3 ms·

1.
by sarthaksaxena 7mo ago
Hi HN! We have built llmpm, a CLI package manager for open source LLMs. You can now download and run 10,000+ free models using single command. The idea came from the friction we kept seeing when trying to run models locally. Setting up mode
2.
Show HN: Llmpm – NPM for LLMs(llmpm.co)
6 points by sarthaksaxena 7mo ago|2 comments
3.
by sarthaksaxena 7mo ago
I am building npm for LLM Models, you can now install run and ship AI Models. It’s a CLI tool that makes open-source LLMs installable like packages. llmpm install llama3 llmpm run llama3 You can also package models with your projects so oth
4.
Ask HN: How are you adapting your career in this AI era?
12 points by sarthaksaxena 7mo ago|6 comments
5.
by sarthaksaxena 7mo ago
I am building a command line package manager for AI models. It’ll make installing and running models locally incredibly easy. Checkout: https://llmpm.co
6.
by sarthaksaxena 7mo ago
Yes indeed there is, run `llmpm serve <model_name>`, which will expose an API endpoint http://localhost:8080/v1/chat/completions & also host a chat UI where you can interact with the local running model ht
7.
by sarthaksaxena 7mo ago
Yeah :)! Just run `llmpm init` to start packaging your models along with your code.
8.
by sarthaksaxena 7mo ago
https://llmpm.co I have built npm for LLM models, which lets you install & run 10,000+ open sourced large language models within seconds. The idea is to make models installable like packages in your code: llmpm install llama