2 ms·
Nice work! I did something similar with a personal project a few months ago using an open source llm. Also, not sure if you know, there is an api you can use. h
by cheesehead 3y ago
Nice work! I did something similar with a personal project a few months ago using an open source llm. Also, not sure if you know, there is an api you can use. https://github.com/HackerNews/API https://github.com/HackerNews/API
- nico 3y agoAwesome, did not know about the HN api, nice! What open source LLM did you use? Anything that would run on a CPU of a 5 year old MacBook Air (which I’m using as my home server) Do you have the code for your project? Or maybe some features/ideas that you could share? Thank you
- cheesehead 3y agoI'm using https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp and currently mistral 7b (on a m1 macbook pro). I'm sure with some prompt examples you can get pretty good results on a smaller model. At the moment I don't have it open sourced due to it being part of a larger project that I'm working on that contains tailwindui licensed components. A cool feature that I'm working on is creating a firefox plugin so you can save/index job postings from other sites and extract out meta information via an LLM. Very similar to this chrome plugin. https://chromewebstore.google.com/detail/huntr-job-search-tracker/mihdfbecejheednfigjpdacgeilhlmnf https://chromewebstore.google.com/detail/huntr-job-search-tr...
- nico 3y agoLove the extension idea, definitely useful for tracking opportunities Thank you for the perspective on running local LLMs Do you think that saas or local LLMs will be the most popular in the next 5 years?
- cheesehead 3y agoHoping it's local :)