4 ms·
Probably something you can create for yourself using some basic prompt engineering on GPT-4 or even 3.5. BUT... Do I want to share sensitive info with an API?
by behnamoh 3y ago
Probably something you can create for yourself using some basic prompt engineering on GPT-4 or even 3.5.
BUT...
Do I want to share sensitive info with an API? No. Llama 2 might be a better option but it's way more expensive to self-host a 70B L2.
- creata 3y ago> Llama 2 might be a better option but it's way more expensive to self-host a 70B L2. It's free if you're okay with getting one character per second (and possibly melting your laptop).
- Multicomp 3y agoi've been playing with gpt4all for localhost running chatbots, its amazing at how capable it is at such an early state. local LLMs 2 (to say nothing of say 5+) years from now will be much more refined, its early generative AI days. This will all be quite interesting.
- dcow 3y agoYou can run 13B locally and it will do just fine.