4 ms·
It's even easier than that. There's no need to even fine tune an LLMs to do it. Here's a screenshot[1] of a 4 bit quantised version of an off the shelf open LLM
by woadwarrior01 3y ago
It's even easier than that. There's no need to even fine tune an LLMs to do it. Here's a screenshot[1] of a 4 bit quantised version of an off the shelf open LLM (WizardLM 13B v1.2) doing it on my Mac.
[1]: https://imgur.com/a/S9jnHWJ https://imgur.com/a/S9jnHWJ
- a_wild_dandan 3y agoYep, I use Llama2 70b for larger tasks on my MacBook and 13b for more “single use” type tasks. It’s a game changer.
- Tostino 3y agoThat may be true, and for some tasks the accuracy may be high enough. I have gotten much more consistency in my tasks by fine tuning though. Getting a consistently good result for one shape of input may not indicate that same performance for another shape of input for example.
- manwithaplan 3y agoThe system confabulated the www subdomain of the “URL provided in the text”, right?