2 ms·
GPT-J is a 6 billion parameter model. (3.4% of the size of GPT-3) Having used both, I'd say it's worse than Alpaca-7B, which itself is not ChatGPT-grade.
by sbierwagen 4y ago
GPT-J is a 6 billion parameter model. (3.4% of the size of GPT-3) Having used both, I'd say it's worse than Alpaca-7B, which itself is not ChatGPT-grade.
- MacsHeadroom 4y agoGPT-3.5 is probably a finetuned Curie (13B). But GPT-J is so far down on the benchmarks, it's definitely not "ChatGPT-grade". Vicuna-13B v1.1 is arguably though.