3 ms·
It's unclear exactly why it doesn't work as well for you. I have two comments that may be useful: 1) It's very unclear how good the generative capabilities of
by nl 4y ago
It's unclear exactly why it doesn't work as well for you.
I have two comments that may be useful:
1) It's very unclear how good the generative capabilities of LLAMA are generally. It benchmarks well for code generation, but for English there aren't really any good benchmarks around. There's good chance the larger model performs much better since generative capabilities seem to be a partially emergent capability.
2) If you just want to "make it work" I'd suggest downloading all the Star Trek scripts you can that include Captain Picard and fine tuning LLAMA using them. It's unclear how well this will work, but that is probably about as good as you can get.
If you care about this probably deeply, it's probably worth trying the same with some of the other open GPT-3 models (GPTJ, GPT-NEOX etc)