4 ms·
Right now I'm pretty sure just having gpt rewrite the average low to mediocre content that made up the gruel of its generic internet diet and doing fine tunes w
by dontupvoteme 3y ago
Right now I'm pretty sure just having gpt rewrite the average low to mediocre content that made up the gruel of its generic internet diet and doing fine tunes will get us another 5-10x along, but most hopefully for us little guys out there with a ~24-48GB VRAM cap
If GPT4 really is 8 230M models, the next bit for us will be a few ~1-5M models that swap in for whatever you want to create, or talk about, or what have you
Imagine a model trained just on English football for the purpose of having a good time in the pub that is used when the topic changes to it. I bet you could pass on the dailymails sports page if you add some "u"s into your words.
Or a model finetuned specifically on the library you're trying to debug, maybe even specifically in combination with other tools you're trying to put together.