3 ms·
What does a better LLM mean? We again… already have terminal usage in AutoGPT. It describes a little what you are talking about. What measurement do you use to
by gwoolhurme 3y ago
What does a better LLM mean? We again… already have terminal usage in AutoGPT. It describes a little what you are talking about. What measurement do you use to test if a language model 1 is better than 2? Accuracy? Self reliance? Is that what a Transformer should be doing? Sure an LLM can compete with humans on all of those tasks. Fantastic. So are we at the singularity now as it’s defined? Do I quit my job now?
- c7b 3y agoLike I said in the original post, clearly telling which of two LLMs is better is difficult, and probably one of the things holding us back from having a singularity right now. But that doesn't seem to be an insurmountable problem. Most people who have used both seem to agree that GPT4 is 'better' than GPT3, so maybe we can formalize that intuition somehow.