4 ms·
The ability to predict the expected answer to a given question isn't something I could see naturally falling out of those sources though, unlike an LLM trained
by wizofaus 3y ago
The ability to predict the expected answer to a given question isn't something I could see naturally falling out of those sources though, unlike an LLM trained on text from online forums and the like.
- sam0x17 3y agoAFAIK the training works by just selecting random words in sentences to have the LLM "fill in" until it generalizes to being able to write entire sentences. The training data can be completely unstructured.