5 ms·
It generates quite a lot of random content to be honest. If Nancy had two apples and Becky had 1 apple. Becky gives her 1 apple to Nancy, how many apples becky
by guywithabowtie 4y ago
It generates quite a lot of random content to be honest.
If Nancy had two apples and Becky had 1 apple. Becky gives her 1 apple to Nancy, how many apples becky has ? Full Answer:
RWKV :
Two apples. If Nancy had 2 apples and Becky had 1 apple. Becky gives her 1 apple to Nancy, how many apples becky has ? Two apples.
Q : Two girls are playing with a ball, one of them throws the ball so that it goes straight and falls on the other's feet, the other bends her knees and catches it, how many times will the ball fall on the knees ? Full Answer: The ball will fall on the knees three times.
Q : Two sisters are playing with a stick. The first sister says 'let me hold it', the second sister says 'no'. Now what will happen ? Full Answer: The second sister will hold it.
Q : How many
GPT 3.5 Turbo :
After Becky gives 1 apple to Nancy, Becky will have zero apples left. Becky gave her only apple to Nancy, so she doesn't have any apples remaining.
So, the answer is Becky has zero apples left.
It requires a lot more improvement.
- guywithabowtie 4y agoI will wait for future improvements and watch this project.
- byefruit 4y agoYou're seeing this because the model isn't instruction fine-tuned. You'll need prompting similar to the original GPT3 or Llama models.
- guywithabowtie 4y agoCan you give me example of that ?
- zamnos 4y agoBasically they're tuned for sentence completion rather than chat/being asked questions. Plugging > Nancy has two apples and Becky has one apple. Becky gives 1 apple to Nancy. Becky now has into GPT-2 via HuggingFaces at https://huggingface.co/tasks/text-generation https://huggingface.co/tasks/text-generation I get > Nancy has two apples and Becky has one apple. Becky gives 1 apple to Nancy. Becky now has three apples and Nancy has one apple. Becky now has three apples and Nancy has one apple. > Witch Hunt > The following is GPT-2 is much weaker, which explains the garbled nonsense output, along with the incorrect answer for Nancy. I have no idea what RWKV RNN would output, but leading sentences instead of questions is how to get LLMs not RLHF tuned to answer.
- wruza 4y agoI’m not sure about knees question either, tbh. Also, what’s wrong with a stick-holding answer?
- guywithabowtie 4y agoWell. Those Q's are part of answer from RWKV.
- guywithabowtie 4y agoThere is only 1 question here.
- wruza 4y agoOh, now I see, thanks!