6 ms·
Yes. > We follow the “Textbooks Are All You Need” approach, focusing this time on common sense reasoning in natural language, and create a new 1.3 billion para
by visarga 3y ago
Yes.
> We follow the “Textbooks Are All You Need” approach, focusing this time on common
sense reasoning in natural language, and create a new 1.3 billion parameter model named phi-1.5, with performance on natural language tasks comparable to models 5x larger, and surpassing most non-frontier LLMs on more complex reasoning tasks such as grade-school mathematics and basic coding.
https://arxiv.org/pdf/2309.05463.pdf https://arxiv.org/pdf/2309.05463.pdf
- ShamelessC 3y agoThanks!