3 ms·
Textbooks Are All You Need II: phi-1.5 technical report "Perhaps achieving ChatGPT’s level of capability at the one billion parameters scale is actually achiev
by __vec__ 3y ago
Textbooks Are All You Need II: phi-1.5 technical report
"Perhaps achieving ChatGPT’s level of capability at the one billion parameters scale is actually achievable?"
- refulgentis 3y agoOn a long enough timeline, Id say yes. Right now they're comparing to the 7B Llama 2, which is a shadow of 65B llama2, which is a couple steps off ChatGPT, which is a shadow of GPT4. I'm still comfy saying yes because there's no reason to doubt it will follow the same logic as "eventually $phone will have the same FLOPS as $desktop"