3 ms·
If the loss keeps decreasing forever, then that conclusion seems to follow. But it's likely there will be plateaus and ceilings that current neural net architec
by pshc 3y ago
If the loss keeps decreasing forever, then that conclusion seems to follow. But it's likely there will be plateaus and ceilings that current neural net architectures cannot surpass. We likely need more breakthroughs to achieve enough generalized reasoning, reliable predictions, alignment, and scalability within hardware constraints.