5 ms·
Speed of hardware did. Back in 80a they already knew the principles of llm training. It only took one week to train 10.000 tokens.
by holoduke 3y ago
Speed of hardware did.
Back in 80a they already knew the principles of llm training. It only took one week to train 10.000 tokens.
- toxik 3y agoGot a reference on that claim?
- holoduke 3y agoI think 6 months ago there was a old video from theate 80s/ beginning 90s at a US university where a professor experimented with a llm from scratch. If I find that one I will post it. But definitely they knew the principles back then.
- osigurdson 3y agoWasn't AIAYN from 2017?