I can assure you it’s not a joke. Compute power is increasing at a ridiculous pace, and highly capable models are getting smaller and smaller, now at the 30b pa

I can assure you it’s not a joke. Compute power is increasing at a ridiculous pace, and highly capable models are getting smaller and smaller, now at the 30b parameter size and under. So even if it wouldn’t be pragmatic now, it could become highly relevant in 4 or 5 years if trend lines continue at anything like the recent pace.