3 ms·
the thing went from the transformer paper in 2017 to basically doing your job for you in 2026
by make3 3mo ago
the thing went from the transformer paper in 2017 to basically doing your job for you in 2026
- drw85 3mo agoThe problem is that it's too expensive. It can technically do parts of my job for me, but at a variable cost that's higher than mine right now.
- make3 3mo agoEfficiency is an angle of research that's quite active, see quantization, MoE, speculative decoding, QKV cache optimizations, sparse attention, etc