4 ms·
We absolutely can and will in time, but for better or worse LLMs and large transformer models are highly effective and are entrenching themselves. Any competing
by dontwearitout 3y ago
We absolutely can and will in time, but for better or worse LLMs and large transformer models are highly effective and are entrenching themselves. Any competing hardware architecture that cannot port LLMs will have to do a lot of bootstrapping, and will have to have some extremely compelling reasons for people to choose it.
Cutting energy costs by an order of magnitude could be enough motivation, but you'll still need to demonstrate competitive model performance.