3 ms·
Lofty diagrams aside, in practical use it's going to be a minimal hardware abstraction that serves to communicate data between models and allocate compute time
by a_vanderbilt 3y ago
Lofty diagrams aside, in practical use it's going to be a minimal hardware abstraction that serves to communicate data between models and allocate compute time based on their importance. Maybe that resource scheduler will be AI but at the end of the day, it's code running on a kernel running on CPUs.
- danielmarkbruce 3y agoThe analogy to an OS was supposed to be an analogy. No one who understands LLMs or OSs actually thinks there should be an "LLM OS" or anything of that nature.