3 ms·
As a sizable share of the market is going to want to use this for local LLMs, I do not think this is that misleading.
by polotics 6mo ago
As a sizable share of the market is going to want to use this for local LLMs, I do not think this is that misleading.
- bigyabai 6mo agoMost people I know are not using TinyGrad for inference, but CUDA or Vulkan (neither of which are provided here).