12 ms·
Pretty cool. I'm trying to wrap my head around this. Can someone explain what this mlc tool does? My understanding is that it "compiles" an LLM to C code that c
by holtkam2 3y ago
Pretty cool. I'm trying to wrap my head around this. Can someone explain what this mlc tool does? My understanding is that it "compiles" an LLM to C code that can run on any platform? How is this different from "quantization"?