4 ms·
It’s pretty stupid actually, I asked it to decode an ascii sequence and it gave me jiberish. I tried phi-4 Q4 and it got it. 9gb vs 2gb(reasoning). I imagine
by m3kw9 2y ago
It’s pretty stupid actually, I asked it to decode an ascii sequence and it gave me jiberish. I tried phi-4 Q4 and it got it. 9gb vs 2gb(reasoning). I imagine you just cannot fit enough information in 2gb to be of much use other than solving general math problems or knowing what training data was in it.
It gave it a good go 2min on a m2 vs phi4 which was instant.
- layer8 2y agoI’d be happy with a model not knowing ASCII if only it could properly reason instead.