>But I rarely see an objective accuracy comparison. There are some perplexity comparison numbers for the previous gen - Orange pi 5 in link below. Bit of a mi

>But I rarely see an objective accuracy comparison. There are some perplexity comparison numbers for the previous gen - Orange pi 5 in link below. Bit of a mixed bag, but doesn't seem catastrophic across the board. Some models are showing minimal perplexity loss at Q8... https://github.com/invisiofficial/rk-llama.cpp/blob/rknpu2/ggml/src/ggml-rknpu2/README.md https://github.com/invisiofficial/rk-llama.cpp/blob/rknpu2/g...