2 ms·
gpt-oss:20b is the best performing model on my spam filtering benchmarks (I wrote a despammer that uses an LLM). These are the simplified results (total percen
by jwr 1y ago
gpt-oss:20b is the best performing model on my spam filtering benchmarks (I wrote a despammer that uses an LLM).
These are the simplified results (total percentage of correctly classified E-mails on both spam and ham testing data):
gpt-oss:20b 95.6%
gemma3:27b-it-qat 94.3%
mistral-small3.2:24b-instruct-2506-q4_K_M 93.7%
mistral-small3.2:24b-instruct-2506-q8_0 92.5%
qwen3:32b-q4_K_M 89.2%
qwen3:30b-a3b-q4_K_M 87.9%
gemma3n:e4b-it-q4_K_M 84.9%
deepseek-r1:8b 75.2%
qwen3:30b-a3b-instruct-2507-q4_K_M 73.0%
I'm quite happy, because it's also smaller and faster than gemma3.