2 ms·
This is actually pretty easy to do with local LLMs: https://justine.lol/matmul/#:~:text=For%20example%2C%20let%27s%20say%20you%20want%20to%20setup%20an%20email%
by pr337h4m 2y ago
This is actually pretty easy to do with local LLMs:
https://justine.lol/matmul/#:~:text=For%20example%2C%20let%27s%20say%20you%20want%20to%20setup%20an%20email%20server%20on%20your%20pihole%20and%20have%20TinyLLaMA%20filter%20spam https://justine.lol/matmul/#:~:text=For%20example%2C%20let%2....
- caseyy 2y agoIt's not a large project, but you would need fine-tuning or a lot of few-shot examples to approach SpamAssassin's efficacy. It would still be slower than SpamAssassin. This is one of those "X but with LLM" ideas :) As far as I know, Gmail has a neural net which is trained by examples from people reporting spam. That is a more potent approach. If you're going to restrict the output grammar to 'true or false', why even run a giant net? You could achieve the same loss with a much smaller one.