3 ms·
yes i keep on trying small models, i have also tried qwen 3.5 0.8B, 2B, 4b and gemma4 e4B models but they either did not worked reliably (thinking loop, issue i
by pdyc 5mo ago
yes i keep on trying small models, i have also tried qwen 3.5 0.8B, 2B, 4b and gemma4 e4B models but they either did not worked reliably (thinking loop, issue in following instruction) or there were performance issues (prompt speed, tg speed, too much ram) e2b was the sweet spot where i could give it plan and it can edit files properly.
- 2ndorderthought 5mo agoThat makes sense it sounds like your computer isn't super powerful. Whatever works for you
- Melatonic 5mo agoHow did e2b compare to e4b ?
- pdyc 5mo agoi did not see much improvement for my use case i.e. file editing tasks but with e4b tg/s is lower so i stick with e2b.