4 ms·
As the part owner of a company using local LLMs we're getting real value out of 27b sized models. I'm saving $1000/mo vs throwing a frontier model at a rather s
by bot403 2mo ago
As the part owner of a company using local LLMs we're getting real value out of 27b sized models. I'm saving $1000/mo vs throwing a frontier model at a rather straightforward (for AI) automation need.
The trick is acknowledging they're B or C tier intelligence and speed and using them accordingly.
- t3hTao 2mo agoAs a small business you must be really really small to only be at $1000/mo token spend. Part time/side gig?