3 ms·
Once it ends, we will buy more GPUs because any small website will want its own. I know that as soon as I can output 100req/s on the cheap on a llama-level mod
by BiteCode_dev 2y ago
Once it ends, we will buy more GPUs because any small website will want its own.
I know that as soon as I can output 100req/s on the cheap on a llama-level model I will put it EVERYWHERE. And my clients too.
DMCA handling? Content flagging alerts? Fuzzy categorization? Natural UI for end user complex queries?
All LLM baby.
And much, much more.