The use case is building apps. A small LLM can do RAG, call functions, summarize, create structured data from messy text, etc... You know, all the things you'

The use case is building apps. A small LLM can do RAG, call functions, summarize, create structured data from messy text, etc... You know, all the things you'd do if you were making an actual app with an LLM. Yeah, chat apps are pretty cheap and convenient for users who want to search the internet and write text or code. But APIs quickly get expensive when inputting a significant amount of tokens.