Good note on a design pattern for a LLM based product. The biggest focal points will be if we see evolution of frameworks that tackle the hard parts here. Eval

Good note on a design pattern for a LLM based product. The biggest focal points will be if we see evolution of frameworks that tackle the hard parts here. Evals, RAG, Guardrails often times require recursive calls to LLM's or other fine-tuned systems which are based on LLM's. I would like to see LLM's and models condensed and bundled up into more singular task trained models - much more beneficial versus system design on using LLM's for applications. This seems like we are applying traditional system design patterns for using LLM's in practice in apps.