3 ms·
One of the things that strongly resonate with me is the "text templating" part. I faced the same thing when i was building my AI application. Most SDK/framework
by sandGorgon 3y ago
One of the things that strongly resonate with me is the "text templating" part. I faced the same thing when i was building my AI application. Most SDK/frameworks for writing generative AI model this as libraries (or even React UI widgets).
I think that is wrong - it is a config management problem. Think Prompts X Chains X LLMs. Your prompts wont work across everything and everything will break on model change. Coding this into ur classes is what everyone does.
Instead we pull out the prompts X chains as jsonnet code. Call it trauma & learnings from the K8s/Borg world. We have formats that have evolved as a result of millions of lines of code wrangling clusters/terraform/etc - so we decided to build a SDK over it.
that is what we did here - https://github.com/arakoodev/EdgeChains/releases/tag/0.2.0 https://github.com/arakoodev/EdgeChains/releases/tag/0.2.0
EdgeChains is basically Generative AI prompt engineering modeled as config management. Funnily people organically build this out over 6 months of engineering AI applications. That's what Martin did with templating this as text !!