3 ms·
Automatic111 is the domain of Jupyter - desktop experimentation. When you go into production, there are tons of additional pieces of complexity that start hitti
by sandGorgon 3y ago
Automatic111 is the domain of Jupyter - desktop experimentation. When you go into production, there are tons of additional pieces of complexity that start hitting you - like prompt routing. So the problem space is different.
We have a simple concept - Generative AI is config management. We model it on top of config management grammar that is proven to work in large production config - jsonnet.
A trivial example is this - https://github.com/arakoodev/EdgeChains/blob/main/Examples/redis-chat.jsonnet https://github.com/arakoodev/EdgeChains/blob/main/Examples/r...
Do u think this is something that works for you ?