4 ms·
This looks great. The demo is very fast. Is it static generated or is it reading the sql db?
by meekaaku 5mo ago
This looks great. The demo is very fast. Is it static generated or is it reading the sql db?
- jcfrei 5mo agoThanks. The demo itself is prerecorded - so no LLM calls. It's just replaying from the sql db. In an actual request it isn't much slower though in finding what tools to use, etc. You can test it btw. I've allocated an hourly budget - anything that you query after the demo goes to an actual LLM.