3 ms·
very much agreed re: dust settling. it makes no sense deploying any of these libraries to prod. as-is. best to understand a configuration / workflow / tuning /
by riter 3y ago
very much agreed re: dust settling.
it makes no sense deploying any of these libraries to prod. as-is. best to understand a configuration / workflow / tuning / etc. that fits your data best and write it from scratch in golang/rust/whatever.
- Dowwie 3y agoAre these computationally expensive operations? If not, Elixir could fit.
- krishadi 3y agoThey are not all computationally expensive. The rate limiting step here is the LLM call itself over the API. So, async is definitely needed. The other aspects would be loading the template from filesystem. I would assume this could be something that's needs to be optimized in the application.