3 ms·
> This is not to say it's never technical, just that it's rare for it to be a reason. It will be a lot more technical reason from now on, when we begin to util
by npn 3y ago
> This is not to say it's never technical, just that it's rare for it to be a reason.
It will be a lot more technical reason from now on, when we begin to utilize more "AI" stuff, like language models.
all of those stuffs are slow to start, because they need time to load the huge model, so it is better to make a service that dedicated to the AI stuff, so the development of the business side do not get hold back by the slow restart cycle.
and AI is just an example, there is a lot of case when it more reasonable to split it to another service too, for example some CPU intensive tasks. Even Erlang/BEAM can't do anything about it if the code is writing in C/Zig/Rust and get called using NIF.