3 ms·
This is still down the path of running your own infra which is a choice the inference consumer needs to make regarding the setup they have and if the management
by cryptolibertus 1y ago
This is still down the path of running your own infra which is a choice the inference consumer needs to make regarding the setup they have and if the management is worth it. We are also looking into how to encrypt or privatize prompts with inference providers to maintain privacy of your data. Infer.bid is more about having an open marketplace of inference providers to compete on price for your business. In the future your app/biz organization might just need inference and not have the hassle of maintaining the infra for it. Instead you could just consume inference like electricity.