4 ms·
It is 100% not made up to make our SaaS more attractive. Our shared SaaS only goes up to 1M vectors, so it's not like it's cheaper anyways. We would currently c
by skeptrune 2y ago
It is 100% not made up to make our SaaS more attractive. Our shared SaaS only goes up to 1M vectors, so it's not like it's cheaper anyways. We would currently charge the raw cost + ~20% for us to host something at HN scale. Almost none of the cost is due to serving the traffic; it's all just rented high mem compute instances and GPUs. We could serve ~1k QPS on the current infra.
Our terraform and helm are public in the repo - https://github.com/devflowinc/trieve/tree/main/terraform/gcloud https://github.com/devflowinc/trieve/tree/main/terraform/gcl...