3 ms·
People cant do that because of cost. If every single query involved taking everything even remotely related to the query, and passing it to OpenAI, it would get
by altdataseller 2y ago
People cant do that because of cost. If every single query involved taking everything even remotely related to the query, and passing it to OpenAI, it would get expensive very very fast.
Its not a technical issue, its a practicality issue imo.
- solidasparagus 2y agoThat's very true. Although it is feasible if you are well-resourced and make the investment to own the toolchain end-to-end. Serving costs can be quite low (relatively speaking) if you control everything. And you have to pick the correct problem where the cost is worthwhile.