3 ms·
Imagine the following scenario: If you're a wrapper around ChatGPT, summarizing ten thousand tokens costs $100. If you use an in-house net, it costs you $1 of
by sbierwagen 4y ago
Imagine the following scenario:
If you're a wrapper around ChatGPT, summarizing ten thousand tokens costs $100.
If you use an in-house net, it costs you $1 of GPU time.
Is $100 larger than $1? Think it through step by step. Show your work.