3 ms·
also means that OpenAI can just swap in Llama 2 and increase their capacity by orders of magnitude this is the age (or year) of token price arbitrage
by yieldcrv 3y ago
also means that OpenAI can just swap in Llama 2 and increase their capacity by orders of magnitude
this is the age (or year) of token price arbitrage
- croddin 3y agoThis is ignoring OpenAI's margins. We don't know how much GPT-3 and GPT-4 actually cost for them to run but it isn't what they are charging us. For Llama 2 the quoted cost is just compute, but for OpenAI you are also paying for using their software.
- waleedk 3y ago[Author] As an end user, you pay the published price of $1 per million tokens for alternatives (such as Anyscale Endpoints -- https://app.endpoints.anyscale.com/landing https://app.endpoints.anyscale.com/landing, but there are others -- Replikate, Fireworks etc). This isn't just the compute price -- there's some margin in there as well.
- the-dude 3y agoIIRC Facebook explicitly licensed against that use case.
- yieldcrv 3y agoDid they? For llama 2? I remember the first llama license
- samspenc 3y agoPer the Llama 2 license, companies with "greater than 700 million monthly active users in the preceding calendar month" must get approval and permission from Meta to use it. For OpenAI - that is very interesting though. The 700M cap means the big FAANG+ companies that Meta competes with - Google, Apple, Amazon, Netflix, even Microsoft - can't use Llama 2. But OpenAI has less than 700 million users? So theoretically, if Llama was better than GPT models, OpenAI could replace their GPT engine with Llama :)