4 ms·
It’s not “trivial” because of the cost per query. As far as Google, it doesn’t even have access to the most valuable phone users without paying Apple $18B+ a y
by scarface74 4y ago
It’s not “trivial” because of the cost per query. As far as Google, it doesn’t even have access to the most valuable phone users without paying Apple $18B+ a year.
- endisneigh 4y agoSomething can be both expensive and trivial. If the market is huge they will bear the cost. The tech is well understood even now. The parameter size will likely be an order of magnitude less for gpt4 level results in a few years
- scarface74 4y agoIf the fixed cost was huge, you would have point. But the variable costs are also huge. I’m sure the market is also huge for dollars sold for 95 cents.
- endisneigh 4y agoit's really not that huge. unlike most companies, people are willing to pay if it's Apple. they can roll it into the iCloud subscription
- scarface74 4y agoThat doesn’t help. You’re still making something that has a high variable cost into something that the user only is paying a fixed cost for.
- endisneigh 4y agoI never said anything about the user only paying a fixed cost
- scarface74 4y agoSo how well will it go over if the average consumer is nickel and dimed for every $x number of queries?
- fillipvt 4y agoNot sure about "the tech is well understood" given the LLM itself is a black box in regards to how it works internally, even Microsoft researches admit it (Sparks of Artificial General Intelligence: Early experiments with GPT-4).