6 ms·
The Foundry pricing, $78,000 for a few months minimum, is absolutely the opposite of Open. It could completely kill my small startup if the API goes from less t
by ilaksh 4y ago
The Foundry pricing, $78,000 for a few months minimum, is absolutely the opposite of Open. It could completely kill my small startup if the API goes from less than a penny per request to requiring a huge up-front investment. It means that anyone bootstrapping is now locked out.
- layer8 4y agoThat’s the general risk of basing a startup on someone else’s service without having a solid contractual agreement, though. It’s always a gamble, in particular when the underlying service is an entirely new type of business.
- tikkun 4y agoThey only require an up front payment if you're renting a dedicated instance.
- riskneutral 4y agoDedicated instances (and high price tags, like $1.5 million per year) are necessary for large corporations to feel safe about sending their proprietary/private data to OpenAI, and to have performance/availablity SLAs in place if/when they start depending on OpenAI for critical workloads. Right now many companies are blocking access to OpenAI entirely because of the data privacy issues. I wouldn't be surprised if this "leak" is intentional and a way of getting feedback from the market on proposed product/pricing. I also wouldn't be surprised if some larger customers are knocking on OpenAI's door and demanding to run OpenAI's models on their own infrastructure to avoid sending any data outside their network.
- visarga 4y agoAbout $100K .. $200K are inference costs. They have a 10x markup.
- wmf 4y agoYeah but will "DV" be available any other way?
- bilbo0s 4y agoHave you ever heard of a "digital divide"? Well get ready to hear about an "AI divide"? Most of us are just on the wrong side of it this time.
- Nifty3929 4y ago$78k is very small, even for bootstrapped companies. Only the very smallest shops would be inhibited by that. And I admit, that's a lot of them! I get it. It sucks to be a solo developer who wants to get involved and doesn't want to spend a bunch of cash. But still, for even small players $250k annually just isn't that much. What we might hope for are trimmed down, subsidized options for small shops who want to get started, with the hope to upgrade them to the full option when they are ready. In the meanwhile, you might consider partnering up with other small startups. Also, "open" doesn't mean free. Things take a lot of effort to build and maintain, and that effort needs to be accounted for somewhere.
- eindiran 4y ago> "open" doesn't mean free Yeah but none of the other definitions of "open" apply to OpenAI either.
- tiagod 4y agoMaybe Microsoft should change their name as well?...
- dragonwriter 4y agoThe “open for business” sense certainly does.
- astrange 4y agoIt means they release research papers. People haven't had trouble reproducing their work. (Of course, GPT's model architecture was invented at Google anyway.)
- nl 4y ago> GPT's model architecture was invented at Google anyway No it wasn't. Transformers were invented at Google, but "architecture" when talking about neural networks means how they are arranged (and to some extent the training objective function) rather than the building blocks used.
- candiddevmike 4y agoThat's the risk you take when you create irreplaceable dependencies.
- xwdv 4y agoGood. I’m tired of fly by night tech bros flooding the markets with shitty AI business ideas they learned about on Youtube. Pay to play. Take a risk. Like a real entrepreneur. I hope the price goes even higher.
- meghan_rain 4y agoAnd 90% of it is "Summarize your XXX" because it's the easiest prompt on OpenAI
- 650REDHAIR 4y agoThank you, arbiter of real entrepreneurship. Tell me again about the projects you’ve launched during your time as a founder. Wait…
- inawarminister 4y agoIt's time to replicate OpenAI services with a real Open Source (or at least source-available, commercial-allowed) licenses. It's time to make our own Linux. Our own Emacs. Go to open-assistant.io and other similar initiatives. Unfortunately GPT-NEOX, LLaMA, and OPT-IML are non-commercial-only. We small scale players should make our own. Please contact me if anyone is interested in this space.
- Mistletoe 4y agoThis answers the question I’ve had. How do they make money? It was naive to think we could have all this innovation for a penny. Someone has to pay those bills. How does Bing plan to monetize searches that go through their even more advanced ChatGPT? Humans will be repulsed by ads in the middle of their answer from a sentient feeling AI. Numbers I’ve seen is that ChatGPT searches will cost 10x a Google search. How do they make it back?
- panarky 4y agoWhen you're watching a movie, and the main character picks up a can of Coca Cola while typing on a Microsoft Surface laptop, with the logos conveniently rotated toward the camera, it's obvious that Coke and Microsoft are paying the studio for product placement. AI advertising will be like this, but subtle and undetectable, so that it's nearly impossible to determine that your conversation about malfeasance by a political candidate is being invisibly influenced by his political campaign.
- lolinder 4y agoIn many jurisdictions that kind of subtle product placement is not legal.
- paulryanrogers 4y agoHow about prohibitions on product use, like Apple phones not being usable by villains?
- wnkrshm 4y agoHow do you prove that it happens and is not an artifact of the training data?
- l33tman 4y agoIf it went to court, in the discovery process the defendant will have to turn over internal emails etc.
- gateorade 4y agoWhy would you start a company that is entirely dependent on a third party’s closed product, over which you have zero control? This just feels immensely risky.
- fragsworth 4y agoIt's the only service available that does this and you want to get ahead of it. Presumably, some competitors will show up and you should be able to switch. Prices will go down as competition pops up and they make things more efficient.
- zamnos 4y agoRealistically, if you start a business, there are tons of such dependencies. If that's too scary for you, you're probably too risk adverse to be an entrepreneur.
- unclad5968 4y agoAll those dependencies usually have alternatives though
- esperent 4y agoThe issue is not having dependencies. The issue is having one specific dependency that is a beta experimental product with no viable alternative, and which will tank your company when they raise prices. Your company must always have alternatives for all third party services. The only exception is open source software that you could switch to hosting yourself if the SAAS company shuts down.
- bfeynman 4y agoShocking that you are able to even get investors with such a crude view on how business works. Starting an ancillary business related to one product that is not even your own IP or core competency is just lightweight consultancy, not a start up.
- rchaud 4y ago
- atemerev 4y agoThey are locking in their fist-mover advantage, but not for long. Everyone and their dog are currently training other AI models which might be even more competitive, some of them open source (like it’s happened with Stable Diffusion). See you on the other side.
- bluescrn 4y agoHopefully the competition will force a bit less lobotomization of future AI models, a bit less 'I'm afraid I can't do that, Dave' when asking it anything vaguely controversial.
- visarga 4y agoA significant part of that is the GPU cost: a lambda box with 8xNVIDIA A100 is $12/h. $12/h * 24 h * 90 days = $25,920 for 3 months That just the inference cost, add OpenAI's model development costs on top.
- deleted 4y ago[deleted]