11 ms·
Ask HN: How do you plan on making money with Open AI API?
It seems that compared to DaVinci, the other 3 models are pretty difficult to effectively use. I spent hours trying to get usable results with Curie, but to no avail.
I'm just curious to know from those who are building applications using Open AI APIs, how are you planning on monetizing your applications when it costs 1-2 cents to get a decent result. That is quite expensive.
- ugh123 4y agoI'm just speculating but i'm certain there will be quite a few deep-pocketed tech and finance types working out deals for lower rates. Think AWS for LLMs.
- qualudeheart 4y agoRecursive prompting works pretty well for niche websites. There is a millionaire computer scientist who sells AI written articles for 50 cents a peace. Can generate those with a few API calls.
- pesfandiar 4y agoAt this pricing, it might only make sense to embed it in a larger application (e.g. Duolingo) or use it for internal IT.
- jay-barronville 4y ago> At this pricing, [. . .] You must be talking about ChatGPT Plus? The GPT-3 API is pretty cheap in my experience
- p3opl3 4y ago$20 a month isn't that bad for Googles alternative. I've heard Microsoft are pushing a $40 a week access to the same tool. I imagine it will be token limited though.
- lm28469 4y ago> Duolingo They're already using gpt3 afaik
- muzani 4y agoCurie can roughly match davinci quality when fine tuned. Fine tuning's cost is mostly on initial training data. After that, it's half the price as davinci on paper, but you need only a fraction of the tokens. They've said they plan on making it cheaper in the future too.
- moomoo11 4y agoCan you give me some pointers to any articles or discussions about how to do this so it works? Thanks!
- muzani 4y agoI did some samples for fine tuning in this repo: https://github.com/smuzani/openai-samples https://github.com/smuzani/openai-samples The sample is in /ft/ folder, instructions at bottom of Readme. Feel free to drop an issue if it's hard to understand. I copy-pasted the instructions in 3 min so it's missing a few steps.
- moomoo11 4y agoThanks!
- bemmu 4y agoI wonder if OpenAI should offer some OAuth flow to allow users to easily grant a certain allowance of credits for an app to use (and later revoke on per-app basis). With that it would be less effort to create fun and useful little apps without needing to charge the user directly.
- kinlan 4y agoWhile I like the idea, it feels like it defeats the point of the question. How likely is it a person will know what open ai is, be willing to set up billing and then also pay you separately?
- ilaksh 4y agoI am pretty sure someone is already working on a GPT Bot World or something where you buy Chat Credits and then can talk to any bot in the marketplace (built by users who bring custom prompts etc.). I mean, its a pretty obvious idea. Its possible that there are several such startups booting up right now.
- jasfi 4y agoI'm building a product using their APIs. Aiming to launch this month: https://inventai.xyz https://inventai.xyz. The UI will set it apart, and more features are going to be built after launch to further differentiate InventAI from other products.
- Double_a_92 4y agoI found out that it is really good at recommending Movies or Series, based on things that I liked. Maybe that could be turned into something.
- Traubenfuchs 4y agoUniversal daily life decision support system: Recommends you stuff you might like in any category, including but not limited to: tv shows, music, food, porn actors...
- p3opl3 4y agoThis is really interesting!
- thom 4y agoPerhaps a much better question is ‘how do you plan on making money from people who plan on making money from ChatGPT?’
- ge96 4y agoYou make courses
- mtmail 4y agoOr a marketplace to share prompts (actually exists, I saw a Show HN).
- open-source-ux 4y agoUse ChatGPT to assist write or plan a course from 50-80% (or more) is likely a popular option. Create a syllabus for learning [insert subject] https://www.youtube.com/watch?v=tVxy1QDYapQ https://www.youtube.com/watch?v=tVxy1QDYapQ
- raducu 4y agoAs someone not familiar with ChatGPT APIs -- what would prevent Open Ai to do to their customers what Amazon does to independent sellers on Amazon -- that is look over their sales numbers and just copy the products that work, but you know, actually use a private model that works event better than the original product?
- btheshoe 4y agoOpenai is a bunch of scientists. And their product is not exactly unique - all the major cloud vendors will have a chatgpt available soon. So openai won't copy for the same reason AWS can't copy all of its customers - presumably the ppl building the product are better at building that product than, like, a room full of scientists.
- tyre 4y agoSam Altman is not a scientist.
- ge96 4y agoOne I've been seeing recently (regarding AI generated images) is people making up "fake movies" they blatantly say it's not a real movie... but you produce these videos with text to speech audio... ehh it sucks content farms/waste of bandwidth but whatever. Just like the people restreaming a live nasa page or restreaming spacex/etc... oh well. It's like those movie summary channels idk why those get under my skin... just a waste. Oh here's an example Chrome Lords 1988 on YT saw this one recently Maybe I'm annoyed because it works. You take a bunch of public things like public images of airplanes and make several channels/videos on each plane and facts... you could automate this and eventually something will work. The TTS voice from medium in particular (guy voice).
- awongh 4y agoHere's the link in case anyone's curious: https://www.youtube.com/watch?v=rpywI2WmcqM https://www.youtube.com/watch?v=rpywI2WmcqM I really liked this video, I see your point!
- noam_compsci 4y ago1. Buy Microsoft stock. 2. (not me personally) Tuning and personalisation of LLMs. - As a company, I want private data to be combined with internet-scale data so that I can get actionable data - As a company, I want internal identity management to secure who is told what by the LLM that is trained on private data. 3. (not me personally) Quick buck. Skin + API call + marketing = short term cash until people clock on that it is cheaper elsewhere.
- xcubic 4y agoI dont understand 3.
- urbandw311er 4y agoHe/she means white label the ChatGPT UI using their API under the hood.
- atmosx 4y agoAppStore and Google Store are already full of apps that are ChatGPT3 with a skin and charge monthly fees for that.
- naikas82 4y agoMake any FAQs and Tech Documentation humanish interactive. What say?
- ilaksh 4y agoThere are multiple sites doing this right now with the OpenAI API. Its a good idea.
- zapperdulchen 4y agoDo you have any good examples?
- PhilAtHN 4y agoJust yesterday I released a new feature for https://www.clozetesting.com https://www.clozetesting.com - one can now create gap-filling exercises using AI. E.g. create a story based on keywords, or generate a dialogue or example sentences regarding a specific grammar theme (e.g. superlatives). I hope teachers are going to love this. Check out the demo video https://youtu.be/ur3fP2xfDEY https://youtu.be/ur3fP2xfDEY
- jacob_rezi 4y agoWe've been working to solve the resume and have seen 10X more job seekers use it in the past few months - https://www.rezi.ai/ https://www.rezi.ai/
- WheelsAtLarge 4y agoI don't think there's a money making play with Chatgpt for the small guy. The move is to improve your output by having it help you with your tasks and adding it's functions to existing apps. It reminds me of the browser. With browsers there is no money making move but you can use it to improve your work. That and you can't trust the output. Someone needs to babysit it.
- p3opl3 4y agoSome browser extensions make a ton of money.. Honey for example.. they got bought by Paypal.
- jsemrau 4y agoUsing similar tech (Named Entity Recognition, Keywords, Summary ,etc) for finclout.io and are currently evaluation GPT3 for same. At this time, our tech is still more fine-tuned to the task. But we are evaluating GPT3 for earnings call summaries and comparisons.
- hubraumhugo 4y agoIMO one of the killer use cases of GPT is reformatting information from any format X to any other format Y, and we're using this superpower in the relatively "boring" space of data extraction: https://kadoa.com https://kadoa.com allows you to extract any data from any website in the format you want.
- nasmorn 4y agoWould this be able to get image urls as well? That has consistently turned out to be the most time consuming part of scraping eg e-commerce pages
- hubraumhugo 4y agoYes, we can extract URL images too :) Feel free to sign up for early access if you have a specific use case.
- mahathu 4y agoHey, that's my niche as a freelancer on upwork. You took my job! shakes fist
- arnath 4y agoWoah, this is super cool. Do you have a live example of the website scraping?
- lonelyasacloud 4y agoNeat. Guessing a similar trick could be used to make UI testing, i.e. less brittle version of Selenium etc ...
- schizo89 4y agoAI talent obviously
- dboreham 4y agoBy engaging in SEO against it? (I say this because that's the way to make money from Google search).
- jstrebel 4y agoChatGPT is just the beginning and a glimpse of what is to come. In its current form, it is rather generic and more of a tech demo. In the future, we will see much more specialized AI applications based on ChatGPT or similar technology, that are geared towards attractive use cases: - software developer support (StackOverflow on steroids) - News aggregation - the automatic newspaper editor or blog curator - Legal support - automatic law clerk All jobs that use natural language as a tool or resource are fair game.
- codeulike 4y agoA plugin for Microsoft Teams called "Waffle" that watches the transcript of the meeting. If you suddenly realise you have been asked a question, or are supposed to say something, but you havent been paying attention, you press the "Waffle" button and ChatGPT feeds you some anodyne lines to say, based on the last few minutes of the meeting transcript. Well I think you've all raised some really interesting points, maybe we should circle back and think about the new issues listed in the risk register
- Havoc 4y agoThat's brilliant. Someone would absolutely make bank with that
- dutchbrit 4y agoJust have to hope OpenAI isn't having a capacity issue when you get asked a question haha but a pretty good idea overall.
- weberer 4y agoTeams is notoriously bad software, so you can just say "Sorry, my Teams cut out again. Could you repeat that?" And everyone would believe you.
- codeulike 4y agoThing is, if you've really not been paying attention, having someone repeat the last sentence or question is not sufficient. For example you might end up making a point that had just been discussed, and end up looking clueless. What you really need is to grok the last five or ten minutes of conversation, and ChatGPT is great at that
- hgarg 4y agoNot sure what's your use case but have you tried fine tuning the cheaper models?
- boredemployee 4y agoAnother issue that no one is talking about is the quota limit. Say you build a succesful product with thousands of people using at the same time. How to get around the usage limit?
- remorses 4y agoincrease prices to lower demand
- deleted 4y ago[deleted]
- serjester 4y agoIt’s pretty simple to request a quota increase
- boredemployee 4y agoDidn't know it was that simple. Because I was using a service [1] that runs on top of Open AI and was down for 3 days. They told us they were down because of the quota limit. [1] https://twitter.com/explain_paper/status/1620185211127595008?s=20&t=17Ls1tMln8kt9xEh8dxT9A https://twitter.com/explain_paper/status/1620185211127595008...
- kiviuq 4y agomake it about beauty and fashion to attract females... (skincare routines, beauty advice... ) integrate it into an ecom or recom platform AI aided shopping "experience"
- vladstudio 4y agoI'm doing design for the team at Kadoa [0] which uses AI API to extract unsctuctured data from whatever sources you throw at it, and prepare it for further automated processing. Seems like a valid use case. https://www.kadoa.com/ https://www.kadoa.com/
- dutchbrit 4y agoFocus on other things while everyone else is jumping on the AI train.
- cactusplant7374 4y agoIt's interesting that none of the responses so far include: make a novel discovery that changes the world. There are productivity gains in some ways I suppose. Using the models may be cheaper than hiring a human. But it looks like this won't become AGI because it has no understanding of the training data.
- JohnFen 4y ago> make a novel discovery that changes the world Probably because that's a lightning-strike sort of event that you can't really plan on.
- spaceman_2020 4y agoAll the ideas I can come up with somehow involve…spam.
- holografix 4y agoHow well would it do as a “expert system” trained only in literature for a particular field. Say medicine? “Doctor GPT3 I feel faint whenever I eat a muffin…”
- ilaksh 4y agohttps://github.com/microsoft/BioGPT https://github.com/microsoft/BioGPT
- keizo 4y agoI’m making a note taking app… sustainable income would be nice, but in the meantime it’s a fun project grugnotes.com
- supermatt 4y agoIm using GPT-3 to enhance specific features. Users only have adhoc need for those features, so the cost is negligible, but the value is great. i.e. the product isnt based around GPT, but uses it in specific low-volume places.
- juliensalinas 4y agoSmaller models like Curie can work quite well too. But they are less "instruct-like" models so you will need to properly use few-shot learning (aka "prompt engineering") in order to get good results: https://nlpcloud.com/effectively-using-gpt-j-gpt-neo-gpt-3-alternatives-few-shot-learning.html https://nlpcloud.com/effectively-using-gpt-j-gpt-neo-gpt-3-a... I takes a bit more work though, and it makes your requests bigger so more expensive.
- 2OEH8eoCRo0 4y agoHow does OpenAI protect sensitive information that is sent to them? This seems like a scandal waiting to happen.
- verdverm 4y agoEspecially given they have already had issues aligning requests with responses, sending other people's replies to your queries https://news.ycombinator.com/item?id=34527029 https://news.ycombinator.com/item?id=34527029
- MrMan 4y agotheir intent is to exploit that data not "protect" it whatever that means
- tooltitude 4y agoMy likely unpopular opinion is that it will be hard to make money with Open AI API. The main moat, i.e. competitive advantage in such applications is the model, and infra serving it. Application won't be that hard to reproduce. If you find a good application with more or less wide market, it will be quickly copied by larger players. Also, the majority of profits will likely go to OpenAI unless there will be other competing providers.
- super256 4y ago> Application won't be that hard to reproduce. I wouldn't build a whole application around OpenAI either, but I could imagine that OAI could be leveraged for single features, maybe where the user doesn't even know it's AI(). I could imagine content moderation, converting between file formats, or reading sentiment from user tweets about a company. Maybe the huge value of OpenAI isn't lying in generating new content, but cutting costs of existing abstraction tasks. So, no content generation, as that would be unethical without disclosure of AI usage.
- tooltitude 4y ago>I could imagine that OAI could be leveraged for single features That's a possible application which won't be easily copied by the large company. But the value of such features is quite limited. > I could imagine content moderation, or reading sentiment from user tweets about a company. I am pretty sure that these services will be provided soon by large companies and OpenAI. They are generic enough to have wide market, and many of these companies already have expertise in them. >So, no content generation, as that would be unethical without disclosure of AI usage. Why unethical? I think these systems could create real content which is useful to everyone as well as spam content could be generated by humans.
- super256 4y ago> I am pretty sure that these services will be provided soon by large companies and OpenAI. They are generic enough to have wide market, and many of these companies already have expertise in them. Well, content moderation on your already existing venue (internet board, discord or whatever) can't be taken away, really. Is a sentiment indicator would be implemented into e.g. TradingView.com, it couldn't be copied either, because most subscribers are in for the main application. It would just be a small feature to justify upselling or whatever. > Why unethical? I'm specifically talking about content generation without disclosure. Imo it's fine to generate content as long as you clarify it for the reader that they are reading a text generated by AI. This is also in line with OpenAI's terms of service: "The role of AI in formulating the content is clearly disclosed in a way that no reader could possibly miss, and that a typical reader would find sufficiently easy to understand." https://openai.com/api/policies/sharing-publication/#content-co-authored-with-the-openai-api-policy https://openai.com/api/policies/sharing-publication/#content...
- Jomaster 4y ago[dead]
- osigurdson 4y agoMy idea is to leverage ChatGPT for "thought aggregation". For example, say there are 10K comments on a particular post or video (or any topic). We usually don't value thoughts from "the masses" very much but there could be important ideas emerging / buried in these comments. ChatGPT LLMs could likely be leveraged to aggregate these comments into themes and summarize them in a meaningful way. One way to think about this idea is multiple choice surveys are great because they are easy to summarize. Their weakness is they overly constrain responses and the aggregated results may not accurately represent the opinions of the people being polled. The idea is to reverse engineer something like survey from free form comments.
- nativespecies 4y agoThis could be helpful for long Reddit posts on subs where there are product recommendations or reviews. I could see a utility where you summarize key takeaways on Yelp (what are the best dishes at this restaurant?), TripAdvisor (top complaints about this hotel with 800+ reviews), etc. Not sure if that makes sense, I am a marketer not an engineer :) - if you do this, let me know, I would definitely use it
- osigurdson 4y agoAnother one would be to (somehow) filter out fake reviews. I'm not sure how to leverage ChatGPT to do this but this is obviously a major problem. However, a person could read the 800 reviews and (given enough time) could likely summarize the more important aspects with some accuracy. They may even be able to filter out some of the obviously fake reviews. This information has value but the costs are (currently) too high to obtain. Perhaps LLMs/ChatGPT could improve the equation.
- osigurdson 4y agoEven on this thread it would great to filter out cynical/nihilist/humorous type comments. Not saying that there is no value in these but certain audiences would like to filter these out depending on mood.
- mattbrewsbytes 4y agoHere's my guess: ad money. Generating loads of mediocre, simple articles for SEO purposes for ad money. Then you can hire other kinds of bots to pump up your page views. If someone is smart about it they will target articles in the topic of "ways to make money online/passive income" (which is mostly click bait but also pays the most) and then produce videos on YT to push people to their content. ChatGPT can write your video script, probably farm it out to voice actors, add some free b-roll video and post it for you.
- client4 4y agoWord wiggler. Pipe chatGPT from one computer to another via keyboard emulation and fool the corporate spy software with long email drafts that take you hours.
- serjester 4y agoI quit my day job and created an email auto reply extensions back in September using GPT-3 and we had a couple hundred people use it. My running total for OpenAI didn’t exceed $20 (their free tier) until a couple weeks ago. The cost of intelligence is going to 0. The problems most companies in the space are solving are “nice to haves”. The real money is building products that aren’t for a tech adjacent audience. I’ve seen so many interesting use cases and I just had another person reach out who’s debating hiring staff (previously tried) and wants to see what AI can do. With some custom training we can completely automate aspects of his business. We’re talking about a potential 10k+ customer. I’m convinced there’s millions of these.
- amecon 4y agoLevered long MSFT
- tripplyons 4y agoHow about NVDA?
- dgudkov 4y agoNot plans yet. Still figuring out how to make money on Stable Diffusion.
- lee101 4y agoI built my own OpenAI compatible alternative, https://text-generator.io https://text-generator.io to help with that pricey ness. Also self hostable which helps people cut costs. It also analyses linked web pages and image content automatically so helps people build these web integrations or auto img alt tag describers or reiept analysers etc without doing as much of the prompt engineering/crawling themselves.
- hrayn3 4y agoI built a travel-planning site over Christmas: https://www.daystodo.com/ https://www.daystodo.com/ I'm planning on posting a blog about my experience here at some point, but it was fun. You can find a draft of it on the site if you're interested in my thoughts on using it as datasource for an app. Basically, I agree - you need to use DaVinci to get good results and it's expensive. That means restricting the amount of queries a user can make (I do it through restricting the inputs a user has) and saving the results, so other users get the saved results instead of hitting OpenAI. For more free-form inputs, I think the only option is to make users pay a small fee (which is tough, because even DaVinci struggles sometimes and I don't want users paying for errors). I'm also experimenting with AdSense but I doubt it'll cover the costs. I wouldn't say I plan to 'make money' but with luck it might be my first side-project that will break even