20 ms·
ChatGPT's API is so good and cheap, it makes most text generating AI obsolete
- johnrushx 4y agoAI-driven tools like replit, marsx.dev, and github copilot are going to completely transform our industry.
- lee101 4y ago[dead]
- brownfox 4y agoDespite the affordable API, complex contexts can result in excessive token usage and potentially exceed the token limit, leading to high costs. Balancing a responsive and cost-effective system while adopting a large knowledge base remains a challenge.
- sposeray 4y ago[dead]
- superkuh 4y agoThis might be true for the type of business and institutional uses that can operate under the extremely puritanical filters that are bolted onto gpt3.5-turbo. But for most human person uses the earlier text completion models like gtp3 davinci are incomparibly better and more responsive. But also 10x as pricey. Still, it's worth it compared to the lackluster and recalcitrant non-output of gpt3.5-turbo. I think over the next couple months most human people will switch away from gpt3.5-turbo in openai's cloud to self-hosted LLM weights quantized to run on consumer GPU (and even CPU), even if they're not quite as smart.
- abraxas 4y agoI have a hard time imagining anything that comes even close to ChatGPT being able to run on consumer hardware in the next couple of years
- superkuh 4y agoThat's what I thought 2 weeks ago. I figured it'd be ~5 years before I could do anything at home. But already people have the leaked facebook llama weights running on CPU w/under 32 GB of system ram doing a token a second or so.
- riku_iki 4y agothat llama is likely much smaller than chatgtp
- minxomat 4y agoThe whole point of the LLaMa paper is that large models are undertrained and oversized.
- riku_iki 4y agonot sure where did you get it, but they trained 65b llama too, which outperformed llama 7b on their benchmark.
- ShamelessC 4y agoHere is the paper and synopsis: https://arxiv.org/abs/2302.13971 https://arxiv.org/abs/2302.13971 > We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. We train our models on trillions of tokens, and show that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets. In particular, LLaMA-13B outperforms GPT-3 (175B) on most benchmarks, and LLaMA-65B is competitive with the best models, Chinchilla-70B and PaLM-540B. We release all our models to the research community.
- riku_iki 4y agowhat's your point? If you read actual paper you will see that 65B outperforms that 7B which was discussed above, and size matters.
- echelon 4y agollm-nasty will find a way. Stable Diffusion broke free of the shackles and was pushed further than DALL-E could have ever hoped for. Just wait. People's desires for LLMs to say spicy things and not be controlled by a single party will make this happen yet again. And they'll be more efficient and powerful. Half the research happening is from "waifu" groups anyway, and they'll stop at nothing.
- isatty 4y agoExactly, there is so much money to be made by generating porn that it’ll be done by this year.
- yieldcrv 4y agoseriously. entertain the humans.
- deleted 4y ago[deleted]
- echelon 4y agoVCR, cable, internet, usenet, web, streaming, VR... There are so many technologies that were propelled forward because of it, not in spite of it. Twitter, Reddit, Tumblr... Tumblr learned a hard lesson when they tried to walk away.
- zirgs 4y agoFeeding the AI lots of porn is one way to fix broken fingers.
- Spivak 4y agoOr just keep using davinci because is it’s also really cheap all things considered. I was excited about getting 1/10th the cost but also came to the same conclusion as you as turbo can’t actually do anything. I could care less about getting it to write porn or nazi propaganda but good lord it can’t even write code, do line edits or follow instructions more complicated than simple call/response.
- tracyhenry 4y agowhat is an example that you can do with Davinci, but not chatgpt? In my limited experience with prompting you can ask chatgpt to do a lot of things
- superkuh 4y agogpt3.5-turbo fails the turing test due to it's constant butt covering. Davinci can pass for a human. I am speaking only of the API responses. The "chatgpt" web interface is something different.
- superkuh 4y agoMy use case is IRC bots. If you just have the bot responding to only a single line and not knowing any of the chat history, yeah, it can be fairly cheap. But once you try to start giving it short term memory by feeding in the prior ~handful of lines you blow through that $18 of free credit in a couple weeks. Something that costs $25/mo is not cheap for a human person. I am not happy with your implication that gpt3.5-turbo only doesn't respond to "nazi" stuff and that my users are such people. But I guess getting Godwin'd online isn't new. It literally won't even respond to innocuous questions.
- Spivak 4y agoWhat kinda volume are you pushing though because I also do that and even have it ingest whole pdfs/word docs as conversation context and I get charged like $3/mo on average. Edit: I’m literally agreeing with you and describing innocuous questions that it doesn’t respond to. I’m saying that if all it refused to do was write hate and erotica it would be fine and I would use it but the filter catches things like code.
- faizshah 4y agoIts actually good for most human person uses too like writing or learning. I’ve never encountered it refusing to do a task in my actual work. I would guess the risk to their brand vs the number of actual applications of the unfiltered ai makes it an obvious trade off. I mean who turns off google safe search when writing an essay or lyrics?
- zamnos 4y agoWait, there are people that aren't children that actually have SafeSearch turned on as more than an accident? Not trying to be insulting, I just genuinely have it turned off in my settings and haven't noticed any of my search results being particularly NSFW and assumed everyone else did too.
- deleted 4y ago[deleted]
- kayodelycaon 4y agoIf the default is on, most people would have it on.
- bilbo0s 4y agoIf the default is off, most will have it off. If the default is on, most will have it on. All of which to say, no one cares, and google very likely knows that. Google will only care if enough of their users care. And they will probably operate in a fashion that keeps the maximum number of their users in the "don't care" camp. It's just business.
- IIAOPSW 4y agoThe default is moderate, which seems to mean "filters irrelevant porn from innocent queries"
- coldtea 4y ago>I mean who turns off google safe search when writing an essay or lyrics? Adults?
- tracyhenry 4y agoA couple months might be too soon imho. But I hope that in 2-3 years there will be a model with similar performance but much smaller size, small enough to run incredibly fast inference + training on my laptop. OpenAI might need to rethink their moat in case that happens. Think about all the smart ML researchers in academia. They can't afford training large models on large datasets, and their decades of work is made obsolete by OpenAI's bruteforce approach. They've got all the motivation in the world to work on smaller models.
- soulofmischief 4y agoI actually don't think that we will make significant advancements in reducing model size before we make significant advances in increasing available power and compute. One reason is that the pressure is still on for models to be bigger and more power hungry, as many believe compute will continue to be the deciding factor in model performance for some time. It's not a coincidence that OpenAI's CEO, Sam Altman, also runs a fusion energy r&d company.
- flangola7 4y agoBut processing hardware has been seeing diminishing returns for years. My CPU from 2013 is still doing what I need; a 1993 processor in 2003 would have been useless. Where do you see hardware improvements coming from?
- stormfather 4y agoSpecifically in AI there is huge room for improvement with things like optical computing. AI processing doesn't need to be completely deterministic, as shown by the fact that we are quantizing llama down to 4 bit without too much of a drop in performance. Once you drop that requirement you open the door to using much, much more efficient analog circuits. How do I invest in optical computing...
- ChatGTP 4y agoCan’t ChatGPT design better hardware ?
- LeoPanthera 4y agoIt doesn't matter that the older model will happily generate text to make your grandmother blush. The usage policy specifically says you can't do that. They even provide an API endpoint for checking whether the input, and output, is allowed or not. There's nothing stopping you from ignoring it, except for the certainty that OpenAI will simply block you.
- deleted 4y ago[deleted]
- FuckShadowBans 4y ago[dead]
- margorczynski 4y agoWhat's the catch? How do they plan to make money out of it? Or maybe the plan is to use the massive amount of data gathered to make it better for e.g. Bing search? Cut out the competition before it has a chance to flourish? Companies, especially giant publicly traded ones like MS (the de facto owner of OpenAI) don't give out freebies.
- overcast 4y agoThe API is a paid service, like all the other APIs.
- alpark3 4y agoI believe his underlying assumption is that the API is so cheap that there's no way they're making money off of it. Yes it's paid, but doesn't matter if they're losing money on every API call.
- ianmcgowan 4y agoIf they're selling below cost, it doesn't matter. When you're selling a dollar for 90 cents, it's hard to make up for that in volume.
- scottLobster 4y agoIt's not like there are individual units of ChatGPT. With enough subscribers they could sell it for 1 cent per month and profit.
- supermatt 4y agoNot sure what you mean by “individual units” but the suggestion is that it costs more than they charge. i.e it’s not profitable, and the more they sell the more they lose.
- scottLobster 4y ago
- ApolIllo 4y agoWhen will they raise prices?
- nateburke 4y agoWhen the PR gains from widespread adoption no longer cover the costs.
- kkielhofner 4y agoAs soon as there’s a reliable base of foundational services/orgs/products/startups built on top of it. Especially with this edge, for now, it’s Hotel California.
- jonatron 4y agoI pasted the article into a Markov Chain: exist generative text unfortunately with the current recognition of its creation which uses the chatgpt api which can confirm the media has weirdly hyped the upcoming surge of ai generated content its hard to keep things similar results without any chatgpt to do much better signalto-noise. -- Is ChatGPT just an improved Markov Chain?
- TechBro8615 4y agoI guess if you squint, it kinda is, in the sense that it generates one token at a time.
- nerdponx 4y agoIt's not a Markov chain because by definition a Markov chain only looks at the previous word. ChatGPT looks at a long sequence of previous words. But the general idea is still broadly the same.
- xwdv 4y agoHence why you have to squint.
- Accujack 4y agoActually, it looks at all the meanings of the tokens within its window.
- PartiallyTyped 4y agoThat's not correct. In a Markov chain, the current state is a sufficient characteristic of the future. For all intents and purposes you can create a state with sufficiently long history to look at a long sequence of words.
- nerdponx 4y agoAlso fair, but then the "current" state would also be a long window/sequence. Maybe that interpretation is valid if you look at the activations inside the network, but I wouldn't know about that.
- zibzob 4y agoDoes anyone know if there's a way to use this technology to help understand a large codebase? I want a way to ask questions about how a big unfamiliar codebase works. It seems like ChatGPT isn't trained on open source code, so it can't answer questions there. When I asked it how something works in the Krita source, it just hallucinated some gibberish. But if there's a way to train this AI on a specific codebase, maybe it could be really useful. Or is that not possible with this type of AI?
- scarface74 4y agoIt “knows” the AWS API, CloudFormation and from what others have told me the CDK pretty well. I’ve asked it to write plenty of 20-30 line utility scripts and with the proper prompts, it gets me 95% of the way there. I assume it would “understand” more popular open source frameworks.
- vorticalbox 4y agoIn this case you can feed it bits of code you're interested in and ask it to explain, the API has a limit of 4096 tokens (which is a good chunk of text). I actually built a slack bot for work and daily ask it to refactor code or "write jsdocs for this function"
- zibzob 4y agoYeah, and this is pretty useful for small bits of code, but what I want is a way to ask questions about large projects. It would be nice to ask something like "which classes are responsible for doing X", or "describe on a high level how Y works in this code". But I'm not sure if that is actually possible with the current technology.
- roseway4 4y agoIt’s possible to do this either by fine-tuning an existing model or using an existing chat model prompts enriched by a vector search for relevant code. See my comment elsewhere.
- 4y ago
- xyz_ielh 4y agoI've been playing with their API and it's just awesome!
- recuter 4y ago[flagged]
- DuckFeathers 4y agoThe biggest problem with ChatGPT (and alternatives) is the risk of being coopted for generating the content someone gets in trouble for. Someone very important will get in BIG BIG trouble and try to blame OpenAI for it... and the series of lawsuits that will follow will kill them. While other such models will be impacted, hopefully, there will be significant variations in alternatives so that we don't lose this technology over giant corporations trying to get out of their trouble by suing their service providers. There will also be companies that will use modified versions of open source alternatives... to make them much more conservative and cautious, so that they don't get in trouble. There will be these variations that will be shared by certain industries. So, while the generative AI is here to stay, there will be a LOT of variations... and ChatGPT will have to change a lot if they want to stay alive and relevant over time.
- freedomben 4y agowould you consider OpenAI (in its current iteration) to be conservative?
- sebzim4500 4y agoYou may be right that some of the smaller AI players could be overwhelmed by lawsuits but OpenAI has a nearly $2 trillion company bankrolling them so they can hire every lawyer in the US if necessary.
- beachy 4y agoExactly. The legal risks act as a moat that only the largest vendors can dig around themselves. I think OpenAI would be very happy about the legal risks.
- specproc 4y agoI don't agree it's cheap. For generation at fairly small scale, sure, but generation is just the party trick. The real power for my use case lies in how much better it seems to do at traditional NLP tasks than an out-of-the-box model, with no further fiddling and faffing required. Say I've got a corpus of ~1m documents, each of 10+ paragraphs and I want to run quote extraction on them (it does this beautifully), vectorise them for similarity search, whatever. This gets pretty expensive pretty fast.
- rattray 4y agoHow much would that example cost, for a sense of scale?
- avibhu 4y agoTangential: you can finetune something like flan-ul2 to do quote extraction using examples generated from chatgpt. If you have a good enough GPU, it should help cut down costs significantly
- specproc 4y agoNice, that sounds like it's worth exploring. Much appreciated. Again though, it's the zero-effort part that's appealing. I'm on a very small team and getting that to close to the same standard will take time for a ham-fisted clod like myself. Worth giving a shot all the same though, thanks again.
- pfdietz 4y agoIt's interesting what you can do with ChatGPT with few shot learning. It generalizes at the drop of a hat, often correctly.
- leobg 4y agoThe zero shot ability is convenient. But for tasks that you need to get done millions of times, I’d much rather spend $10 on GPU compute and maybe a day of training data generation to train a T5 which I then “own”. Also, running your own specialized model locally can be much faster than using someone’s API.
- alpark3 4y agoEveryone loves to hate on OpenAI and talk about how they're really ClosedAI and an evil corporation vying for power, but the opposite way is also interesting to think about. I think it's fair to say that majority of scientists at OpenAI wouldn't be working there if they knew they were working for an evil corporation. These are some of the brightest people on the planet, yet I've only heard good things about OpenAI leadership, especially Sam Altman, and their commitment to actually guiding AI for the better. I'm not saying that OpenAI is benevolent, but let's assume so for the sake of argument. They definitely would need real-world experience running commercial AI products, for the organizational expertise as well as even more control over production of safe and aligned AI technologies. A hypothetical strategy, then, would be to a) get as much investment/cash as needed to continue research productively (Microsoft investment?) b) with this cash, do research but turn that research into real-world product as fast as possible c) and price these products at a loss so that not only are they the #1 product to use, other potentially malevolent parties can't achieve liftoff to dig their own niche into the market I guess my point is that a company who truly believes that AI is potentially a species-ending technology and requires incredible levels of guidance may aim for the same market control and dominance as a party that's just aiming for evil profit. Of course, the road to hell is paved with good intentions and I'm on the side of open source(yay Open Assistant), but it's nevertheless interesting to think about.
- wpietri 4y ago> These are some of the brightest people on the planet, yet I've only heard good things about OpenAI leadership This is a deeply ahistorical take. Lots of technically bright people have been party to all sorts of terrible things. Don't say that he's hypocritical Rather say that he's apolitical "Vunce ze rockets are up, who cares vere zey come down "Zats not mein department!" says Werner von Braun
- ben_w 4y agoWhile "smart people do terrible things" is an absolutely fair point, it's also the kind of thing I hear AI researchers say, even with similar references. Sometimes they even say this example in the context of "why human-level AI might doom us all".
- deleted 4y ago[deleted]
- al2o3cr 4y agoAI's main accomplishment so far is rendering its human shills indistinguishable from Markov generators.
- 1f60c 4y agoI would love a breakdown of how they made the incredible header image (https://minimaxir.com/2023/03/new-chatgpt-overlord/featured.png https://minimaxir.com/2023/03/new-chatgpt-overlord/featured....)
- preommr 4y agoIt says it in the caption: Stable diffusion + controlnet. If you haven't seen it already, controlnet has allowed for massive improvements in addint constraints to generated images. Here's an example of using a vector logo to make it semalessly integrate it in different environments: https://www.reddit.com/r/StableDiffusion/comments/11ku886/controlnet_unlimited_album_covers_graphic_design/ https://www.reddit.com/r/StableDiffusion/comments/11ku886/co...
- aqme28 4y agoIt says it's made with ControlNet and Stable Diffusion. Probably SD'd "charcuterie board" over a drawing of the logo.
- minimaxir 4y agoHere's a few bonus OpenAI charcuterie: https://twitter.com/minimaxir/status/1633635144249774082 https://twitter.com/minimaxir/status/1633635144249774082 1. I used a ControlNet Colab from here based on SD 1.5 and the original ControlNet app: https://github.com/camenduru/controlnet-colab https://github.com/camenduru/controlnet-colab 2. Screenshotted a B/W OpenAI logo from their website. 3. Used the Canny adapter and the prompt: charcuterie board, professional food photography, 8k hdr, delicious and vibrant Now that ControlNet is in diffusers, my next project will be creating an end-to-end workflow for these types of images: https://www.reddit.com/r/StableDiffusion/comments/11bp30o/tech_companies_as_charcuterie_boards_controlnet/ https://www.reddit.com/r/StableDiffusion/comments/11bp30o/te...
- zirgs 4y agoOne of the biggest drawbacks of ChatGPT is that OpenAI knows everything that its users are doing with it. Every prompt and its answer are being logged. Hackers might breach OpenAI systems and leak its data. If you're Rockstar that's working on GTA 7 then you'll propbably want to keep all the AI written mission scripts, story ideas, concept art and other stuff like that on your own servers.
- simonw 4y ago... which is one of the strongest arguments for being able to run a large language model on your own hardware instead! https://til.simonwillison.net/llms/llama-7b-m2 https://til.simonwillison.net/llms/llama-7b-m2
- Karrot_Kream 4y agoDon't want to be vapid, but these are some cool guides! I know how to run these models but want to link my friends to guides to get started. Thanks!
- BoiledCabbage 4y ago> OpenAI retains API data for 30 days for abuse and misuse monitoring purposes. They just changed this. It is now only 30 day retention - https://openai.com/policies/api-data-usage-policies https://openai.com/policies/api-data-usage-policies
- throwawayapples 4y agoDoes that only apply to API usage and not ChatGPT the web app? It would seem to, because the web app doesn't seem to expire your old chats.
- KyeRussell 4y agoMy old chats all completely disappeared in the past few days . Quite disappointing actually. I had some valuable state in some of them.
- simonw 4y agoDoes anyone have a good feel for how likely it is that OpenAI might be running it at this price to get companies hooked, with plans to then raise the price later on once everyone is locked in? I'm personally much more excited about the LLaMA + llama.cpp combo that finally brings GPT-3 class language models to personal hardware. I wrote about why I think that represents a "Stable Diffusion" moment for language models here: https://simonwillison.net/2023/Mar/11/llama/ https://simonwillison.net/2023/Mar/11/llama/
- pixl97 4y agoDepends how much competition ends up in this market. If there is plenty of competition that gives good results at a similar costs rising prices will be difficult. Now if it actually costs far more to run than the API cost is currently, we'll see it go up.
- mirekrusin 4y agoThey want to take the widest possible share, which atm, without competition means bringing on people/companies that wouldn't otherwise consider it. The price will only go down when competition appears. They can only slow it down with the cheapest possible offering (to put market entry bar higher for competitors). They don't know what competition will do, but they know if they move fast they'll have very low chance of catching up anytime soon and that's all that matters. Competition will be interesting because interface is as simple as it can be (easy to switch to different provider). Providers can hook people though pre-training but I don't know if it's possible to do dedicated pre-training on large models like this. They may need to come up with something special for that.
- minimaxir 4y agoI pointed that out in the caveats since that happened with Google Maps, but in practice I don't think it'll happen (or if it happens it will only be a slight increase) since that would seriously upset its users. Especially since the low price was likely due to competition anyways. In the case of Google Maps it was effectively a monopoly.
- 4y ago
- fareesh 4y agoHow does one go about minimizing costs for certain situations? For example if I share a db schema and then ask it to generate some sql, I need to share that entire db schema for every single question that follows, is that right? Or is it possible for me to somehow pay and have it "retain" that schema knowledge for all subsequent queries without having to send the schema along with every single question?
- mirekrusin 4y agoIt's called fine tuning [0] but it's not yet available for chatgpt, only older models. [0] https://platform.openai.com/docs/guides/fine-tuning https://platform.openai.com/docs/guides/fine-tuning
- fareesh 4y agoYeah that seems to be the trouble - the pricing is great with ChatGPT but not so much with the older ones
- mirekrusin 4y agoThat may be partially because it's not possible to do pre-training on such a large model.
- fareesh 4y agoOn the web version is it doing that under the hood? I.e. if I have a 10+ follow up conversation does it start from the beginning each time?
- mirekrusin 4y agoIt keeps context of 8k tokens. In pre-training you're using much more examples and network is tuned around them.
- osigurdson 4y agoI largely agree but I don't see how ChatGPT hits the same use cases as a fine-tuned model. Prompts can only have 8K tokens so any "in-prompt" fine tuning would have to be pretty limited. I'm not certain that the lack of ChatGPT fine tuning will be a permanent limitation however.
- riku_iki 4y agobut they have API for fine tuning?..
- osigurdson 4y agoThey do, but not for gpt3.5 turbo (the ChatGPT model). See the following link for details: https://platform.openai.com/docs/guides/chat/is-fine-tuning-available-for-gpt-3-5-turbo https://platform.openai.com/docs/guides/chat/is-fine-tuning-...
- riku_iki 4y agoprobably this may change soon..
- osigurdson 4y agoIt may and I hope it does but I have no information one way or the other.
- fancyfredbot 4y agoOpenAI could probably make money offering the API for free at this point - the data they are getting is so valuable for them in building a competitive advantage in this space. Once they know use cases for the model they can make sure they are very good at those, and then they can consider hiking the price.
- eeegnu 4y agoCharging a small amount is more optimal since it mitigates API spam without having to set a low rate limit. It also ties your users to a financial id, which is (probably) harder to get in bulk for nefarious purposes than just requiring a phone number to sign up.
- napier 4y agoYes last week, but Llama 65B is as of today running on an M1 so yeah difficult to predict how centralised AI APIs will play out six months from now: https://twitter.com/lawrencecchen/status/1634507648824676353 https://twitter.com/lawrencecchen/status/1634507648824676353 Still expecting OAI to be able to leverage a flywheel effect as they plough their recent funding injection into new foundation models and other systems innovations but there’s also going to be increasing competition from other platform providers and also the open source community boosted by competitors open sourcing / leaking expensive to train model tech with the second order function of diffusing wind from sales.
- cs702 4y agoIt will also make a lot of simple machine-learning models obsolete. It's just not that obvious yet. Imagine feeding a query akin to the one below to GPT4 (expected to have a 50,000-token context), and then, to GPT5, GPT6, etc.: query = f"The guidelines for approving or denying a loan are: {guidelines}. Here are sample application that were approved: {sample_approvals}. Here are sample applications that were denied: {sample_denials}. Please approve or deny the following loans: {loan_applications}. Write a short note explaining your decision for every application." decisions = LLM(query) Whether you like it or not, this kind of use of LLMs looks almost inevitable, because it will give nontechnical execs something they have always wanted: the ability to "read and understand" the machine's "reasoning." They machine will give them what they have always wanted: an explanation in plain English.
- mtlmtlmtlmtl 4y agoYes, let's put LLM in charge of loan applications. Definitely no financially devastating 2008-like slippery slope there. It'll be fine.
- sebzim4500 4y agoYou could check a random sample of them with expert humans to ensure there isn't a systematic issue causing you to issue large loans that you shouldn't be issuing. I doubt regulators would be happy with this though, especially since regulations are often a jobs program for former employees of regulators.
- rafram 4y agoI don’t think regulator nepotism is the main reason that the authorities would be uncomfortable with loan decisions being made by a system that definitionally reinforces existing biases and is incapable of thought. It’s just a bad idea!
- LawTalkingGuy 4y ago
- vintermann 4y agoOne kind of text generation AI it already makes obsolete, is specialized translation models. It's no surprise it outdoes Google Translate, that feels like it hasn't been updated in a while. But it also outdoes Deepl now, and Deepl is good. And it seems to handle translating from low-resource languages extremely well. Into them, it's a bit harder to judge. It handles translation between closely related languages such as Swedish and Norwegian extremely well. Google Translate goes via English and accumulates pointless errors.
- IIAOPSW 4y agoIt sucks at morse code.
- vkou 4y agoAnd yet, this is ChatGPT's attempt at generating a college essay: https://acoup.blog/2023/02/17/collections-on-chatgpt/ https://acoup.blog/2023/02/17/collections-on-chatgpt/ Looking at the actual essay it produced, I don't need to know anything about Roman history to know that the essay sucks. Looking at the professor's markup of the essay, it becomes very clear that for someone who knows a lot about Roman history, the essay sucks - a lot. And it's not like it was prompted to write about an esoteric topic! According to the grader, the essay made 38 factual claims, of which 7 were correct, 7 were badly distorted, and 24 were outright bullshit. According to both myself, and the grader, way too much heavy lifting is done by vague, unsubstantiated, overly broad statements, that don't really get expanded on further in the composition. But yes, if we're looking to generate vapid, low-quality, low-value content spam, ChatGPT is great, it will produce billions of dollars of value for advertisers, and probably net negative value for the people reading that drivel.
- photochemsyn 4y agoWhat is you sequentially fed ChatGPT with samples of the course professor's own writing, and then asked it to write an essay on the subject of interest? As the article notes, optimization is possible: > "For example, high school and college students have been using ChatGPT to cheat on essay writing. Since current recognition of AI generated content by humans involve identifying ChatGPT’s signature overly-academic voice, it wouldn’t surprise me if some kids on TikTok figure out a system prompt that allow generation such that it doesn’t obviously sound like ChatGPT and also avoid plagiarism detectors." A decent student might go to the trouble of checking all the factual claims produced in the essay in other sources, thus essentially using ChatGPT to write a rough draft then spending the time saved on checking facts and personalizing the style. I don't even know if that would count as serious cheating, although the overall structure of such essays would probably be similar. Running 'regenerate response' a few times might help with that issue, maybe even, 'restructure the essay in a novel manner' or similar.
- vkou 4y agoI can't see why feeding it another 50, or even 500 papers is going to make it any better at making the categories of non-explicit inferences that its currently failing at, when the terabytes upon terabytes and hundreds of thousands of papers of training data did not. It could train it to speak in the mannerisms of a particular author, but that's the least interesting thing in this context, and it'll still be speaking in banalities and nonsense.
- lamontcg 4y agoYou think Google Search is polluted with AI written SEO'd trash already, well just wait for what it is in store when the chatbots attack whatever value is still contained in reddit-as-a-search-engine...
- sourcecodeplz 4y agoWho uses Google anyway nowadays besides getting the address of a website you don't remember (assuming you know about ChatGPT).
- Toutouxc 4y agoI can mostly tell when webpages from my search results are trying to bullshit me (and Kagi gives me some nice tools to suppress the bullshitting kind), but with ChatGPT I have no idea.
- darepublic 4y agoYes true if you trust the website then generally that trust can extend to all its content. You are putting your faith into the competence and consistency of a human being which is generally more trustworthy than the hit or miss results of a word predictor
- Velc 4y agoThey already are. This week I uncovered a ChatGPT bot farm operating on reddit.
- binkHN 4y agoCare to provide more details?
- d23 4y agoOff topic, but how'd you get that amazing header banner Max? I tried a web-based ControlNet + Stable Diffusion combo[1], but the quality is nothing near what you have there. [1] - https://stablediffusionweb.com/ControlNet https://stablediffusionweb.com/ControlNet
- minimaxir 4y agohttps://news.ycombinator.com/item?id=35112641 https://news.ycombinator.com/item?id=35112641
- avereveard 4y agoyeah remember when a lot companies based themselves on the bing search api and then the price increase 3x-10x depending on usage? thanks, but no thanks.
- virtualjst 4y agoWhere is juniper notebook code for the chatgpt_generate function?
- virtualjst 4y agoWhere is the jupyter notebook code with the example chatgpt_generate function?
- minimaxir 4y agoThat function is just a wrapper over the base openai.ChatCompletion.create call from the documentation with no changes: https://twitter.com/minimaxir/status/1631044069483749377 https://twitter.com/minimaxir/status/1631044069483749377
- boringg 4y agoUntil they raise prices. Classic venture playbook here - get everyone hooked on the product then raise rates. Also depends how you calculate cost. If its simply $ or if you are counting the externalities as 0.
- sourcecodeplz 4y agoI don't think were going to reach winter before we can run our own ChatGPT locally with mundane hardware.
- transitivebs 4y agoNot sure if the author saw in the OpenAI docs, but their current "system" message has a really weak effect on the output. OpenAI explicitly recommends using a simple "system" message and then a separate instructions "user" message that encodes your prompt instructions. So if you're struggling to get the chat completions API to follow instructions, don't rely on the system message alone. (I'm the author of the `chatgpt` npm package and run a community of 10k+ ChatGPT hackers, so we've run into a lot of these kinks and found that this method works much better than using the "system" message exclusively. It's even mentioned in their official chat completions guide as something that they will be improving in future versions)
- typest 4y agoDo you know of any advice or guides on how to use the chatgpt api? It's unclear to me when things should be a system message, and if not, if they should be user or assistant messages. You say here that the simple message should be really simple. So, further instructions should be in a user message? Any idea what constitutes a "simple" system message?
- harrisonjackson 4y agoThe best thing you can do is lots of testing. Setup an environment where you can isolate the prompt you are working on (the new chat playground is good for this) and load it with a system message and some assistant and user messages then play with it until you get the results you want. I've had success with a simple system method that is one sentence defining how we are extending chatgpt. "You are AcmeCoBot an extension of ChatGPT which we have enabled <x, y, z features> to assist users <goal>." Then a user message with the actual instructions on what you want/need - this is much closer prompting for gpt-3. user msg 1: Translate the following to German for me... some text assistant msg 1: an example translation new user msg: Translate the following to German for me... The model completes these interactions well. We may run 1-10 of these completions before using chatgpt for the last mile message that actually gets sent to a user. It takes a while to wrap your head around using the chatgpt api for a non-chat completion.
- EGreg 4y agoThe only problem is that you’re locked into a centralized monopoly, and they can disconnect your business at any time
- throwwwaway69 4y agoThis is true of a ton of businesses, though. If it's not OpenAI then it's ad providers, or payment processors, or affiliate programs, or the banking industry. These are all huge blockers to a lot of businesses (porn sites, non-monetizable content, cannabis companies, etc).
- istillwritecode 4y agoI will no longer give my phone number to a cloud provider. Count me out.
- yacine_ 4y agoDo not discount the premium on "not having to network egress"
- braindead_in 4y agoTo everyone affected by the crisis: Keep calm and build ChatGPT apps.
- BiteCode_dev 4y agoBut when is it going to make regex obsolete? :)
- ChildOfChaos 4y agoIs it worth buying GPT credits form openAi for personal use rather than just using ChatGPT, if so why? I'm wondering if having access to the system role could make it more helpful and useful? Trying to feed ChatGPT info, but it still eventually ignore it or it becomes too much for it and then it just reverts to being generic.
- canibal57 4y agoSpongeBob would never be a red card.
- d0na1d 4y agocool))