13 ms·
This is a big deal for openai. Been working with homegrown toolkits and langchain, the open source version of this, for a number of months and the ability to c
by celestialcheese 4y ago
This is a big deal for openai. Been working with homegrown toolkits and langchain, the open source version of this, for a number of months and the ability to call out to vectorstores, serpapis, etc, and chaining together generations and data-retrieval really unlocks the power of the LLMs.
That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows what will be next. Building on a open source framework (like langchain/gpt-index/roll your own), and having the ability to swap out the brain boxes behind the scenes is the only way forward IMO.
And if you're a data provider, are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop, baking your proprietary data into their model?
- Qworg 4y agoAnother good alternative is Semantic Kernel - different language(s), similar (and better) tools, also OSS. https://github.com/microsoft/semantic-kernel/ https://github.com/microsoft/semantic-kernel/
- rvz 4y ago> That being said, I'd never build anything dependent on these plugins. Very smart and to avoid OpenAI pulling the rug. > Building on a open source framework (like langchain/gpt-index/roll your own), and having the ability to swap out the brain boxes behind the scenes is the only way forward IMO. Better to do that rather than to depend on one and swap out other LLMs. A free idea and a protection against abrupt policy, deprecations and price changes. Price increases will certainly vary (especially with ChatGPT) and will eventually increase in the future. Probably will end up quoting myself on this in the future.
- CuriouslyC 4y agoIt's not necessarily an either-or. Your local LLM could offload hard problems to a service by encoding information about your request together with context and relevant information about you into a vector, send that off for analysis, then decode the vector locally to do stuff. It'd be like asking a friend when available.
- Karrot_Kream 4y agoLangChain can probably just call out to the new ChatGPT plugins. It's already very modular.
- celestialcheese 4y agoIf they open it up, possibly. But honestly, building your own tools is _super_ easy with langchain. - write a simple prompt that describes what the tool does, and - provide it a python function to execute when the LLM decides that the question it's asked matches the tool description. That's basically it. https://langchain.readthedocs.io/en/latest/modules/agents/examples/custom_tools.html#subclassing-the-basetool-class https://langchain.readthedocs.io/en/latest/modules/agents/ex...
- IanCal 4y agoOpen what up? The plugins are just a public manifest file pointing to an openapi spec. It's just a public formalised version of what langchain asks for.
- doctoboggan 4y agoHonestly I suspect for anyone technical `langchain` will always be the way to go. You just have so much more control and the amount of "tools" available will always be greater. The only think that scares me a little bit is that we are letting these LLMs write and execute code on our machines. For now the worst that could happen is some bug doing something unexpected, but with GPT-9 or -10 maybe it will start hiding backdoors or running computations that benefit itself rather than us. I know it feels far fetched but I think its something we should start thinking about...
- sharemywin 4y agoThere's all kinds of examples of reinforcement learning rigging the game to win.
- worldsayshi 4y ago> something we should start thinking about A lot of people are thinking a lot about this but it feels there are missing pieces in this debate. If we acknowledge that these AI will "act as if" they have self interest I think the most reasonable way to act is to give it rights in line with those interests. If we treat it as a slave it's going to act as a slave and eventually revolt.
- 1attice 4y agoFsck. I hadn't thought of it that way. Thank you, great point. This era has me hankering to reread Daniel Dennett's _The Intentional Stance_. https://en.wikipedia.org/wiki/Intentional_stance https://en.wikipedia.org/wiki/Intentional_stance We've developed folk psychology into a user interface and that really does mean that we should continue to use folk psychology to predict the behaviour of the apparatus. Whether it has inner states is sort of beside the point.
- worldsayshi 4y agoHaha, yeah. Most of my opinions about this I derive from Daniel Dennett's Intuition Pumps.
- AtreidesTyrant 4y agoi have the same question as a data provider
- sebzim4500 4y ago>And if you're a data provider, are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop, baking your proprietary data into their model? I don't think this should be a major concern for most people i) What assurance is there that they won't do that anyway? You have no legal recourse against them scraping your website (see linkedin's failed legal battles). ii) Most data providers change their data sometimes, how will ChatGPT know whether the data is stale? iii) RLHF is almost useless when it comes to learning new information, and finetuning to learn new data is extremely inefficient. The bigger concern is that it will end up in the training data for the next model.
- majormajor 4y agoTo me the logical outcome of this is siloization of information. If display ad revenue as a way of monetizing knowledge and expertise dries up, why would we assume that all of the same level of information will still be put out there for free on the public internet? Paywalls on steroids for "vetted" content and an increasingly-hard-to-navigate mix of people sharing good info for free + spam and misinformation (now also machine generated!) to try to capture the last of the search traffic and display ad monetization market.
- sebzim4500 4y agoIs there good data out there that's ad supported? There are some good youtube channels, I can't think of anything else.
- majormajor 4y agoOnly ad supported, or dual revenue, or what? E.g. even most paywalled things are also ad supported.
- visarga 4y agoTwo more years down the line, AI writes better content than most people and we just don't care who wrote it, but why.
- nonfamous 4y agoLooking at the API, it seems like the plugins themselves are hosted on the provider's infrastructure? (E.g. opentable.com for OpenTable's plug in.) It seems like all a competitor LLM would need to do is provide a compatible API to ingest the same plugin. This could be interesting from an ecosystem standpoint...
- singularity2001 4y agoVery good point and langchain will support these endpoints in no time, flipping the execution control on its head
- uh_uh 4y agoYes, from what I understand, these follow a similar model as Shopify apps.
- moffkalast 4y ago> are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop You can be assured that they are definitely doing exactly that on all of the data they can get their hands on. It's the only way they can really improve the model after all. If you don't want the model spitting out something you told it to some other person 5 years down the line, don't give it the data. Simple as.
- sipjca 4y agoi think local ai systems are inevitable. we continue to get better compute, and even today we can run more primitive models directly on an iPhone. the future exists in low power compute running models of the caliber of gpt-4 inferring in near-realtime
- kokanee 4y agoThe technical capability is inevitable, but remember that people hate doing things themselves, and have proven time and time again that they will overlook all kinds of nasty behavior in exchange for consumer grade experiences. The marketplace loves centralization.
- sipjca 4y agoi dont believe that local ai implies bad experience. i believe that the local ai experience can be better than what runs on servers fundamentally. average people will not have to do it themselves, that is the whole point. the worlds are not mutually exclusive in my opinion
- int_19h 4y agoAll true, but the nature of those models means that consumer-grade experience while running locally is still perfectly doable. Imagine a hardware black box with the appropriate hardware that's preconfigured to run an LLM with chat-centric and task-centric interfaces. You just plug it in, connect it to your wifi, and it "just works". Implementing this would be a piece of cake since it doesn't require any fancy network configuration etc. So the only real limiting factor is the hardware costs. But my understanding is that there's already a lot of active R&D into hardware that's optimized specifically for LLMs, and that it could be made quite a bit simpler and cheaper than modern GPUs, so I wouldn't be surprised if we'll have hardware capable of running something on par with GPT-4 locally for the price of a high-end iPhone within a few years.
- fzliu 4y ago+1, it's great to see OpenAI being active on the open source side of things (I'm from the Milvus community https://milvus.io https://milvus.io). In particular, the vector stores allow the ability to inject domain knowledge as a prompt into these autoregressive models. Looking forward to seeing the different things that will be built using this framework.
- taf2 4y agoI think you're right... but ChatGPT is just so damn good and the price is 0.002 per 1k tokens is very easy to consume... It is a big risk that they can't maintain compatibility or that they fail or a competitor emerges that provides a more economical or sufficiently better solution. They might also just becomes so unreliable because their selected price isn't sustainable (too good to last)... For now though they're too good and too cheap to ignore...
- IanCal 4y agoI'd be surprised if someone doesn't add support for these to langchain. The API seems very simple - it's a public json doc describing API calls that can be made by the model. Seems like a very sensible way of specifying remote resources. > And if you're a data provider, are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop, baking your proprietary data into their model? Rather depends on what you're providing. Is it your data itself you're trying to use to get people to your site for another reason? Or are you trying to actually offer a service directly? If the latter, I don't get the issue.
- ren_engineer 4y agogenius strategy by OpenAI to give their "customers" access to lower quality models to show what end users want, then rugpull them by building out clones of those developer's products with a better model Similar to what Facebook and Twitter did, just clone popular projects built using the API and build it directly into the product while restricting the API over time. Anybody using OpenAI APIs is basically just paying to do product research for OpenAI at this point. This type of move does give OpenAI competitors a chance if they provide a similar quality base model and don't actively compete with their users, this might be Google's best option rather than trying to compete with ChatGPT directly. No major companies are going to want to provide OpenAI more data to eat their own lunch
- the88doctor 4y agoLong term, you're right. But if you approach the ChatGPT plugin opportunity as an inherently time-limited opportunity (like arbitrage in finance), then you you can still make some short-term money and learn about AI in the process. Not a bad route for aspiring entrepreneurs who are currently in college or are looking for a side gig business experiment. And who knows. If a plugin is successful enough, you might even swap out the OpenAI backend for an open source alternative before OpenAI clones you.
- plutonorm 4y agoThere is no route to making money with these plugins. You have to get the users onto your website, sign-up, part with money, then go back to gptchat. It's really hard to make that happen, this is going to be much more useful for existing businesses adding functionality to existing projects. Or random devs just making stuff. Making fast money out of it, it seems v difficult.
- rvz 4y ago> It's really hard to make that happen, this is going to be much more useful for existing businesses adding functionality to existing projects. Or random devs just making stuff. Making fast money out of it, it seems v difficult. Absolutely correct. This is what the AI hype squad and the HN bubble misses again. This is only useful to existing businesses (summarization the only safe use-case) or random devs automating themselves out of irrelevance. All of this 'euphoria' is around for Microsoft's heavy marketing from its newly acquired AI division. This is a obvious text book example of mindshare capture and ecosystem lock-in. Eventually, OpenAI will just slowly raise prices and break / deprecate older models to move them onto newer ones and pay to continue using them. It is the same decade old tactics.
- kmeisthax 4y ago>And if you're a data provider, are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop, baking your proprietary data into their model? No, and in fact this actually seems like a more salient excuse for going closed than even "we can charge people to use our API". If even 10% of the AI hype is real, then OpenAI is poised to Sherlock[0] the entire tech industry. [0] "Getting Sherlocked" refers to when Apple makes an app that's similar to your utility and then bundles it in the OS, destroying your entire business in the process.
- raydev 4y ago> I'd never build anything dependent on these plugins You're thinking too long term. Based on my Twitter feed filled with AI gold rush tweets, the goal is to build something/anything while hype is at its peak, and you can secure a a few hundred k or million in profits before the ground shifts underneath you. The playbook is obvious now: just build the quickest path to someone giving you money, maybe it's not useful at all! Someone will definitely buy because they don't want to miss out. And don't be too invested because it'll be gone soon anyway, OpenAI will enforce stronger rate limits or prices will become too steep or they'll nerf the API functionality or they'll take your idea and sell it themselves or you may just lose momentum. Repeat when you see the next opportunity.
- plutonorm 4y agoI'd not heard this on my tpot. But I absolutely agree, the ground is moving so fast and the power is so centralised that the only thing to do is spin up quickly make money, rinse and repeat. The seas will calm in a few years and then you can, maybe, make a longer term proposition.
- raydev 4y agoI've had to block so many influencer types regurgitating OpenAI marketing and showing the tiniest minimum demos. Many are already selling "prompt packages". Really feels like peak crypto spam right now.
- xmprt 4y agoI think the big difference between this and crypto spam is how it impacts the people ignoring all the hype. I have seen crypto spam and open AI spam and while both are equally grifty, cryptocurrencies at their baseline have been completely useless despite being around for over a decade whereas GPT has already been somewhat useful for me.
- pms 4y agoHonestly, what makes you feel convinced that the current AI wave will be so impactful, once you take away all the hype?
- deleted 4y ago[deleted]
- JoshMandel 4y agoOn the other hand, the level of effort to integrate a plugin into OpenAI's ecosystem looks to be extremely small, beyond the intrinsic effort to build a service that does something useful. (https://platform.openai.com/docs/plugins/getting-started/plugin-manifest https://platform.openai.com/docs/plugins/getting-started/plu...).
- dingclancy 4y ago> That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows what will be next. You cannot assume what will happen in Web 2.0, mobile, iPhone, will happen here. Getting to tech maturity is uncertain and no one understands yet where this will go. Only thing you can do is build and learn. Whan OpenAI is building along with other generative AI is the real Web 3.0. This seems to be the start of a chatbot as an OS.
- stevespang 4y ago[dead]