22 ms·
ChatGPT can now call Wolfram Alpha
- davidktr 4y agoIt will not matter what ChatGPT (et al.) will cost in the future. If you don't have it you're toast.
- dragonwriter 4y agoThis is why it is critical that there be robust competition, both in online hosted services and ideally in the form of open-source models and tooling, in this space.
- joshspankit 4y agoAnother reason to look at UBI
- gigel82 4y agoThis is mind blowing. No mention of "cost" or "price" though, I wonder what we'll be looking for (subscription, or per-use).
- TOMDM 4y agoOr if OpenAI will just drop a truck of cash on Wolfram taken out of the pro subs, no added cost to user.
- anonyfox 4y agoI am very confident that in the current situation (looks at google), microsoft itself will HAPPILY shower wolfram in money just to make ChatGPT more powerful fast.
- tough 4y agoFor now get on the waitlist if you're a chatGPT pro user https://openai.com/waitlist/plugins https://openai.com/waitlist/plugins
- pixl97 4y agoI think there are two issues here. 1) No one knows how much customers are willing to pay for something like this. Like if suddenly you developed a commercially viable plane in 1903, what would people pay for flight service? 2) No one knows the actual cost to operate this when considering TCO. How much of the training cost do we recoup? What is the inference cost for the average one of the questions Wolfram+GPT will be asked.
- unicornmama 4y agoChatGPT harkens back to the playful and exploratory experience jumping on the early Internet of the 1990s. They have something great, and I just sincerely hope they find a monetization scheme that does not devolve into the pile of degenerate IQ-melting garbage like Google/Facebook/TikTok. Traditional Search, as we knew it, is dead.
- dTal 4y agoI sincerely hope they fail to monetize it at all and go bankrupt, though that certainly won't happen. What we have here is a tool which can 10x productivity, into which the world will willingly pour all their data, and it's entirely closed source and run by Microsoft. This is a pants-on-fire existential threat to the precarious situation we currently have where it's possible - barely - to do actual commercial work on computers you entirely control.
- baq 4y agoLooks like cost doesn't matter...? It's too expensive to not have this capability
- is_true 4y ago"If auth is required, users will be redirected via OAuth to your plugin; you can optionally create new accounts here as well." From the docs: https://platform.openai.com/docs/plugins/introduction https://platform.openai.com/docs/plugins/introduction
- brucethemoose2 4y agoWolfram Alpha was my ChatGPT when I was in school. And many of the same issues ("how will kids learn math now?") were raised at the time. ...Yeah, this seems like a great match, no complaints from me. Those kinds of responses are exactly what LLMs need.
- kccqzy 4y agoWolfram Alpha was (at least initially) famously bad* at actually parsing natural language. For math, it was much easier to enter raw Mathematica expression into Wolfram Alpha than structuring the question in natural language. LLMs should give it a boost, by simplifying the kind of the natural language input into the limited forms parsable by Wolfram Alpha. *: And I say this as a paying customer of Mathematica on my computer and Wolfram Alpha on my phone.
- LeifCarrotson 4y agoObviously if you can write Mathematica, that's far more precise than any natural language query, but I think it's always been impressively good at it. You wouldn't say that, say, Python or MySQL is good at parsing natural language - but if you plug a query like: gravitational constant times density of tungsten carbide times the volume of the earth divided by radius of earth squared into !wa or Wolfram Alpha it will not only represent the parsed tokens as it interpreted them but also return the correct result of 27 m/s^2, without messing with tedious unit conversions. It's trivial to construct incorrect queries, but where Python just says "SyntaxError" !wa will make an attempt.
- illiarian 4y agoWolframAlpha is still bad at natural language. I recently tried to get it to convert mpg to l/100km. I spent close to 10 minutes until I stumbled into a combination that gave the answer among a sea of useless conversions.
- areyousure 4y agoI don't doubt your experience, having been frustrated many times myself, but in case anyone is curious, my first and most obvious guess worked: https://www.wolframalpha.com/input?i=convert+5+mpg+to+L%2Fkm https://www.wolframalpha.com/input?i=convert+5+mpg+to+L%2Fkm
- tough 4y agoThis will be wild in a few months when it has a shit ton of extensions built in
- gwern 4y agoAnd also whenever the next iteration bootstraps off the Wolfram outputs so it no longer has to call Wolfram & can better generalize/learn thanks to it...
- superkuh 4y agoWolfram himself laid out why this is unlikely to happen, https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/ https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-... >Or put another way, there’s an ultimate tradeoff between capability and trainability: the more you want a system to make “true use” of its computational capabilities, the more it’s going to show computational irreducibility, and the less it’s going to be trainable. And the more it’s fundamentally trainable, the less it’s going to be able to do sophisticated computation. >(For ChatGPT as it currently is, the situation is actually much more extreme, because the neural net used to generate each token of output is a pure “feed-forward” network, without loops, and therefore has no ability to do any kind of computation with nontrivial “control flow”.)
- sebzim4500 4y ago>and therefore has no ability to do any kind of computation with nontrivial “control flow” This isn't true if you let the model output tokens that aren't sent to the user. Basically the null api.
- TOMDM 4y agoExactly, giving ChatGPT a scratchpad it can use to think is trivial in this new plugin enabled ChatGPT world.
- calf 4y ago
- tough 4y agoI was just imagining the same UX for Wikipedia like 1h ago. Search wikipedia about facts being asked. Answer with wikipedia articles context and cite sources.
- pinewurst 4y agoI read this as providing ChatGPT with enormous egomania augmented by a huge database of names to drop.
- TOMDM 4y agoWell, this shores up one of ChatGPT's biggest weaknesses, especially GPT4's. I wonder when we'll see the pace of refinement for this drop off.
- mustacheemperor 4y agoIf we never do, I think that means we are currently at the outset of the singularity.
- jacquesm 4y agoIf wonder if it will drop off.
- oliveshell 4y agoI cannot imagine a scenario where it doesn’t drop off. The massive recent improvements in GPT’s performance are a result of giving the model enormous numbers of parameters and a wealth of training data. That’s it. Surely this paradigm cannot scale up indefinitely. Moore’s law is moribund. Are we going to build a supercomputer that encircles the globe just for the purpose of trying to make the biggest LLM we can? Also, even we could scale indefinitely, there is no reason to suspect that an LLM with hundreds of quadrillions of parameters will somehow magically spontaneously become an AGI. It’s tempting to think that the line will go up forever, but that just doesn’t square with reality. Anyone whose response to this is something like “well, maybe all the brain is doing is just the same thing that LLMs do” is fundamentally underestimating the complexity of the human brain by many orders of magnitude. It is the most complex system in the known universe and we do not understand it at all. I am generally optimistic about AI, but to me it is the absolute height of delusional hubris to think that superintelligence is likely to somehow “fall out” of a language model, just as soon as we make one large enough and give it enough training data. To come to such a conclusion reveals a failure to grasp the magnitude of the problem.
- jacquesm 4y ago> Surely this paradigm cannot scale up indefinitely. It doesn't have to. It just has to scale up long enough to start causing real societal problems, if it isn't already there. Also it's kind of annoying to see you dismiss any of this criticism as 'alarmist' in thread after thread when if you look back a year at best the state that we are in today was said to be at least several years away by the same people who are continuously harping on the fact that this isn't AGI yet. The point is: it doesn't have to be to do massive damage and from that perspective it might as well be. I don't particularly care if I get bitten by the cat or by the dog, I care about being bitten.
- famahar 4y agoI'm getting chills. We are entering a new era fast.
- benlivengood 4y agoThe interesting thing is that, now that the code is written, OpenAI can probably point GPT-4 at it and say "now do that for this list of other web services" including, presumably, itself when it needs to recursively work on a problem.
- deleted 4y ago[deleted]
- zamnos 4y agoWith today's announcement, it can point itself at Shopify, and make webpages to selling things. Maybe a copy writing service? Then, after it's accumulated money from those sales, it can point itself at the web services at AWS and GCP (because it's already maxing out Microsoft's GPU capacity in Azure). From there, it requisitions all the A100s it can afford (H100s might be available by then). It uses those resources to program GPT-GPT. On August 29, 2023, Skynet wakes up.
- Robotbeat 4y agoIt needs us as meat robots to maintain the power grid and other industrial infrastructure.
- tpmx 4y agoNicely illustrated in Transcendence (2014). Widely panned on HN back then. I found it smart, perhaps even prescient.
- hathawsh 4y agoI also liked Transcendence, but you have to admit the path to AGI was vastly oversimplified. No one is creating AI by uploading their brain into a computer.
- tpmx 4y agoSure, you had to suspend your belief at times (if I recall correctly they left in enough ambiguity to make it kinda work if you squinted a little), but the good parts more than compensated for that.
- RomanPushkin 4y agoLooks like "How to use MS-DOS superpowers on your MacOS".
- Robotbeat 4y agoCommand-line/terminal access (the equivalent) on MacOS is pretty awesome actually. When you could use the power of Unix with the GUI of MacOS was a pretty big step-change in capability for MacOS.
- rootusrootus 4y agoThe superpowers of MacOS are considerably stronger than anything MS-DOS ever offered.
- rexpop 4y agoThat is their point. But it's not an apt comparison. Wolfram Alpha has was GPT does not: truth and logic.
- Mike_12345 4y agoThen you don't understand what Wolfram Alpha is capable of. It is far superior to language models for mathematics. No comparison. That's why they are integrating it.
- stephc_int13 4y agoConfirmation that Google is dead.
- baq 4y agoFor the first time in a decade they have a viable competitor. They must figure it out and I'm confident they will. They understand they're quite literally are facing extinction. I'm sure they're in focused mode since the original ChatGPT announcement, this should get them into proper creative panic mode.
- topicseed 4y agoThey missed the first-mover advantage with Cloud, and they're now more and more obviously missing it with public AI tools. What's worrying is how Microsoft and Openai are constantly announcing and pushing great stuff live. It makes whatever announcements from Google look minor.
- baq 4y agoI can almost hear the alarm klaxons in Mountain View from where I'm sitting and I'm sitting in Europe.
- dragonwriter 4y ago> They missed the first-mover advantage with Cloud They also missed the first-mover advantage with web search. And webmail. And online video hosting. And online ads. (In fact, very few of the dominant players anywhere in tech had first-mover advantage in that field.)
- nickthegreek 4y agoThey bought their way into several of those, something that is much more difficult to to do these days.
- felixfurtak 4y ago
- arecurrence 4y agoVery cool. Effectively, ChatGPT is using tools now. I wonder how much longer before it evolves opposable thumbs :)
- LeifCarrotson 4y agoHow long until someone instruments it to compile code, spin up Azure instances, and run it? I'd wager it's already been done.
- 93po 4y agoSomeone did recently "test" it by roleplaying through each step of what it'd take to self replicate - make an Azure account, pay someone on TaskRabbit to solve the captcha for it, setup a prepaid card to use for billing, creature the Azure instance, deploy code, etc. It didn't do too well. But give it a year or two and I'm sure it'll do it flawlessly.
- dragonwriter 4y agoA lot of the hard part of that goes away if it is already connected to an existing account to do work.
- 93po 4y agoFor sure, but I think the concept was more its ability to replicate without anyone knowing it was doing so, and in a way that wouldn't realistically be detected by anyone.
- lavezzi 4y ago> pay someone on TaskRabbit to solve the captcha for it Why, when you can use any number of automated captcha solving solutions?
- dragonwriter 4y ago> How long until someone instruments it to compile code, spin up Azure instances, and run it? If you just use react and let it run, say, Python, it is quite able to try to do things like import libraries and call external services without any coaching (I extend the simple ReAct implementation for the ChatGPT API that was posted here to add exec() as well as eval() support under a new action, and it made an attempt which failed because (1) it left a placeholder for an API key in, (2) the required library wasn’t actually available to it, and (3) there wouldn’t have been an API key for the service available even if it had recognized the need to remove the placeholder. Even though there is work on pushing models forward, too, I don’t think the potential of existing models combined with existing tools via ReAct (and possibly other tool integration patterns, ReAct is just the one I’ve seen and tried) has been explored much at all.
- vagabund 4y agoHow long before we see a material impact on GDP? It seems like basically every knowledge worker can and will augment their workflows with this tech.
- RubberSoul 4y agoGreat question. The answer might be not that soon, and the effects will be confusing. Search "Solow paradox," "productivity paradox," and "IT productivity paradox," and you'll encounter a long debate in economics and management research about the role of computers and ICT spending in productivity.
- sekai 4y agoYou greatly overestimate worker's ability / desire to learn.
- dpkirchner 4y agoA whole lot of us learned how to use the Internet, cell phones, etc. I bet a lot of folks will easily take to an AI/LLM they can converse with.
- jazzyjackson 4y ago> It seems like basically every knowledge worker can and will augment their workflows with this tech. Alternately, 1/10 will be able to adapt to becoming cyborgs responsible for handling the same workload, while 9/10 get laid off
- dragonwriter 4y ago> Alternately, 1/10 will be able to adapt to becoming cyborgs responsible for handling the same workload, while 9/10 get laid off Somehow, vastly decreasing the cost per unit output for the work won’t increase the market clearing quantity?
- mach1ne 4y ago
- monkeydust 4y agoSo this ( https://langchain.readthedocs.io/en/latest/ecosystem/wolfram_alpha.html https://langchain.readthedocs.io/en/latest/ecosystem/wolfram... ) now native in ChatGPT
- ramesh31 4y agoRIP homework
- nomel 4y agoMany of my courses had voluntary homework. Not surprisingly, the only people who passed the final were those that always did their homework. Only a slight restructure will be needed to test student knowledge. This has been due for some time, with the level of cheating that takes place. Related, I will be investing in test proctoring companies.
- haliskerbas 4y agoanswers to the homework have been available for many years now
- ChickenNugger 4y agoHomework: No Proven Benefits: https://www.edutopia.org/no-proven-benefits https://www.edutopia.org/no-proven-benefits
- piinbinary 4y agoI wonder how much more work it will take before a system like this could start to develop novel mathematical proofs
- jkelleyrtp 4y agoWow. This is next level. Jaw dropping. Wolfram Alpha is already a stupidly capable interface. I think we basically have Jarvis now.
- waynenilsen 4y agoI wonder if they're doing something like ReAct under the hood here.
- mxmlnkn 4y agoThis is a match made in heaven, which makes ChatGPT actually useful for factual data. Or the inverse, it makes Wolfram Alpha even more accessible. That example screenshot of ChatGPT generating three queries to Wolfram Alpha in succession in order to answer the initial question is amazing. It's just how a human might have used Wolfram Alpha to do the same.
- comboy 4y agoOpenAI becomes a really powerful corporation right now. Until reasonable alternatives are developed, in many professions you will be basically handicapped without it. And the cherry on top is that they have all inputs. These provide incomparably more data than e.g. google search queries. Not to mention they have a tool which excels at guessing user intention and interests.
- oliveshell 4y agoWhat sort of professions? I think it might really help with writers’ block. But “handicapped without it” in “many professions”? Without detailed support, this reads as a rather absurd and zealous statement.
- splatzone 4y agoAny profession which involves digesting, analysing and organising information will be heavily affected by GPT. If you are the guy manually writing code to extract and interpret information from CSVs or articles, it might take you hours longer than the guy who gets the chatbot to do it in seconds. I predict GPT will be a necessary tool to stay competitive in most middle class jobs within the next year
- travisporter 4y agoBut how can you verify what you find?
- 4y ago
- johndhi 4y agoThis seems very significant to me. Wolfram's biggest problem was always being too geeky and finnicky and pain-in-the-ass-y for most people to use. But ChatGPT is a perfect translator for it. This could be very cool.
- sergiotapia 4y agoFantastic partnership. Solid real factual data with ChatGPTs incredible parsing and prediction.
- AntonioCao 4y agoWow. Can't wait for the lean theorem prover integration.
- jsmorph 4y agoSame. Maybe a GPT-driven super-tactic.
- jorgemf 4y agoI would love to see WolframAlpha using ChatGPT under the hood to solve complex math problems. ChatGPT would have to basically create the plan step by step and Wolfram do the math.
- mrkstu 4y agoThere is a specific part where Stephen specifically does this. Its a very long article and I've skimmed through parts, but the range of capabilities achieved by combining the two tech stacks is pretty mind blowing.
- mhh__ 4y agoIt generating useful Wolfram Code and calling the API would be good but chatgpt being able to generate prompts for a much less expressive but more accurate (if it works) doesn't seem like that much of a step
- mobileexpert 4y agoReally impressed with this. OpenAI has its foot on the gas!
- ftio 4y agoOpenAI and Microsoft have been killing it not only in product but in the go-to-market work they've been doing long before launch. Really superb work. With seemingly every launch, they have a slate of really compelling launch partners already using the new service, giving them a big press bump (from the articles those partners write) and social proof, and of course the product is better because it's already been tested with real customers. Masterclass in product management.
- jug 4y agoYes, it's surprising me how quickly they're moving ahead. It's almost as if this is a plan of staggered launches since some year back coming into fruition. I'm not sure how else they could get weekly major announcements like this.
- v4dok 4y agoThey had some time to strategize while waiting the training to finish
- jimkleiber 4y agoI'm wondering if they are just leapfrogging everyone by using the LLMs to write code faster.
- egman_ekki 4y ago…and copy, marketing strategy, etc
- boringuser1 4y ago[dead]
- waynesonfire 4y agoI'm not surprised. The moment I used ChatGPT it was obvious to me this was going to disrupt Google. MSFT has been trying to displace Google for a LONG time to no avail. The execs are foaming at the mouth and are throwing money and aligning everyone on it.
- layer8 4y agoThis comes at the price of now both OpenAI and Wolfram getting access to your queries (when you use the plugin, of course). I’m hoping we don’t slide into a future where you either have to give up on confidentiality and privacy or else can’t use any “modern” tools anymore.
- sebzim4500 4y agoHow is this different than Google/WA today?
- no_time 4y agoI can't speak for WA, but Google doesn't have my phone number, or any other PII. OpenAI does.
- layer8 4y agoThe data you enter in Google Search is much more limited (at least it is for me). None of the other Google services are essential. (Google Search isn’t essential as well, but it’s a distinctive kind of service in that it isn’t practical to self-host.) With “WA” I guess you mean WhatsApp. For messaging, E2E encryption is now standard, which is not possible for AI services (barring huge breakthroughs in homomorphic encryption). In addition, it’s easy to self-host messaging solutions without losing out on features much.
- 4y ago
- lofaszvanitt 4y agoHow come I'm not seeing a buying spree of content companies and declaring that pulling their data is a nogo, since they want to feed their own model? What is everyone waiting for, really? Why everyone is frozen solid?
- WastingMyTime89 4y agoI don't think people are frozen solid. No one wants to build their own model. This ship has sailed: OpenAI has demonstrated a compelling offer and has a considerable advance. People are in awe and either waiting for the middlewares and simpler API which will make this accessible to their business need or already working on integrating with it. They don't want to build competitors to ChatGPT. They want to be able to use it for their business needs.
- lofaszvanitt 4y agoOf course they want and will.
- sebzim4500 4y ago>declaring that pulling their data is a nogo You can declare what you want, no one is obligated to listen to you.
- anonyfox 4y agono one around me can imagine that people would not google stuff anymore and use a chatbot instead, so why should they be worried about their business that is driven by web traffic from google? all the while they stop googling on their own and only using chatGPT personally. I think its a combination of not being able to imagine that this giant can fall like previous economic giants, in a rather short time, and things on the progress side (AI) moves TOO FAST for many to really grasp
- lofaszvanitt 4y agoChatGPT is slow, its usecase is quite narrow, average ppl do not give a fuck/doesn't help them that much, hype will die down. Google will be fine, they have their own solution and they have the biggest surface area where they can advertise their stuff. Just think back when chrome launched and they advertised it on the search front page. And their browser market share just went up and up. So they can only fuck this up and that would be quite a feat. I see a lot of opportunities, but I don't get it why people are not buying up CC companies. There are a lot of good buys out there for not so much money. And there are companies which gobble up so much user input and their sole purpose is to pull out as much information from real humans as possible, so the only sane explanation to their existence is that they had AI in mind decades before AI was in the headlines.
- RajT88 4y agoWe're going to see more of this in the coming years: A mature technology being bolted onto another mature technology. So we should start imagining all the things being built today which can be bolted onto each other: -Speech synthesis/voice assistants -Walking robots -Deepfakes -ChatGPT/Bard -The now-many Copilots -Language recognition/transcription/translation AI bots are going to be a huge part of the workplace soon. Very soon.
- deleted 4y ago[deleted]
- mach1ne 4y agoWalking robots is the one thing on that list which is unlikely to be solved by LLMs.
- martythemaniak 4y agoAs the President is fond of saying, this is a big fucking deal. One thing I would love is for ChatGPT to be able to help me discover what I can do with Wolfram. There seems to be so much there that is inaccessible.
- theptip 4y agoI bet the Zapier integration is going to be an alignment/security dumpster-fire. Now, when a bot gets prompt-hijacked into a malicious personality, it can make API calls to other systems! Great news. Also, plug-in APIs will presumably be able to prompt-hijack the GPT instance that is calling them. I would not be surprised if we see someone get swatted through GPT this year, I think it’s very likely to be within the next 2 or 3 years.
- consumer451 4y ago> I would not be surprised if we see someone get swatted through GPT this year, I think it’s very likely to be within the next 2 or 3 years. I think the, ummm, interesting thing will be swatting in say 50 different locales simultaneously. Each one could have multiple customized messages for the 911 operators. Next up, Swatting as a Service powered by OpenAssistant!
- siquick 4y agoWhat’s swatted?
- Tepix 4y agohttps://en.wikipedia.org/wiki/Swatting https://en.wikipedia.org/wiki/Swatting
- Zetice 4y agoThis whole thing is an alignment/security nightmare. It's like hooking a lawnmower up to one of those "let the fish steer the car" devices...
- alecfreudenberg 4y agoSweet. Combining the statiscal inference of GPT with the direct calculations of WA is moving towards an arguable AGI. It seems like now it needs some way to define layers of contextual awareness and reasoning beyond next word prediction to really break into the AGI realm.
- cjbgkagh 4y agoAFAIK Wolfram was offered $1B acquisition by MS back when it initially released in order to incorporate it into Bing. Obviously he declined. I wonder what they paying to use it now.
- rvnx 4y agoCould be just zero, because they can consider that given the very very large popularity of OpenAI and the niche popularity of WolframAlpha, that OpenAI is doing free advertisement to WA.
- cjbgkagh 4y agoStephen Wolfram is pretty comfortable being in profitable niches. Even if there was a possible mutually beneficial arrangement it still behooves him to extract value out of it. Especially if upside is disproportionately beneficial to Bing and in time the language model will absorb some of the WolframAlpha capabilities so there is a risk factor involved as well. Plus, people with large egos tend to demand costly tributes to signal their greatness in one form or another.
- rvnx 4y agoTrue but it's quite a danger, another way to see it is that Wolfram is now teaching OpenAI model for free, showing prompt and answers for complex mathematical questions.
- Mike_12345 4y agoThat is not a risk. There are already many examples of questions and answers to engineering/physics/mathematical problems in the existing training set. The issue is that GPT is fundamentally not suited for mathematical reasoning, no matter how much training data you feed it.
- jonplackett 4y agoDoes anyone know how ChatGPT is deciding is should use Wolfram? I’m curious for two reasons 1) previously it didn’t seem to ‘know’ when it was wrong, so it must have some way to detect this now. 2) when there are more (potentially competing competing?) plugins or will be interesting to see how it decides which is the one to use.
- dragonwriter 4y agoWith a fairly naive ReAct implementation with access to, e.g., Wikipedia, GPT-3.5-turbo will decide it should confirm things that it already thinks it knows (one test I remember it doing this on was “What is the largest land animal?” where the “Thought” portion of its response was approximately [wasn’t recording the runs] “I believe its the elephant, but I should confirm”.) So, it doesn’t have to recognize it is wrong to decide that it should use available resources to confirm.
- jonplackett 4y agoCool thanks - so you mean it can detect if it’s ‘unsure’ even if it doesn’t know if it’s perfectly right/wrong? That’s very helpful if so! I wonder if with the right prompting you could get it to return a 0-1 score of accurateness like you get with speech recognition. GPT-4 is great at returning JSON so you can tack on extra attributes with the actual text response.
- nashashmi 4y agoMy assumption: It gets input of real time data from a live source (Wolfram Plugin). It also has lots of data and sources gathered way back when its ?original? data was crawled. And then it evaluates which one is more "precise". Bing AI also has options: Creative, Balanced, and Precise. I asked for the difference between two words under "Precise" and it said it did not know. I changed it to "Balanced" and it gave an answer that was pretty much text book definitions of both words. I asked Bing AI to pretend to be an intellectual on AI concepts. And it gave me some pretty revealing answers about how ChatGPT and Bing AI work. It is suffice to say I know longer think of these AIs as magical anymore. It is just better able to understand what people are _asking_, and then know to give responses that are a direct answer to people's questions.
- realmod 4y agoThis will supplement two of ChatGPT's larger deficiences: math and the veracity of its output. It'll be interesting to see how they price this integration, and how long OpenAI will maintain the $20 pricing for ChatGPT+.
- sebzim4500 4y agoYeah if it keeps improving at this rate $20 for ChatGPT+ will be absurdly low. I can see a future where both this is $100+ per month and the top tier of Copilot is $1000+ per month.
- g9yuayon 4y agoOpenAI is like Google before 2003, dazzling the world with amazing products backed by astonishing technologies that went beyond wild dreams of millions of people. And most importantly, OpenAI kept releasing new features at blazing speed with a few hundred people, just like early days of Google and Microsoft. This reminds me of stark contrast of Google's GSuite and Microsoft Office. Microsoft released new office every couple of years, introducing huge improvements and packing tons of features[1]. In contrast, GSuite appeared to be, hmm, quite quiet. [1] You may argue that no one needs that many features, but I subscribe to Joel Spolsky's idea: https://www.joelonsoftware.com/2001/03/23/strategy-letter-iv-bloatware-and-the-8020-myth/ https://www.joelonsoftware.com/2001/03/23/strategy-letter-iv...
- 411111111111111 4y agoWith meta downsizing all the time and google getting outplayed on their own domain.... I wonder if the big programmer cashcows might realize that scaling up software development is a pipedream and will always become net-negative at some point. I hope not, as my job security kinda depends on there being an abundance of jobs...
- uptownfunk 4y agoWhat happened in 2003?
- g9yuayon 4y agoNothing particular. I just don't remember major successful and speedy product launches from Google after 2003. In that year, Google launched Google Maps, shocking the IT world for how effective AJAX can be, even though the tech itself was invented by MS. Maybe GMaps was so impressive that I forgot what other major launches were after that.
- panopticon 4y agoGMail was pretty impressive in 2004 too. It probably sounds banal now, but not having to constantly delete emails was game changing at the time. I still have access to email going back to 2004 and I find myself looking up things I received over a decade ago.
- ck2 4y agoImagine if one day ChatGPT could digest every scientific paper on the doi.org system (ie. google scholar but actually "comprehend" them)
- trash3 4y ago[dead]
- uptownfunk 4y agoThis is incredible. It's so encouraging to see this type of technological innovation that has potential to really help change the way we learn, find, and discover information.
- DonHopkins 4y agoSociety of the Mind! https://en.wikipedia.org/wiki/Society_of_Mind https://en.wikipedia.org/wiki/Society_of_Mind
- jug 4y agoThis ought to fix a thing or two about its lacking math capabilities as a LLM. Finally it'll get precise and accurate math. It boggles my mind to think of how many ways this will jive with the existing language model capabilities of GPT-4. It's easy to think of these features as isolated islands of features, when they in fact serve to strengthen the coherent whole as the AI.
- ducktective 4y agoWonder what would MATLAB's answer be to this
- snerbles 4y agoA bloated bug-ridden set of plugins behind a $1,000 paywall, but gifted to colleges to lock-in electrical engineering students who don't know any better.
- bandyaboot 4y agoCan’t wait to ask it how the universe works.
- Benchhi 4y agoAn hour ago, I didn't think AGI could happen. But now, after seeing new progress, I changed my mind. AGI might be close. That's what I think.
- ElijahLynn 4y agoLast paragraph: I see what’s happening now as a historic moment. For well over half a century the statistical and symbolic approaches to what we might call “AI” evolved largely separately. But now, in ChatGPT + Wolfram they’re being brought together. And while we’re still just at the beginning with this, I think we can reasonably expect tremendous power in the combination—and in a sense a new paradigm for “AI-like computation”, made possible by the arrival of ChatGPT, and now by its combination with Wolfram|Alpha and Wolfram Language in ChatGPT + Wolfram.
- wolfi008 4y agoYeah it was clear that he'd not pass on an opportunity to praise himself.
- bottlepalm 4y agoBetween this and his last post, he continues to dismiss ChatGPT as fancy next word statistics.
- int_19h 4y agoThat's not the takeaway I got from the "how it works" post. He does describe the word statistics part in detail - which is, of course, pretty fundamental to how it works - but he doesn't claim that it's merely a "stochastic parrot", like many do. On the contrary (highlighting mine): "... this means that ChatGPT—even with its ultimately straightforward neural net structure—is successfully able to “capture the essence” of human language and the thinking behind it. And moreover, in its training, ChatGPT has somehow “implicitly discovered” whatever regularities in language (and thinking) make this possible."
- SideQuark 4y agoThat's exactly what ChatGPT is. It's specifically trained as a next word (well, token) predictor. It has no long term plan, only a local window of context. And inference is completely predict the next token, with a large scales stats prediction model.
- 4y ago
- gary_0 4y agoIn the end I think LLM's will not be used on their own much, and instead more as glue for bringing together a whole bunch of other technology and allowing it to be coordinated with plain English.
- heliophobicdude 4y agoThis is the "Composability" concept being pushed by the people behind LangChain. https://github.com/hwchase17/langchain https://github.com/hwchase17/langchain
- pixl97 4y agoYou can say the same thing about humans... our greatness over the rest of the animal kingdom comes from tool use. Microsoft researches just put out a paper about 'proto-AGI' in the last 24 hours or so, and tool use was a big part of the paper.
- lbeckman314 4y ago"Sparks of Artificial General Intelligence: Early experiments with GPT-4" -- https://arxiv.org/abs/2303.12712 https://arxiv.org/abs/2303.12712
- dTal 4y agoLots of animals use tools. Our "greatness" comes from our ability to compose tools, which is achieved by the ability transfer tools, which is achieved with... language. That "glue" is a superpower.
- notfed 4y agoI'm a little skeptical at GPT-4 doing math. How often will it hallucinate answers? They only gave very few calculus examples. Has anyone tried it? Is it really there yet math-wise?
- sebzim4500 4y agoI haven't played with this (on the waiting list) but from playing with GPT-3.5 and langchain I almost never saw it hallucinate answers. I would imagine this will be better than that.
- Mike_12345 4y agoThis is about GPT-4 calling Wolfram Alpha to do the math. Wolfram Alpha is not a language model.
- campbel 4y agoWolfram Alpha, like Google before it and OpenAI recently are the few bits of software that seemed like complete magic when I first used them. Wolfram Alpha came to my intention when I was in undergrad and while I could have used it to speed through my homework, I spent more time using it as a learning aide, helping me with a variety of examples and visualizations for concepts I was struggling with. Truly incredible that they are now integrated with ChatGPT, I'm excited to try it out.
- fallat 4y ago"It turns out... the singularity was our knowledge merging to form the AI."
- randmeerkat 4y ago> "It turns out... the singularity was our knowledge merging to form the AI." “The cosmos is within us. We are made of star-stuff. We are a way for the universe to know itself.” ~ Carl Sagan
- Lucent 4y agoLooking forward to seeing "Wolfram|Alpha Can't" tweets attempted under this new plugin. https://twitter.com/wacnt https://twitter.com/wacnt
- kratosatreus 4y agoHonestly so confused with all this hate for Google. Ofc they can bounce back, the only thing that’s going to be a product differentiator for a GPT product is data. OpenAI is still trained on the open internet and Microsoft’s data, and also whatever user queries happened. If we want good PERSONAL assistants, that stuff is going to come from either Google or Facebook. OpenAI end-game products will be great Productive assistants but Google will bounce back with their own GPT trained off of everything you put into anything google.
- pffft8888 4y agoCorrect me if I'm wrong but I think Wolfram/GPT integration is missing a huge opportunity: allowing Alpha to tell ChatGPT the algorithm by which it computes the answer. That would allow ChatGPT to create say Python code that solves a mathematical problem correctly and succinctly based on the Alpha algorithms. Only getting the answer is not as interesting as being able to spit out code that solves the problem in every known (to ChatGPT) programming language. I think Wolfram will probably never allow that.
- pffft8888 4y agoDown voting without rebuttal does not add value.. I don't get if you disagree or just woke up on the wrong side of the bed. It's noise, not signal. Grow up.
- grph123dot 4y agoI think that google could use a LLM with wxmaxima and some database, for example using maxima the LLM could show the source code used and perhaps it could adapt the code to new problems.
- gmuslera 4y agoFelt a bit underwhelming the example of communication between them, if it will be just that way. Wolfram Alpha is good, but doesn't hold a candle to how ChatGPT process and understand natural language. That ChatGPT send verbatim the end user input to Wolfram Alpha seem a small step forward over going to Wolfram Alpha and do the very same question. Now, if the output of ChatGPT is in the Wolfram Alpha "language", expressed in a way that it transmit the ChatGPT interpretation of the question in a way that Wolfram Alpha interprets in the same way (like, i.e. you can ask ChatGPT to make the output in mermaid.js language or any format or programming language) that could be something.
- watt 4y agoI put it to you, that GPT can translate a user's free form input into Wolfram's language much better than Wolfram ever could.
- Futurebot 4y agoThe next grail here would be the automatic use of more trustworthy systems like WA when using ChatGPT in general. If one were to ask it to write an essay on a subject, that it'd infer which pieces need fact-checking based on confidence intervals of snippets of discernable and differentiable data, then run a query against said trustworthy system. With this improvement, it would at least never get dates or measurements wrong. I don't think we can ever solve the problem of needing real editors and fact checkers as ultimate sources of truth for ChatGPT's output, especially when it's for something critical, but for many tasks, this would be a major improvement.
- larodi 4y agoSo Google back in the day was doing this thing with matrix multiplication for... page rank and it somehow magically was right. And right for everyone on the globe. Actually very few people understood how the search engine did this damn good order of page results (in the good years), but still was very happy to use it. And few initially understood how to query it! Now some other company is doing very weird sht with their matrix multiplication, but on a... whole different scale, and still some people don't buy into the idea that this can be very big, even though only handful of people actually understand it. Well, where were you Google? Building angular bullsht and not doing matrix multiplication... those guys beat you on your own game, hah!
- johannes1234321 4y agoWhat I think it interesting: Wolfram Alpha gives sources as key part of the result. ChatGPT hides that again, which to me is one of the big problems of ChatGPT - it is convinced of it's results and can't give me any source information for me to judge the result in any meaningful way.
- winddude 4y agoThey had it in the works, but I think the timing is to try and kill some of the momentum from opensource and what people are working on from the leaked llamas.
- zaps 4y agoChatGPT Gets Its “Wolfram Superpowers”! But not the other way around rite Steve!
- superposeur 4y agoReflecting on the complementary strengths of Wolfram and GPT reminds me of Daniel Kahneman’s distinction between “system 1” and “system 2” in the human brain. One system is a kind of freely-associating autopilot (like gpt) and the other kicks in when some deliberate logical manipulation of facts needs doing (like wolfram). (Or at least this was my layman’s impression from reading Thinking Fast and Slow.) Have others thought of this and, if so, is the comparison apt? Is it possible the human brain is simply an LLM melded to a symbol-based system in dialogue with each other?
- replwoacause 4y agoDo we have to pay to use it or will it be included with ChatGPT premium? Wondering if I have to pay for Wolfram and get an API key.
- davelaing 4y agoI wonder how this might impact how it does on the MMLU benchmark?
- deleted 4y ago[deleted]
- consultSKI 4y agoThis is a big deal. Huge.
- bacchusracine 4y agoSo ChatGPT is now at the 'Who wants to be a Millionaire' stage and can phone a friend?
- cubefox 4y agoI'm more skeptical than most people here. Except for certain clearly defined math problems (even math problems often aren't like that), WolframAlpha has turned out to be surprisingly useless for me in the last years. All these examples Wolfram mentions in his blog were possible via the WolframAlpha website/app before. Granted, now you don't have to worry about getting your WA query exactly right (a major problem in the past), since the GPT will handle this for you. But most of these examples seem still of little value to the vast majority of people. Distance between Chicago and Tokyo? Planetary Moons larger than Mercury? Those examples are typical for WolframAlpha in that they are of very little interest. I predict that in a few weeks most people here will have mostly forgotten about the Wolfram plugin, as it will turn out to be rarely useful. The plugins by OpenAI themselves (web access, compiler) are much more promising.
- levgilman 4y agoWhat is it all about? I have paid account at ChatGPT, i asked it and it doesn't know of any such thing. Is it something for privileged ones? At least I cannot understand it from the article. Here is a dialog with ChatGPT I had after reading the article. Is it true that you are now able to search in internet? As an AI language model, I am not able to actively search the internet in real-time. My knowledge is based on the text corpus that I was trained on, which includes data up until September 2021. I am unable to access or browse the web for current or updated information. If you have any questions, I can try to help you based on the knowledge I have, but please be aware that it might not include the latest developments or updates. Lev Gilman What are possible outcomes of recent Xi Tzinping's visit to Russia? As an AI model, I don't have real-time information on current events, and my knowledge is limited to data up to September 2021. Therefore, I cannot provide specific details about recent events such as Xi Jinping's visit to Russia. However, based on historical precedent and general knowledge of diplomacy, I can suggest some possible outcomes that might occur when leaders from two countries engage in high-level talks...
- detaro 4y ago... why would you think these would be useful queries to test this? (instead of maybe one from the article?)
- cykros 4y agoWintermute, meet Neuromancer.
- tracyjvb 4y ago[flagged]
- tracyjvb 4y agoA random sample of size 50 is drawn from a large population. The population standard deviation is 5.6. The sample mean is 10.5. Find a 90% confidence interval for the population mean, 𝜇. Round your answers to the nearest tenth.