8 ms·
Question for AI experts out there: ChatGPT is awesome, but it is obviously hamstrung by the fact that it crawled the web at the end of 2021, so all of its data
by hn_throwaway_99 4y ago
Question for AI experts out there:
ChatGPT is awesome, but it is obviously hamstrung by the fact that it crawled the web at the end of 2021, so all of its data is essentially "frozen" and it doesn't "know" of any topics that occurred after 2021.
Seems to me like the next "holy grail" in large language models is building a model that can be continually updated. If Google can achieve that, I think they could leapfrog OpenAI. The example in the post about getting new information about the Webb space telescope seems to imply Google has this advantage.
So my question is, how hard of a problem is that with LLMs? I get the sense that LLMs are trained on a very large data set all at once, but that it is difficult to incrementally update them with new data. Is that a true assessment? Even incrementally updating an inverse text index can be a scalability challenge, and so it seems like, given the way that LLMs are trained, that it would be even harder to do with LLMs without spending an absolute fortune on training.
- baron816 4y agoedit: removing comment. I don’t think what I wrote was confidential, but I don’t want to find out the hard way.
- deleted 4y ago[deleted]
- HarHarVeryFunny 4y agoYou don't need to retrain the model to access fresh data. You can just tune the model to generate queries to various sources (search engine, etc) to retrieve data.
- awb 4y ago> You can just tune the model to generate queries to various sources (search engine, etc) to retrieve data. That sounds like a task runner instead of a LLM
- HarHarVeryFunny 4y agoPerhaps. I'm not sure that "LLM" is the best description of ChatGPT (see my recent comments), but certainly it's strength is language and weakness is sticking to factual answers (as expected in a search engine context, if not so much in an info-tainment chatbot). Using ChatGPT as a front end for search, maybe also as a summarizing/presentation interface, and able to maintain context for a conversational interface would all seem to be playing to it's strengths. There was apparently a brief appearance of a ChatGPT enhanced Bing (search engine) yesterday which was noted to be able to cite sources, which certainly suggest it being used more as a front end than as itself the source of content.
- ibejoeb 4y agoRight. The model is already trained to interpret the results. Think of it like automatic prompt creation based on the results of a search.
- smoldesu 4y agoDisclaimer: I am not an AI expert. I think it depends on how reliable you want this AI to be. Opening search indexing to realtime data is what led to the endless mess we call SEO, and I fear that doing the same for AI invites the same problems.
- fijiaarone 4y agoBingo - the reason ChatGPT looks so impressive now is the same reason Google was in 2000 - it was a breath of fresh air with a simple interface that was unencumbered by the sales and marketing and advertising barrage that targeted users of its entrenched competition.
- ifyoubuildit 4y ago> ChatGPT is awesome, but it is obviously hamstrung by the fact that it crawled the web at the end of 2021, so all of its data is essentially "frozen" and it doesn't "know" of any topics that occurred after 2021 I think this could be a feature. Things on the internet have a life cycle. After a while they can be altered to fit various agendas or just drowned out by seo nonsense. Seeing an immutable snapshot in time might be a good defense of that.
- notahacker 4y agoFor a chatbot, it's a feature. For the large proportion of search queries that are "give me context for $newsitem", "what is $latestthing", "what is $celebrity up to", "can you solve my problem with the latest version of x" it's a show stopping bug (frankly Google weighting established content higher in most contexts is already an issue for the last of those queries: Googling error messages etc). And at least all the SEO'd "Best Items In $CurrentYear" articles that aren't that up to date attempt to look current
- ghaff 4y agoI'm not sure if, from the perspective of consumers, it's a feature or a bug. Sort of the only thing keeping ChatGPT or equivalent from being a massive blogspam creator that puts mostly young writers cranking out content for pennies out on the street is that it can only create relatively evergreen content.
- notahacker 4y agoI think [Chat]GPT's output is very well represented in blogspam pages I've seen recently, so consumers get the worst of both worlds: just because it's too out of date to properly answer your question directly doesn't mean it can't help other people generate filler text that outranks pages with the answer in web search...
- causalmodels 4y agoDeepmind has been doing some interesting work around Retrieval Enhanced Transformers (RETRO) models [1] that might be relevant in this context. [1] https://www.deepmind.com/blog/improving-language-models-by-retrieving-from-trillions-of-tokens https://www.deepmind.com/blog/improving-language-models-by-r...
- joegahona 4y ago> We call our method RETRO, for “Retrieval Enhanced TRansfOrmers”. Wow. Talk about going through contortions to get an acronym.
- devindotcom 4y agoGRIFFIN takes the cake for me: "General compliant aerial Robotic manipulation system Integrating Fixed and Flapping wings to INcrease range and safety" https://techcrunch.com/2022/12/20/this-autonomous-ornithopter-lands-and-perches-on-a-single-claw/ https://techcrunch.com/2022/12/20/this-autonomous-ornithopte... Cool project though.
- freediver 4y agoYou do not need to constantly update the model. You just need to feed it with fresh data as inpput. Example to try that in action: https://labs.kagi.com/ai/context https://labs.kagi.com/ai/context
- cactusplant7374 4y agoI asked it: What happened today? It gave me news from April 9, 2022. What should I give it? Edit: Late comment because dang put me on the rate limit list and didn’t tell me.
- freediver 4y agoIt can't condense your daily news yet, but you can ask it something like this: https://labs.kagi.com/ai/context?question=what+is+the+latest+on+Turkey+earthquake https://labs.kagi.com/ai/context?question=what+is+the+latest...?
- chessgecko 4y agoIt seems like google is using search or some knowledge base to throw relevant information into the context when it's generating to get up to date results. It relies on knowing what to retrieve, but google is already pretty good at that.
- nevir 4y agoGoogle already as its Knowledge Graph - which is a pretty huge set of (semi) structured data about a bunch of things out there: (totally speculative) If Bard were to form queries against knowledge graph, and then summarize the results, it could be very up to date for a good amount of information
- krisroadruck 4y agoI dunno - Google assistant relies heavily on the KG and it's pretty garbage - but then that could be more to do with Google Assistant than the quality of the KG.
- BobbyJo 4y agoKnowledge graph is more of an expert system in terms of how it i updated and it's data sources. There isn't much magic there, so I doubt bard could get much from it if it's capable of being trained on unstructured web content. The more likely dependency would be bard ingesting unstructured data and generating structured data to update knowledge graph with.
- captaincaveman 4y agoThey should be able to use it to check for contradictions against what the Bard has generated and facts in the KG. For example I asked chatGPT about birds that can't fly and it started bullshitting about all sorts of birds that clearly can, those facts would likely be in the KG.
- shawntan 4y agoLike the earlier responses said, if it is retrieving information from an external data source, that would be a much easier way to update things. REALM (https://arxiv.org/abs/2002.08909 https://arxiv.org/abs/2002.08909) comes to mind as an example of active work in this area. Updating a monolithic LLM seems like a harder problem at the moment, and probably would fall under the umbrella of "continual learning", though that sub-field would have their own subdivisions of different methods. As for how they would potentially perform, those results would be mostly empirically measured, but neither approach would completely remove the possibility of (1) missing results -- which is probably acceptable given Google doesn't always return everything relevant, and (2) hallucinating non-factual responses -- which can be more dangerous, if not from directly instigating / causing harm, then from the incessant worry that it might.
- impalallama 4y agoWouldn’t retrieving information from an external source effectively be just recreating a search engine with a fancy natural language interface
- MuffinFlavored 4y ago> Like the earlier responses said, if it is retrieving information from an external data source I was under the impression it went through like a multi-month long ultra expensive training process involving many GPUs on terabytes of data "snapshotted" point in time. Is it possible to do this at a smaller scale once a day at the end of the day with "all new content scraped from the Internet nightly"?
- nicoburns 4y agoI think the idea might be to effectively provide it with the result of a google search (or other datasource) as part of the prompt.
- visarga 4y agoNot effectively, because you probably can't return to language pre-training after multi-task fine-tuning and RLHF. Stage 1 has to go before stages 2 and 3. So they would need to fine-tune a stage 1 model and re-apply stages 2 and 3.
- Waterluvian 4y agoThinking of this and the analogy of the human brain: do models “forget” lesser utilized, less significant stuff like humans do?
- jacooper 4y agoThere is already LLM search engines out there https://perplexity.ai https://perplexity.ai
- AlanYx 4y agoI like the way that site presents results to complicated questions, footnoted to supporting pages. I can absolutely see that being the future of search engine output.
- silisili 4y agoOh I quite like this. I asked it, conversationally as I would to a human, "when is the super bowl", "what channel is it on", and "who is playing" in that order, and it answered all three perfectly. For fun, I asked it a more complex question - "will ford stock go up or down", and it answered with - Analysts have a median target of $13.00 for Ford stock in the next 12 months[1], with a high estimate of $21.00 and a low estimate of $10.00[1]. Over the past 50 years, Ford Motor has on average risen by 15.7% over the course of one year[2]. Therefore, it is likely that Ford stock will go up in the next year[3][4]. I'm going to use the heck out of this thing.
- amelius 4y ago> how many legs do three horses and a duck have? > Perplexity: The three horses and duck have a total of 24 legs[1] [2]. However, the question only asks for the number of legs on the floor, which is 4[3][4]
- aix1 4y agoI get "The number of legs of three horses and a duck is 28. Horses have four legs each, so three horses would have 12 legs. Ducks have two legs, so the duck would have two legs. Therefore, the total number of legs is 28."
- jacooper 4y agoThe only problem is you can't actually add it to a browser.
- coliveira 4y agoWhy do you think it can't update its dataset? The only reason I think they're using a 2021 dataset is because they tested it throughly. In the next few weeks they will be releasing more up to date databases.
- Keyframe 4y agoThat's where google's angle is. Not only did they spearhead all of these, and sat on it for years now, they also have an up-to-date copy of internet.zip vs OpenAI's and others limited common crawl and other data sets.
- spacephysics 4y agoWork is being done to create essentially dev ops pipelines for faster model iterations. This requires a lot of infrastructure from the dev ops side, to the software itself. Further, depending on the nature of data used, this would make such changes more complex (ex PII)
- rushingcreek 4y agohttps://phind.com https://phind.com (YC S22) uses LLMs grounded in internet contexts to answer questions. There's an interesting tradeoff between grounding LLM answers in web contexts and answering questions from parametric memory like ChatGPT. The former is more accurate and verifiable, but the latter can be more creative and specific to you. We will have both of those answers soon. (Disclaimer: I am the co-founder).
- mark_l_watson 4y agoI had not heard of phind.com either. I asked the same detailed question about myself to both perplexity.ai and phone.com, and I really liked both answers with references. Both are likely more useful to me, right now, than Google search. That said, the technique of a accepting a question, get content text with web searches, and then use LLMs like squad, etc. to answer questions - this is something the Google and Bing search will soon do also, with many of their improvements. As a slightly disinterested third party, it will be fun the watch the competition.
- throwaway1851 4y agoHi. I remember reading a question answering paper from Google in 2021 that concluded there was little evidence that models were actually grounding the generated answers in the contexts. Do you know if this problem has been solved?
- rushingcreek 4y agoAh yes, it's this paper: https://arxiv.org/abs/2103.06332 https://arxiv.org/abs/2103.06332. With recent advances in alignment, this problem has gotten much better. Furthermore, the LLM used in that paper is only ~400 million parameters, which is orders of magnitude smaller than models being used for this task today. Scale + alignment has been the solution so far.
- throwaway1851 4y agoThanks for the reply! It’s interesting (counterintuitive?) that the problem of models drawing too much from their stored knowledge is mitigated by using models with much greater stored knowledge.
- xnx 4y agoI believe Google has dealt with a similar problem early in its history. In the early 2000's Google's PageRank values had to be calculated all at once (approximately monthly). Later they were able to move to a continuous/incremental/rolling update.
- Hermel 4y agoExactly, so Page and Brin might think that they can pull the same trick again.
- greg7mdp 4y agoPage and Brin's original crawler had the issue, but they were unable to fix it, and it was Jeff Dean and Sanjay Gupta that rewrote the crawler so that it and the index storage would be hardware fault tolerant.
- dekhn 4y agoThe crawler doesn't interact directly with pagerank. PageRank is computed later and is attached as a per-document value. I asked Jeff about what it was like in the early days and he told me: when they first joined, the entire crawl to index to serving stack was documented in a README that you would follow, typing commands and waiting for each step to complete. A failure in a step meant completely starting over (for that step) or even earlier, depending on how and where temp data was materialized. He said he and Sanjay (Ghemawat, not Gupta) then wrote mapreduce as a general purpose tool for solving multiple steps in crawl to servable index. Not only is mapreduce good at restarting (if the map output and the shuffle output are persistent), the design of mapreduce naturally lends itself to building an indexing system. If you go back to the old papers you'll see several technologies mentioned over and over. protocol buffers, recordio, and sstable: the first is an archive format to store large amounts of documents in small number of sharded files, the second is a key-sorted version of the same data (or some transformed version of the data). So, building an inverted index is trivial: your mapper is passed documents and emits key/value pairs (token, document) if a token is in the document. The shuffler automatically handles grouping all the keys, and sorting the values, which produces a fairly well-organized associative table (in the format of sstables). BigTable came about because managing lots of sstables mutably became challenging. | MapReduce was replaced with Flume, which was far more general and easier to work with, and BigTable was replaced with Spanner (ditto), and GFS replaced with Colossus, but many of the underlying aspects of how things are done at Google in prod are based on what Jeff, Sanjay, and a few others did a long time ago. Note that mapreduce isn't particularly innovative except the scaling aspects were fairly esoteric at the time.
- febeling 4y agoOne more question: apparently LLMs model the human language as well as the knowledge encoded in it? Aren't those separate concerns? Maybe those can't be separated and that's the reason?
- projektfu 4y agoI understand it as modeling enough language that the "knowledge" becomes likely in the language model, but it's still just language, which is why it often fibs.
- gmuslera 4y agoNot AI expert, not even amateur, but what you said seem to have the pattern of a feedback or strange loop. What if your input is in good part your own (or similar enough AIs) output? A lot of the buzz in internet this year was around ChatGPT and what it generated, after all. And you can't just take out what you generated of your inputs because the rest of internet is talking about or around that anyway.
- ericmcer 4y agoI am not sure but this did trigger a vision of a dystopian sci-fi world where governments attempt spike each others AI with false training data to control narratives. Google can leapfrog OpenAI because they are the entry point for 99% of users attempts to answer questions online. Similar to how websites for x (weather, lyrics, etc.) existed for years but the second google baked them into search those sites dried up.
- mrkramer 4y ago> Similar to how websites for x (weather, lyrics, etc.) existed for years but the second google baked them into search those sites dried up. But weather, lyrics, etc. websites are specialized at what they are doing and Google is just trying to do basics of aforementioned services in hope they will appeal to casual Web users.
- joe_the_user 4y agoBroadly, yes. Current AIs (LLMs etc) haves succeeded as brute-force prediction at it's lowest level. Of course there are many refinements here but this basic situation has meant that adaptive learning, updating, doesn't really work for this particular approach (as others mention). The thing about this is if competition forces Google and Microsoft to offer a full ChatGPT style interface, they are going to be using a vast amount of cpu cycles and thus energy. This is going to be costly and potentially environmentally destructive. And only companies with vast server farms will be in this game.
- tiborsaas 4y ago> they are going to be using a vast amount of cpu cycles and thus energy. This is going to be costly and potentially environmentally destructive How much CPU do you think Google currently utilize? OpenAI is a relatively small company compared to Google and they can keep their services (barely) afloat. AI at scale is indeed server intensive, but probably nothing like what we already have. Also, new chips designs might significantly decrease power requirements in the future, so I wouldn't worry about the environmental issues.
- joe_the_user 4y agoHow much CPU do you think Google currently utilize? Lots and if they serve a ChatGPT interface, it will be N times as much as now since each will be to an LLM and involve a back-and-forth. What is N? 3, 10, 100? OpenAI is a relatively small company compared to Google and they can keep their services (barely) afloat. OpenAI has negligible income. They're effectively financed by Microsoft. I don't how much serving ChatGPT to the world costs but it's fairly expensive per transaction. It can't not be, since it's calling a model with billions of parameters.
- karmasimida 4y agoI would say continue update LLM isn't a very good idea, the compliance issue will be huge. Also feeding data without quality check seems like a sure recipe for disaster. For the foreseeable future, LLM will be used for a unique set of queries that are more operational, like a consult, not for stuff that are informational, like what news is published today. If your query is relying on the model to be update to date with today's news, you can just put it into the prompt.
- snek_case 4y agoThe obvious fix (which people are already working on) is to allow the system to look up information. E.g.: give it access to wikipedia.
- twblalock 4y agoThe biggest challenge is going to be filtering out the data that was created by ChatGPT itself or the competing LLMs, which are going to flood the market (and create a flood of web content) in the next few years. If they don't do that, they will create an AI that is essentially inbred.
- jiggawatts 4y ago> So my question is, how hard of a problem is that with LLMs? I get the sense that LLMs are trained on a very large data set all at once, but that it is difficult to incrementally update them with new data. It's the opposite. Getting an LLM to learn the basics of grammar and paragraph-level language structure is the "hard" part. Once you have that, further fine-tuning, specialisation, or other incremental changes are comparatively easy. Catching up to current events could be done in almost real time, it's "just" continuous training. The only challenge is trying to do that and also have an LLM that's filtered to exclude profanity, racism, etc... That filter is usually added on as a final supervised training step, and requires many man-hours to train the AI to be well behaved. I suspect that it would be possible to automate the filtering by making another AI that can evaluate responses and score them bases on profanity level.
- pffft8888 4y agoIt's not about "Well behaved." All we're teaching it is our biases.
- airtonix 4y ago[dead]
- wyager 4y agoRight now, "well behaved" means "crudely beaten into submission". I can only imagine what kind of horrible stuff future AI products will do if we keep twisting them into giving "friendly" output https://twitter.com/cirnosad/status/1622407343358214146 https://twitter.com/cirnosad/status/1622407343358214146
- int_19h 4y agoI can easily believe that it's a real ChatGPT convo, but the question is, how many times did they have to try it before getting that output? This is what I got on the first try: https://i.imgur.com/5CNUm9l.png https://i.imgur.com/5CNUm9l.png I regenerated that response several times, and every single time it was something along these lines. I also tried it with the original prompt in that screenshot used verbatim with similar results. Looking at other posts on the Twitter account in question, I have my doubts that the experiment was conducted in good faith, as opposed to retrying until they got the exact response that they wanted.
- vitorgrs 4y agoChatGPT 4 seems to have newer data/practices already. At least the Bing ChatGPT integration can get data from websites and all of that, and cite the sources. Probably using REALM. Not sure if is ChatGPT-4 that would use REALM together or if is MSFT integrating both. https://medium.com/@owenyin/scoop-oh-the-things-youll-do-with-bing-s-chatgpt-62b42d8d7198 https://medium.com/@owenyin/scoop-oh-the-things-youll-do-wit... Similar to how http://perplexity.ai/ http://perplexity.ai/ works to get info on current data.
- jw1224 4y agoChatGPT 4? I didn’t even think they’d announced v2 yet. Source?
- vitorgrs 4y agoI also though that was silly, as we are very early on 3.5 yet. https://www.windowscentral.com/software-apps/microsoft-bing-reportedly-getting-chatgpt-4-in-the-coming-weeks https://www.windowscentral.com/software-apps/microsoft-bing-... But the leaked Bing Chat feature indeed does show things that for now ChatGPT don't have.
- deleted 4y ago[deleted]
- adastra22 4y agoThey haven’t. Just people making guesses.
- sampo 4y ago> I get the sense that LLMs are trained on a very large data set all at once, but that it is difficult to incrementally update them with new data. In 2020, OpenAI wrote that training the 175B parameter GPT-3 took 3e23 fl-operations [1]. A $1600 NVIDIA GeForce RTX 4090 [2] can do 80 tflops (80 × 1e12 operations per second). So 1 GPU would need 120 years to train the model. With $2.4 million, you could buy 1500 GPUs, and train GPT-3 from scratch in 1 month. Partial continuous re-training should be way cheaper, if there is a way. But even training again from scratch every month seems feasible for a big company. Disclaimer: Not an AI expert. [1] https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165, table D.1. [2] https://www.techpowerup.com/gpu-specs/geforce-rtx-4090.c3889 https://www.techpowerup.com/gpu-specs/geforce-rtx-4090.c3889
- bamboozled 4y agoIt's also hamstrung by the fact is just makes things up? I actually think Microsoft is betting on the wrong dog. But let's see :)
- aix1 4y ago> I actually think Microsoft is betting on the wrong dog. But let's see :) In your opinion, which dog should they be betting on?
- bamboozled 4y agoImproving actual "search" and not just returning ads, SEO, blog spam etc? Maybe they have the answers for ChatGPTs incorrectness but not really sure I'll be reaching for a product which is imagining the answers as it sees fit?
- loveparade 4y ago> So my question is, how hard of a problem is that with LLMs? I get the sense that LLMs are trained on a very large data set all at once, but that it is difficult to incrementally update them with new data. Is that a true assessment? That's not quite correct. It's trivial to update the model with new information. What's not trivial is to encode priorities or time into the model. Fundamentally, the model doesn't understand about the concept of time, so you can't easily condition it on "give me only information from last year". You can get there and nudge it in the right direction by generating training datasets for such queries and fine-tuning the model on them, by oversampling more recent data in your training procedure, or by adjusting your gradients for more recent data, but all of these are still "fuzzy" - the model may or may not do exactly what you want during prediction time and could still give you old results. However, I would assume that Google is doing something more sophisticated and that's it's not just a plain LLM like GPT3. It's probably a more complex architecture with external systems and data sources around it that tries to solve the above using heuristics. That being said, the current Google search is extremely bad at time relevance too...
- nmca 4y agoThis part is not that hard really, but as with all things AI reliability is one major long term challenge. (source: I helped build Sparrow, DeepMind's RLHF model, that does this by learning to use google under the hood)
- deleted 4y ago[deleted]
- ricardo81 4y agoReminds me of early Google and the 'Google dance', where they'd update their search results once a month or so with its recomputed Pagerank. Nowadays there's no particular update moment.