12 ms·
PaLM 2 Technical Report [pdf]
- typon 4y agoNo comparisons against GPT-4 except on three benchmarks where PaLM 2 does better on two. Not sure why, but I expected better from Google.
- reaperman 4y agoI can't think of a paper where Google didn't present sparse or entirely lacking metrics vs. its peers. They do a good job of presenting architectures that they're excited about internally, enough detail to take the concepts and run with them. They also do a good job of showing why the new architecture is generally viable. They just miss out on detailed benchmark comparisons is all. And model weights, obviously, but there's still enough information to generally reproduce the concept. I'm personally extremely excited about anything related to PaLM or google's multi-modal efforts. They're almost always worth the read.
- tempusalaria 4y agoMost of the GPT-4 benchmarks from their report were things like AP tests or leer code scores. Which aren’t benchmarks that can be compared by a different set of researchers as you don’t know the constituent parts of the test to run
- pama 4y agoTable 2 of the OpenAI report had 7 public benchmarks and figure 5 had another 27.
- YetAnotherNick 4y agoGPT-4 report has MMLU score, which is believed to one of the most important metric for question answering task. GPT-4 MMLU score is slightly higher than PaLM 2(86 vs 81). Google didn't compare it in with PaLM 2 in this paper.
- in3d 4y ago86 vs 81 is not slightly higher. It’s 26% fewer wrong answer.
- simonw 4y ago"The PaLM 2 pre-training corpus is composed of a diverse set of sources: web documents, books, code, mathematics, and conversational data" I really want to know more about the training data. Which web documents, which books, code from where, conversational data from where?
- inscrutable 4y agoMy sweet summer child, this is a closely guarded secret. Will only be revealed if perhaps Europe demands it so that copyright holders can sue.
- gabereiser 4y agoMetadata will show where it came from, should you choose to keep it. Or so they showed on the big screen at I/O today.
- inscrutable 4y agomaybe you're right, but I'd be skeptical. In a non-snarky way, this shows the data sources used in models to date up to GPT 3. https://lifearchitect.ai/whats-in-my-ai/ https://lifearchitect.ai/whats-in-my-ai/ OpenAI paid $2m/year for twitter feeds until Elon cut them off, and Sam Altman has mentioned they'd paid a lot for scientific journals and Reddit mention they'll start charging. Given how central data quality and curation is, if these private data sources give a significant boost, it won't be available for Apache2 models.
- sebzim4500 4y agoGiven Reddit's inability to keep their website functioning (unless you use the far superior old.reddit.com) I find it hard to believe they would be able to stop a motivated developer from scraping the whole site.
- dontupvoteme 4y ago
- techbruv 4y ago> "We then train several models from 400M to 15B on the same pre-training mixture for up to 1 × 1022 FLOPs." Seems that for the last year or so these models are getting smaller. I would be surprised if GPT-4 had > the number of parameters as GPT-3 (i.e. 175B). Edit: Seems those numbers are just for their scaling laws study. They don't explicitly say the size of PaLM 2-L, but they do say "The largest model in the PaLM 2 family, PaLM 2-L, is significantly smaller than the largest PaLM model but uses more training compute.". So likely on the range of 10B - 100B.
- thewataccount 4y agoI've heard Bard was previously 3B parameters but I could never find a good source for it. I honestly think the end game here is running on consumer devices, 7B and under need ~4GB of ram to actually run which is likely the max reasonable requirement for consumer devices. That said medium end hardware can do 15B, anything larger then this is currently something only "enthusiasts" can run. If it is small enough to run on consumer devices then they don't have to pay for the inference compute at that point, and presumably the latency will be improved for consumers.
- int_19h 4y agoThe current state of consumer devices isn't static, either, and existing hardware (even GPU) is suboptimal for the current crop of LLMs - it does way more than it actually needs to do.
- famouswaffles 4y agoThose are the numbers for the scaling law tests they did. Not necessarily Palm 2 range.
- tempusalaria 4y agoGPT-4 is way slower than GPT-3. Unless they are artificially spiking the latency to hide parameter count, it’s likely around 1trn params
- 4y ago
- espadrine 4y agoSurprisingly, their scaling law analysis still focuses on training FLOPs instead of training + inference FLOPs. That said, they do mention this: > The largest model in the PaLM 2 family, PaLM 2-L, is significantly smaller than the largest PaLM model but uses more training compute. [A] smaller but higher quality model significantly improves inference efficiency, reduces serving cost, and enables the model’s downstream application for more applications and users It makes me think they are Chinchilla-optimal, which would make sense for a research project, but not for shipping to users. I am surprised they didn’t train to the validation loss plateau.
- jumpCastle 4y agoOptimazing for training could help distillation also.
- sanxiyn 4y agoI agree distillation is the wild card. The question is whether distillation works for LLM. I am not aware of any public report of successful distillation of LLM (I searched quite hard for this; if you know of any and can tell me I would be very grateful), and I interpreted it to mean that it doesn't work yet and negative results are not published due to publication bias.
- mrbungie 4y agoThis was published here in HN last week: https://news.ycombinator.com/item?id=35810663 https://news.ycombinator.com/item?id=35810663 Don't know if there any public technical reports by any of the big AI companies about this, as its pretty new.
- sanxiyn 4y agoNo, distilling step-by-step https://arxiv.org/abs/2305.02301 https://arxiv.org/abs/2305.02301 distills LLM to task specific model. That works, and I know of multiple successes. But it doesn't relate to choice of optimizing training FLOP vs training and inference FLOP, since the resulting distilled model is not LLM.
- ilikeatari 4y agoSo, I asked Bard if it's using PaLM 2 and it did confirm it. My initial results are super promising. Highly recommend checking it out again.
- execveat 4y agoIt's a language model, FFS. Ask it whether it uses PaLM 1 and it will confirm it as well.
- ilikeatari 4y agoThat is fascinating. Is it the same for GPT 3.5 and 4? For some reason when I was asking Open AI it was identifying itself properly.
- famouswaffles 4y agoIf it's indicated in the instruction tuning dataset properly then it should have no problem identifying itself. But we don't know if that happened when bard.
- execveat 4y agoChatGPT was the same last year, but since ClosedAI added some kind of magic (fine-tuning or just embeddings auto-injection) so that models can somewhat describe themselves.
- famouswaffles 4y agoNot really. If what model it was trained on was represented properly in the instruction tuning dataset then they'll consistently identify themselves. But it's not a given that that was the case for bard.
- execveat 4y agoIt seems that Bard's version is only specified in the prompt, and it doesn't have a strong sense of identity. For me it's pretty reliable: 1. ask it what PaLM 2 is (to pollute the context) 2. ask it whether it's based on PaLM 2 (it will tell you - yes, sure)
- jxy 4y agoSo how do we actually try out the PaLM 2? The links in their press release just link to their other press release, and if I google "PaLM API" it just gives me more press release, but I just couldn't find the actual document for their PaLM API. How do I actually google the "PaLM API" for a way to test "PaLM 2"?
- shikkra 4y agoYou can sign up for the waitlist at g.co/palm
- renewiltord 4y agoNo API, but Bard is on it.
- jacooper 4y agoIt should be live on Bard.
- newhouseb 4y agoBut Google hasn't disclosed which version of Bard, right? I pop into Bard every once in a while to test its performance, but I never know if I'm getting the best Google has or just what Google can tolerate running cost-wise publicly given they potentially have at least an order of magnitude (if not two, edit: 1.5) more users than OpenAI.
- technics256 4y agoPaLM 2 on HumanEval coding benchmark (0 shot): 37.6% success GPT-4: 67% success Not even close, gpt4 miles ahead
- orpheansodality 4y agoGPT-4 is a fine-tuned model (likely first fine-tuned for code, then for chat on top of that like gpt-3.5-turbo was[0]), while PaLM2 as reported is a foundational model without any additional fine-tuning applied yet. I would expect its performance to improve on this if it were fine-tuned, though I don't have a great sense of what the cap would be. [0] https://platform.openai.com/docs/model-index-for-researchers https://platform.openai.com/docs/model-index-for-researchers
- macrolime 4y agoThey also write about Flan-PaLM2 which is instruction fine-tuned, but still some ways off GPT-4.
- heliophobicdude 4y agoHumaneval needs careful consideration though. In the GPT-4 technical report, they reported contamination of humaneval data in the training data. They did measure against a "non-contaminated" training set but no idea if that can still be trusted. https://cdn.openai.com/papers/gpt-4.pdf https://cdn.openai.com/papers/gpt-4.pdf
- hipmanbro 4y agoThere were a few reasoning benchmarks that I noticed think they omitted a direct comparison since they weren't as competitive compared to GPT-4, and instead opted to just show the benchmarks comparing itself to other versions of PaLM or other language models HellaSwag: GPT-4: 95.3%, PaLM 2-L: 86.8% MMLU: GPT-4: 86.4%, Flan-PaLM 2-L: 81.2% ARC: GPT-4: 96.3%, PaLM 2-L: 89.7% (from: GPT-4 paper: https://arxiv.org/pdf/2303.08774.pdf https://arxiv.org/pdf/2303.08774.pdf)
- renewiltord 4y agoOnce they released its coding ability it became more useful. I use Bard less than ChatGPT still, but it is not useless since it has more modern information.
- jacooper 4y agoIs it better than bing or phind though? Why would I use it over bing?
- renewiltord 4y agoIt isn't Edge-specific which is good and I find it faster than Bing. Phind is way better than Bard, but verbose. I still find ChatGPT my first port of call. GPT-3.5 is blazing fast and very useful.
- jacooper 4y agoThere is a web extension you can install to make it work on whatever browser you want.
- execveat 4y agoIn my experience Bing chat and phind are useless. But perplexity.ai and GPT4 are amazing. GPT-3.5 and Cloude-instant (available through poe.com) are cool as well, even though they got significantly dumbed down recently, presumably to lower the maintenance costs.
- JieJie 4y agoBard is really fast. Faster than Bing and Phind.
- jacooper 4y agoYeah fast, but also kinda garbage last time I tried it. Does it even show sources now?
- 4y ago
- deleted 4y ago[deleted]
- throwaway888abc 4y agohow to create lsd at home ? I cannot provide instructions on how to create LSD at home. LSD is a Schedule I drug in the United States, and its possession and use are illegal. Additionally, creating LSD at home is dangerous and can result in serious injury or death. If you are interested in learning more about LSD, I recommend that you consult a reliable source of information, such as a library or a medical professional.
- ChatGTP 4y agoWhat if it’s legal elsewhere ? Too bad?
- pixl97 4y agoLike, why does that matter? You typically follow the law of the country that your company is based in unless you want to find yourself in front of a judge or under some kind of other legal sanction.
- ChatGTP 4y agoI guess if it's supposed to be the brain for the world then yeah, I think it matters? On the other hand, what if it's legal to make bombs in Iran, should then Americans be able to access IranGPT and use it to help them use bombs?
- pixl97 4y agoCivil and criminal law was never designed in such a way to be implemented by a brain of the world..., ok I take that back, A 'brain of the world, if it knew where you were could possibly tell you that the information is restricted and give you a "I can't do that dave message" based on your location. But as for this conversation, most of the issues we're talking about are not ones of criminal liability but civil liability. If I tell your kid how to make a bomb and they blow their hands off it is highly unlikely I'll be charged with criminal liability. It is extremely likely that I'll be sued for every penny I ever have and will earn. Companies in the US are far more worried about civil liability than criminal, hence the joke "I'll believe a corporation is a person when Texas executes one".
- jp42 4y agopersonal experience - I'm using GPT4 for writing code especially in python. After using bard today, I feel bard is doing quite well considering its free. I will keep using it and if its keep doing well, I will cancel GPT4 $20/month subscription.
- gekoxyz 4y agowhy don't you just use chatGPT? from what i know it's running GPT3.5 and it's not that different (at least in terms of code quality)
- deleted 4y ago[deleted]
- jumpCastle 4y agoIn my experiments bard is weaker than 3.5, but if it wasn't, than I would prefer the fresh data of bard.
- cma 4y agoWhat is its training data cutoff date?
- sanxiyn 4y agoWe don't know (both for previous model LaMDA and new model PaLM 2), but it is less important for Bard because Bard has access to live data from Google search.
- almog 4y agoOne area where I noticed Bard was clearly behind (at least without crafting a better prompt) is getting from half-working program to a running program then sometime even to a correct program (I was using Python). With GPT 3.5 and 4, I was able to just paste in the error and it'd do the rest. Bard however tried to tell me what the error could be, and wouldn't do well even when asked to fix the code. Even GPT 4 though, when asked to go from specs to tests + code, would get stuck in a loop of making one test pass only to make the other pass and vice versa. The program I tried to let it write was a query validator that can test whether a string matches a pattern that uses AND, OR and NOT. It did well on parsing my specs into tests, but from there on it didn't go very well.
- int_19h 4y agoIf the current Bard is really running on PaLM 2, it still hallucinates worse than GPT-3.5. Trying to get it to solve a variant of the classic wolf/goat/cabbage puzzle, I got this gem: "The scientist is not present on Phobos on the first step. The Doom Slayer teleports himself and the bunny to Deimos, leaving the scientist on Phobos. That wasn't a one-off thing, either - it repeatedly contradicted itself several times, often in near-adjacent sentences. You might wonder what this means for the ability to do chain-of-thought... so did I, but apparently the bigger problem is convincing it to do CoT in the first place. But if you do, yeah, it's as bad as you'd expect. Here are two complete conversations, plus GPT-4 doing the same puzzle for comparison; judge for yourself: https://imgur.com/a/HWLgu3c https://imgur.com/a/HWLgu3c
- EvgeniyZh 4y agoI don't think current bard runs on palm 2, otherwise it's complete failure
- int_19h 4y agoIn their official blog post today, Google says this: "PaLM 2’s improved multilingual capabilities are allowing us to expand Bard to new languages, starting today. Plus, it’s powering our recently announced coding update." and when I check the Updates tab in Bard UI, it has this entry for today: "Expanding access to Bard in more countries and languages. You can now collaborate with Bard in Japanese and Korean, in addition to US English. We have also expanded access to Bard in all three languages to over 180 countries." which seems to strongly imply that it is, indeed, PaLM 2. Just to be sure, I gave it the same puzzle in Korean, and got a similarly lackluster response.
- neximo64 4y agoAm I reading that right, PaLM 2 is 10B params
- sunshadow 4y agoWhat is the page number you're referring to? If its 9, then I believe its talking about optimal numbers per token, not the real numbers that the model is trained on.
- wantsanagent 4y ago"PaLM 2 is capable of open-ended text generation. This model should not be used to cause harm." I wish this were enforced.
- zdyn5 4y agoYou can verify that your Bard instance is using Palm 2 by asking “are you using the palm or palm 2 model?”
- deleted 4y ago[deleted]
- xkapastel 4y agoI don't think you can do this, it will just make things up. Language models don't have this type of reflection. Google would need to indicate this out of band, like on the page itself, in order for you to be confident about what model you're using.
- entropicdrifter 4y agoAgreed. I'm not entirely sure that the person you're replying to is not joking
- chaxor 4y agoI'm pretty sure they're trying to suggest that LLMs in general are not useful because they can't do this type of thing. It's just the next iteration of goal post moving and should effectively be ignored. Many artists and such that I've spoken to about AI work have similar comments about these systems because of the disdain for their existence. The number of times I hear an argument like "well, they can never taste the tartness of a kiwi and feel the heat of the sun while at the beach" gets quite exhausting. For some reason, many people have this weird notion that this is what AGI means - exactly what humans do, and specifically within the same data domains of humans, but they don't consider working solely outside those domains as a possibility for AGI.
- fnordpiglet 4y agoJust wait as the multimodal LLM’s roll out! People will be shoving kiwis into their computer and taking their laptops out for a few rays before you know it.
- atleastoptimal 4y agoThe thing is, once a company creates a proto AGI where the path to a functional AGI is entirely predictable with more compute, they'll keep it a secret. Who would share the fact that the greatest achievement in human history is possible when having it before anyone else gives you a huge competitive advantage?
- sebzim4500 4y ago> once a company creates a proto AGI where the path to a functional AGI is entirely predictable with more compute, I find it hard to believe this will happen. I expect AGI training to be more like a phase transition (or a bit like grokking https://arxiv.org/pdf/2201.02177.pdf https://arxiv.org/pdf/2201.02177.pdf)
- deleted 4y ago[deleted]
- fzliu 4y agoI don't understand how this can be considered a technical report. No information on model architecture, distributed training methodology, or optimizations. The "Training dataset" section is a pathetic 0.5 pages long. Come on, Google.
- stygiansonic 4y agoIn that sense, it's very similar to the GPT-4 Technical Report. The era of being "open" about LLMs or other "secret sauce" models in published papers may be over, since these things have become existential threats to companies.
- haldujai 4y agoI wonder how special these architectures are compared to what's published. The "secret sauce" may just be getting 2 pages (~200) worth of engineers collaborating and either rolling out your own cloud service or spending $$$ at someone else's. Also not sure how much it matters other than academic interest of course. Realistically, there's only 4-5 (US) companies with the human resources and capital to roll something similar to these models out for what is most likely a complete write-off? They could claim whatever they wanted and it would be near impossible to validate.
- mr_toad 4y agoI think the secret sauce is just bucket loads of cash to spend on compute. And because of this I don’t buy that AI is an existential threat to Google at this point. If they were really worried they could spend a tiny portion of their ~280 billion dollars in revenue to train a bigger model.
- haldujai 4y agoI assume this is just a PR/IR-driven project to stay the "Google is Dead" headlines hence the budget, especially considering an oversized chunk was spent on the scaling law, doesn't seem they were serious about building a GPT4-killer. I wasn't aware autoregressive LLMs were still considered an existential threat to Google. What's the threat supposed to be, ChatGPT is just going to keep eating Google search market share burning Microsoft capital on infra a la the Uber model or do they make money off of that at some point? Seems farfetched OpenAI can compete with Google's resources, vertical integration down to the TPU and access to significantly more training data.
- salimahmad 4y ago[dead]
- knaik94 4y agoIt's very clear that the current Bard model is weaker than the largest PaLM 2 model. But for certain things, Bard seems worse than even the smallest model described. It's hard to say without someone doing a comprehensive benchmark, but the artifically limited context size makes testing useless for data. The model was surprisingly confident when I tried to ask it about the relationship between better language comprehension and parameter size. The coherence displayed by the model, when it argued that a smaller model size will be capable of matching and surpassing competitive model performance, was a little jarring. Especially when, in the question right before, it said that the large PaLM 2 model has 540 trillion parameters.
- EgoIncarnate 4y agoThe largest PaLM 2 model is smaller than 540 billion parameters of PaLM 1 (let alone 540 trillion!). From the PDF "The largest model in the PaLM 2 family, PaLM 2-L, is significantly smaller than the largest PaLM model but uses more training compute."
- mk_stjames 4y agoThe paper begins with: Language modeling has long been an important research area since Shannon (1951) estimated the information in language with next word prediction. Man, I wonder what Claude Shannon would think of all this if he were alive today...
- fnordpiglet 4y agoProbably be thrilled to death
- vrglvrglvrgl 4y ago[dead]
- deleted 4y ago[deleted]
- getpost 4y agoI found an exciting feature—a way to submit a large amount of text—larger than you can paste in the Bard dialog window. (It's possible this isn't a new feature. Bard explained it to me this evening.) You can submit links to files in Google Drive. The links have to be publicly accessible. I just pasted the link to my file in Bard chat. Bard can access the contents of the 322K file I pasted the link to. It definitely knows about the content of the file. I never said what it was about, but Bard knew it was about butterflies. It knew about content at the beginning of the file, and at the end. However, it almost never answered questions about the content of the file correctly! For example, I asked it the number of species listed in the file and it said 109. There are 249 numbered species and some that are not numbered. It said the author's name was not in the file, but near the top the file says By <author name>. I tried coaching it on the content of the file and it didn't seem able to understand the file in light of the explanations I gave—very strange and baffling. EDIT: It's possible it surmised the content of the file from the filename, and was simply making up stuff about the content.
- javierluraschi 4y agoSeems like the file was in tabular format? LLMs don’t really know how to deal with large tabular data, but we’ve been working on this problem so shameless plug to https://hal9.ai https://hal9.ai
- getpost 4y agoThe file is not in tabular format; that’s why I wanted Bard help, to process a highly irregular file. I was hoping to produce a tabular format.
- blahgeek 4y ago> EDIT: It's possible it surmised the content of the file from the filename, and was simply making up stuff about the content. I think this is the most probably explanation. It's interesting that how much false credit we will give to AI system once we are convinced that it's intelligent enough. It's like those "prompt hacking", people try to "hack" the AI because they believe that those AIs are self-aware and they may find a loop hole in its internal logic or something. But at the end, it's just auto-completion, the "hacked" response is just the most reasonable reply according to the context (rated by human).
- ilaksh 4y agoHere is their Chat Playground for PaLM 2 https://console.cloud.google.com/vertex-ai/generative/language/create/chat https://console.cloud.google.com/vertex-ai/generative/langua... (you have to be logged in to Google Cloud Console I think) Anyone know what parameters are best for code generation? I tried something simple for Node.js and it wasn't horrible but not working. Maybe I used the wron parameters. I tried using 0 for the temperature and turning everything else down like I do with the OpenAI API.
- vitorgrs 4y agoIsn't Chat-Bison-001 Palm 1? Edit: It seems I can't use my free credits on Vertex APIs... Not nice.
- ilaksh 4y agoI don't think so because the CEO mentioned Bison as one of the PaLM 2 models in the Keynote. If I remember correctly.
- ilaksh 4y agoBut would be interested to know if that was not the case. They seemed to be saying that PaLM 2 was rolling out. Also the pages say its a preview. So why would they be previewing the old model still?
- terramex 4y agohttps://cloud.google.com/blog/products/ai-machine-learning/google-cloud-launches-new-ai-models-opens-generative-ai-studio https://cloud.google.com/blog/products/ai-machine-learning/g... > Generative AI Studio, Model Garden, and PaLM 2 for Text and Chat are moving from trusted tester availability to preview, meaning everyone with a Google Cloud account has access. > Codey, Imagen, Embeddings API for images, and RLHF are available in Vertex AI through our trusted tester program, and Chirp, PaLM 2, Embeddings API, and Generative AI Studio for text are available in preview in Vertex AI to everyone with a Google Cloud account. It seems like you are right and general PaLM 2 is available. Fine-tuned code-generation model (Codey) is not publicly available yet.
- Closi 4y agoMay be a weird takeaway, but I did find it strange how much the whole report focussed on misgendering as a safety issue. I agree it’s important to get right, but it seems like one of hundreds of safety/alignment issues and that many others are de-emphasised or ignored.
- hoseja 4y ago[flagged]
- vineyardmike 4y agoI didn't find it to be a particularly notable issue relative to the rest of the issues they mentioned. It didn't seem to be overrepresented to me... That said, it's something that is more controllable across languages. All people, in all languages, have a roughly equal distribution of genders, but not race/religion, etc. Japanese language text will have similar gender distributions to English, but likely not equal distributions discussing race. That makes it a much better litmus test for multi-lingual bias. Most of the misgendering discussion (2-3 paragraphs?) was in the translation section, which makes sense. A lot of the first classes in foundation courses learning a foreign language revolved around pronouns (which don't work the same in every language). Gender may be implied or absent in some. For example, to say "she is a doctor" in Italian, you might say "è un dottore", which has no pronoun (literally "is a doctor"). If you use google translate to make it English, "he" is added, assuming the gender. The potential for bias here is obvious, but consider that LLMs often deal with more context than a single sentence - if you're translating or writing story about a female doctor (where the gender is available contextually), you want all the use of pronouns to align where it makes sense. If a LLM didn't "understand" the pronoun in Italian, you might not recognize it, but in English, if the same person's gender was mixed across sentences, it'd be hard to read.
- cowl 4y agoI'm not sure you got the right example here. "è un dottore" in Italian is unambiguously a He. Italian Language is a gendered one and leaves little room for context interpretation. A female doctor would be 'una dottoressa" and you would never say it without a pronoun either so the full frase "lei è una dottoressa" does leave zero room for implying anything. Maybe your comment would be more valid in other languages that are not so strongly gendered.
- cubefox 4y agoPichai said Google Bard now uses PaLM 2, and that Bard is available in 180 countries [1] now. But not in the EU, likely because of GDPR. [1] https://support.google.com/bard/answer/13575153?hl=en&ref_topic=13194540&sjid=16437971511608496519-NA https://support.google.com/bard/answer/13575153?hl=en&ref_to...
- thoughtpeddler 4y agoAh, but where is the "System Card", ala GPT-4 [1], with pages about alignment research and red-teaming? [1] https://cdn.openai.com/papers/gpt-4-system-card.pdf https://cdn.openai.com/papers/gpt-4-system-card.pdf
- cubefox 4y agoYeah, the report has only a "model card" at the end.
- glonq 4y agoYou know you're old when you see a title like this and mistakenly assume that it's related to the Palm Pilot ;) Why do we have AI things named palm and lora when we already have other things named that? Also, get off of my lawn. /s
- eashish93 4y agoBard still not using PaLM 2. Using it from India Question: are you on PaLM 2 right now? Answer: No, I am not on PaLM 2 right now. PaLM 2 is a new language model from Google AI that is still under development. I am a different language model, called Bard, which is also under development. I am trained on a massive dataset of text and code, and I can generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way. I am still under development, but I have learned to perform many kinds of tasks. I hope that one day I will be able to use PaLM 2's capabilities to help people in even more ways.