3 ms·
AFAIK, PaLM was up and running inside Google long before the hype with ChatGPT. So in the circle of frontier AI researchers, they miss know it. But Google kept
by sinuhe69 3y ago
AFAIK, PaLM was up and running inside Google long before the hype with ChatGPT. So in the circle of frontier AI researchers, they miss know it. But Google kept silence because of the problematic hallucinations and the fear for litigation and their reputation.
Besides, in his analysis, le Cun consistently spoke of GPT as “writing help, no more no, less”.
- cubefox 3y agoPaLM was a base model without any fine-tuning, itself a copy of GPT-3. Maybe you meant LaMDA, which was based on pure instruction fine-tuning without RLHF.
- sinuhe69 3y agoSorry but your claim is so ridiculous. PaLM employs a different model as ChatGPT. And Google also published their result in April 2022, earlier than OpenAI talked about their ChatGPT in late 2022.
- HeatrayEnjoyer 3y agoI don't really care which tech corp did what first, just want to point out GPT-4 was being beta trialed to some bing users in mid 2022.
- cubefox 3y agoPaLM was basically a larger version of GPT-3. It was not similar to ChatGPT. It was a pure token predictor. It was not fine-tuned for chat.
- sinuhe69 3y agoPaLM use a pathway architect, not a decoder only transformer as ChatGPT. At least you can look it up on Wikipedia before making such wild assumptions.
- gmerc 3y agoGoogle didn’t saw a way to monetize the technology within their existing very profitable business model. It’s the convergence of end of ad economy/attention supply growth and Microsoft’s money forcing AI as the next growth narrative that’s forcing google to join the party - at massive cost to them.
- solidasparagus 3y agoGoogle is (was?) just extremely risk averse when it came to AI. Hence why all their great researchers who wanted to put things into the world left.