5 ms·

Just because he is an engineer does not mean he can predict how near future AI products will turn out. Web3 was a circle jerk within the crypto community. It o

by rapsey 4y ago

Just because he is an engineer does not mean he can predict how near future AI products will turn out. Web3 was a circle jerk within the crypto community. It only convinced fools. Recent GPT/stable diffusion products universally blow people away with their output. Engineers and everyone else regularly dismiss new tech for its shortcomings and completely miss the forest for the trees.

chimprich 4y ago
Chollet's view on this can't just be dismissed. There can't be many people better positioned to understand the current state of the art and the immediate prospects for advancement. It's fine to disagree with him, but most people doing so will be from a much less informed position.
- rapsey 4y ago
  He is however at Google and they are in the inevitable innovator's dilemma. MS is going all out on GPT with Bing and Office integrations.
- karmasimida 4y ago
  If I am not mistaken, he doesn't have publications (edit: one publication, along with 70+ co-authors) in NLP: https://scholar.google.com/citations?hl=en&user=VfYhf2wAAAAJ&view_op=list_works&sortby=pubdate https://scholar.google.com/citations?hl=en&user=VfYhf2wAAAAJ... His work on Keras is admirable, but that is about it.
- Terretta 4y ago
  > Chollet's view on this can't just be dismissed." Then why did Chollet dismiss it? "If this had been a blog post and not a random spur-of-the-moment train of thoughts, I wouldn't have made the AI/web3 comparison. It was counterproductive, as it is what most folks are now focusing on." "The two are, in fact, very much not the same."
ben_w 4y ago
> Recent GPT/stable diffusion products universally blow people away with their output. I see a lot more naysayers than you. While I am impressed, plenty are unconvinced. (I really need to make time to test it against random standard written qualifications; if anyone has some example exams and marking schemes, in any language, please let me know. I have Polish maths, plus English and Irish school leaving certificates).
giantrobot 4y ago
> Recent GPT/stable diffusion products universally blow people away with their output. I've yet to be blown away by either system. I guess I am just incredibly cynical but the output of ChatGPT and Stable Diffusion aren't all that impressive to me. A lot of Stable Diffusion art just looks like browsing random DeviantArt or ArtStation pages. ChatGPT reminds me of IRC Markov bots, it produces the same non-sensical crap that they would. Only when a prompt hews incredibly close to some training content does it seem to product cogent output. Both will get better and might become more impressive to me but right now that's not the case. My main issue is neither system actually understands what it is being asked. They're relying on the viewer's tendency for apophenia and pareidolia do make them think the system understood what it was asked. I think there's justification for heavy skepticism for the future of these systems because we're approaching the point where their incorrect/inaccurate output is going to end up feeding the next generation systems' training data.

by rapsey 4y ago

chimprich 4y ago

Chollet's view on this can't just be dismissed. There can't be many people better positioned to understand the current state of the art and the immediate prospects for advancement. It's fine to disagree with him, but most people doing so will be from a much less informed position.

rapsey 4y ago
He is however at Google and they are in the inevitable innovator's dilemma. MS is going all out on GPT with Bing and Office integrations.
karmasimida 4y ago
If I am not mistaken, he doesn't have publications (edit: one publication, along with 70+ co-authors) in NLP: https://scholar.google.com/citations?hl=en&user=VfYhf2wAAAAJ&view_op=list_works&sortby=pubdate https://scholar.google.com/citations?hl=en&user=VfYhf2wAAAAJ... His work on Keras is admirable, but that is about it.
Terretta 4y ago
> Chollet's view on this can't just be dismissed." Then why did Chollet dismiss it? "If this had been a blog post and not a random spur-of-the-moment train of thoughts, I wouldn't have made the AI/web3 comparison. It was counterproductive, as it is what most folks are now focusing on." "The two are, in fact, very much not the same."

ben_w 4y ago

> Recent GPT/stable diffusion products universally blow people away with their output. I see a lot more naysayers than you. While I am impressed, plenty are unconvinced. (I really need to make time to test it against random standard written qualifications; if anyone has some example exams and marking schemes, in any language, please let me know. I have Polish maths, plus English and Irish school leaving certificates).

giantrobot 4y ago

> Recent GPT/stable diffusion products universally blow people away with their output. I've yet to be blown away by either system. I guess I am just incredibly cynical but the output of ChatGPT and Stable Diffusion aren't all that impressive to me. A lot of Stable Diffusion art just looks like browsing random DeviantArt or ArtStation pages. ChatGPT reminds me of IRC Markov bots, it produces the same non-sensical crap that they would. Only when a prompt hews incredibly close to some training content does it seem to product cogent output. Both will get better and might become more impressive to me but right now that's not the case. My main issue is neither system actually understands what it is being asked. They're relying on the viewer's tendency for apophenia and pareidolia do make them think the system understood what it was asked. I think there's justification for heavy skepticism for the future of these systems because we're approaching the point where their incorrect/inaccurate output is going to end up feeding the next generation systems' training data.