5 ms·

Bard’s biggest problem is it hallucinates too much. Point it to a YouTube video and ask to summarize? Rather then saying I can’t do that it will mostly make up

Bard’s biggest problem is it hallucinates too much. Point it to a YouTube video and ask to summarize? Rather then saying I can’t do that it will mostly make up stuff, same for websites.

lou_alcala 3y ago
I had a similar issue so I made https://TLDWai.com https://TLDWai.com to summarize YouTube videos
- theblazehen 3y ago
  I've found ChatGPTBox to be useful for it as well, and works on more websites
- Madmallard 3y ago
  how is that site fairing for traffic and conversions?
  - lou_alcala 3y ago
    It was only launched a couple months ago, so low traffic, and no conversions
- spiderfarmer 3y ago
  I could use this for my project but most of my videos don't have any dialogue or voice overs. It would be perfect if it described the actual (visual) video content.
  - lou_alcala 3y ago
    For now it transcribes the audio of the video using Whisper.cpp; but what you say is a good feature that I will be reviewing.
bb88 3y ago
Wake me up when AI based search is actually useful. Then I'll be interested.
- quickthrower2 3y ago
  Useful for ideation stage, but not the truth stage.
  - adrianmsmith 3y ago
    Also useful for generating content about something you already know about e.g. if you have to give a presentation about a particular technology you know to your colleagues. (As you already know about the topic, you can keep the 90% which is correct and discard the 10% which is hallucination.)
- deleted 3y ago
  [deleted]
- lucb1e 3y ago
  I've gotten use out of https://phind.com https://phind.com (was linked on HN at some point I think, I'm not affiliated but use it maybe once a month for a hard-to-find thing)
- mbwgh 3y ago
  I use Kagi's FastGPT (which is really Anthropic Claude I think) for queries I have only a fuzzy idea of how I should put it into words. It's not very verbose and gives you a search summary, consisting of something like four paragraphs, each with a citation at the end. As others have stated, asking it yes/no questions is not really a use case though.
- pelorat 3y ago
  Bing chat is pretty good.
aragonite 3y ago
It will quite often make up non-existent command line syntax purely based on vibes (I'm assuming Google Search uses Bard to generate those AI powered answers to queries like "what's the command line syntax for doing such and such").
seanhunter 3y ago
Yup. For example I asked it some questions in linear algebra[1]. The answers (if you didn't know linear algebra) seemed convincing, full of equations etc but the equations were wrong. Looked good, but just totally wrong in loads of important ways. When I pointed out the mistake it geneally returned with a proof of why its previous result was wrong. Now I could have walked away patting myself on the back, but even with correct equations, the answers were wrong in a deeper, more fundamental way. If you were trying to use it as a tool for learning (a sort of co-pilot for self-study) which is how I use GPT-4 sometimes it would have been really terrible as it could completely mess up your understanding of foundational concepts. It doesn't just make simple mistakes it makes really profound mistakes and presents them in a really convincing way. [1] What's the difference between a linear map and a linear transformation? What are the properties of a vector space? etc
- isaacfung 3y ago
  >What's the difference between a linear map and a linear transformation? Are they not the same?
  - TwentyPosts 3y ago
    They are, at least in my opinion (degree in mathematics). This might be a terminology issue. Not all fields use exactly the same terminology.
  - seanhunter 3y ago
    They are. Bard invented a difference and that is in fact the deep error I was referring to. It said that for a linear map the origin was fixed whereas for a transformation it was ok for the origin to move. Or vice versa I can’t quite remember.
gniv 3y ago
I just tried, and it says "Sorry, I can't summarize YouTube videos yet."
practice9 3y ago
Hallucinatory sources are also bad, as in when you follow the link and the content is completely different compared to what Bard said in its reply

Bard’s biggest problem is it hallucinates too much. Point it to a YouTube video and ask to summarize? Rather then saying I can’t do that it will mostly make up stuff, same for websites.

lou_alcala 3y ago

I had a similar issue so I made https://TLDWai.com https://TLDWai.com to summarize YouTube videos

theblazehen 3y ago
I've found ChatGPTBox to be useful for it as well, and works on more websites
Madmallard 3y ago
how is that site fairing for traffic and conversions?
- lou_alcala 3y ago
  It was only launched a couple months ago, so low traffic, and no conversions
spiderfarmer 3y ago
I could use this for my project but most of my videos don't have any dialogue or voice overs. It would be perfect if it described the actual (visual) video content.
- lou_alcala 3y ago
  For now it transcribes the audio of the video using Whisper.cpp; but what you say is a good feature that I will be reviewing.

bb88 3y ago

Wake me up when AI based search is actually useful. Then I'll be interested.

quickthrower2 3y ago
Useful for ideation stage, but not the truth stage.
- adrianmsmith 3y ago
  Also useful for generating content about something you already know about e.g. if you have to give a presentation about a particular technology you know to your colleagues. (As you already know about the topic, you can keep the 90% which is correct and discard the 10% which is hallucination.)
deleted 3y ago
[deleted]
lucb1e 3y ago
I've gotten use out of https://phind.com https://phind.com (was linked on HN at some point I think, I'm not affiliated but use it maybe once a month for a hard-to-find thing)
mbwgh 3y ago
I use Kagi's FastGPT (which is really Anthropic Claude I think) for queries I have only a fuzzy idea of how I should put it into words. It's not very verbose and gives you a search summary, consisting of something like four paragraphs, each with a citation at the end. As others have stated, asking it yes/no questions is not really a use case though.
pelorat 3y ago
Bing chat is pretty good.

aragonite 3y ago

It will quite often make up non-existent command line syntax purely based on vibes (I'm assuming Google Search uses Bard to generate those AI powered answers to queries like "what's the command line syntax for doing such and such").

seanhunter 3y ago

Yup. For example I asked it some questions in linear algebra[1]. The answers (if you didn't know linear algebra) seemed convincing, full of equations etc but the equations were wrong. Looked good, but just totally wrong in loads of important ways. When I pointed out the mistake it geneally returned with a proof of why its previous result was wrong. Now I could have walked away patting myself on the back, but even with correct equations, the answers were wrong in a deeper, more fundamental way. If you were trying to use it as a tool for learning (a sort of co-pilot for self-study) which is how I use GPT-4 sometimes it would have been really terrible as it could completely mess up your understanding of foundational concepts. It doesn't just make simple mistakes it makes really profound mistakes and presents them in a really convincing way. [1] What's the difference between a linear map and a linear transformation? What are the properties of a vector space? etc

isaacfung 3y ago
>What's the difference between a linear map and a linear transformation? Are they not the same?
- TwentyPosts 3y ago
  They are, at least in my opinion (degree in mathematics). This might be a terminology issue. Not all fields use exactly the same terminology.
- seanhunter 3y ago
  They are. Bard invented a difference and that is in fact the deep error I was referring to. It said that for a linear map the origin was fixed whereas for a transformation it was ok for the origin to move. Or vice versa I can’t quite remember.

gniv 3y ago

I just tried, and it says "Sorry, I can't summarize YouTube videos yet."

practice9 3y ago

Hallucinatory sources are also bad, as in when you follow the link and the content is completely different compared to what Bard said in its reply