6 ms·

Generative AI is going to be as big of a shift as the internet. We already have chatbots that have internalized the entire internet of billions of humans. We no

Generative AI is going to be as big of a shift as the internet. We already have chatbots that have internalized the entire internet of billions of humans. We now have the ability to have an Einstein-level of genius in our pockets, and we can ask endless questions. Soon, we’ll have personal AI doctors, lawyers, chefs, tutors, teachers, artists, you name it. Every single industry will have personal assistants that will not hallucinate because they are strictly being trained on data in their particular fields.

mcphage 2y ago
Training on data in a particular field will not prevent hallucinations, because the generation algorithm itself works on hallucinations. Anything below the resolution of “looks like the source” is indistinguishable.
- imtringued 2y ago
  When you ask it to do arithmetic operations, its approximation performance is surprisingly good. The expectation is that its responses are good approximations of the query, but not necessarily perfectly accurate. The problem though is that good approximations in the English text domain might care more about good presentation than accurate information content.
croes 2y ago
The carbon dioxide because of the energy consumption will further speed up climate change. And a genius like chatbot is useless if it's used for mindless and malicious tasks. The genius is also still in question. Einstein expressed something new and didn't just repeat existing knowledge.
- PlutoIsAPlanet 2y ago
  Battle between AI and Crypto, what will burn the planet first
  - Rinzler89 2y ago
    Oil.
- 123yawaworht456 2y ago
  the container ship that was used to deliver the dildo in your nightstand drawer all the way from China to the US had probably emitted more carbon dioxide than training GPT4 did.
  - croes 2y ago
    Do you think those dildos get replaced my GPT4 or does the carbon dioxide of the training come on top of that?
    - 123yawaworht456 2y ago
      I think it makes no sense to foam at the mouth about AI energy consumption when it's a drop in an Olympic-size swimming pool. I also think it's just an angle for you people to attack a technology you dislike. just like anti-car zealots don't give a shit whether a car is ICE or EV and have seamlessly switched to preaching about 'walkable cities' instead of their previous rhetoric, you'll adopt some other rhetoric even when the models no longer require whole datacenters to train.
      - croes 2y ago
        We are just at the beginning of wide AI use and MS already said they're emissioning 40% more carbon dioxide.
qeternity 2y ago
> Every single industry will have personal assistants that will not hallucinate because they are strictly being trained on data in their particular fields. Every single output from an LLM is a hallucination. It's just that for good models, most of them make sense.
- cma 2y ago
  If you say "repeat after me: [some string]" and the LLM responds: "[some string]", it hallucinated the string?
  - gruturo 2y ago
    > If you say "repeat after me: [some string]" and the LLM responds: "[some string]", it hallucinated the string? Yes it's always hallucinating. The hallucination just often happens to be the answer you were looking for.
    - HeatrayEnjoyer 2y ago
      If it had not hallucinated what would the output string have been?
    - deleted 2y ago
      [deleted]
WheatMillington 2y ago
Your experience with generative AI is considerably different from mine.
111111101101 2y ago
I think that generative AI is a much bigger deal than the internet and maybe even the Industrial Revolution. The internet mainly sped up existing processes and made them accessible to everyone. We’ve had mail order for over a century, transatlantic communication through the telegraph and radio, and the printing press. If the Industrial Revolution was so impactful because it boosted human productivity, then the ability to spawn hundreds, even thousands, of intelligent 'humans' at will must be an even bigger deal.
- weweweoo 2y ago
  I'm not that impressed until one of those "intelligent humans" can make me a sandwich and deliver it to me. Gen AI's productivity boosting capabilities are seriously limited outside office work, and even there it can't be trusted to perform totally autonomously. It's a big deal, but not a revolution. Now, if combine robotics with Gen AI and some other solutions to form true AGI that can do both tasks in physical world and virtual, then things will get more interesting.
mckravchyk 2y ago
> We now have the ability to have an Einstein-level of genius in our pockets It's pretty cool but what you really mean is that it's a better UI to an encyclopedia and a story / art generator. It has no ability to reason at all and often struggles with simple things.
- viking123 2y ago
  Yeah but this hallucinating parrot will turn into AGI any moment now, so keep buying NVDA.
gmerc 2y ago
Even with RAG there’s hallucinations and the potential for accidental prompt injection. It remains to be seen if this can be solved in a generalizable way.
lifestyleguru 2y ago
As of now all your chatbots give me the exact answer, which made me reach out to the chatbot, and most of the times I was forced to reach out to the chatbot. Plus companies have weird excuse not to hire humans dealing with my ticket.

mcphage 2y ago

Training on data in a particular field will not prevent hallucinations, because the generation algorithm itself works on hallucinations. Anything below the resolution of “looks like the source” is indistinguishable.

imtringued 2y ago
When you ask it to do arithmetic operations, its approximation performance is surprisingly good. The expectation is that its responses are good approximations of the query, but not necessarily perfectly accurate. The problem though is that good approximations in the English text domain might care more about good presentation than accurate information content.

croes 2y ago

The carbon dioxide because of the energy consumption will further speed up climate change. And a genius like chatbot is useless if it's used for mindless and malicious tasks. The genius is also still in question. Einstein expressed something new and didn't just repeat existing knowledge.

PlutoIsAPlanet 2y ago
Battle between AI and Crypto, what will burn the planet first
- Rinzler89 2y ago
  Oil.
123yawaworht456 2y ago
the container ship that was used to deliver the dildo in your nightstand drawer all the way from China to the US had probably emitted more carbon dioxide than training GPT4 did.
- croes 2y ago
  Do you think those dildos get replaced my GPT4 or does the carbon dioxide of the training come on top of that?
  - 123yawaworht456 2y ago
    I think it makes no sense to foam at the mouth about AI energy consumption when it's a drop in an Olympic-size swimming pool. I also think it's just an angle for you people to attack a technology you dislike. just like anti-car zealots don't give a shit whether a car is ICE or EV and have seamlessly switched to preaching about 'walkable cities' instead of their previous rhetoric, you'll adopt some other rhetoric even when the models no longer require whole datacenters to train.
    - croes 2y ago
      We are just at the beginning of wide AI use and MS already said they're emissioning 40% more carbon dioxide.

qeternity 2y ago

> Every single industry will have personal assistants that will not hallucinate because they are strictly being trained on data in their particular fields. Every single output from an LLM is a hallucination. It's just that for good models, most of them make sense.

cma 2y ago
If you say "repeat after me: [some string]" and the LLM responds: "[some string]", it hallucinated the string?
- gruturo 2y ago
  > If you say "repeat after me: [some string]" and the LLM responds: "[some string]", it hallucinated the string? Yes it's always hallucinating. The hallucination just often happens to be the answer you were looking for.
  - HeatrayEnjoyer 2y ago
    If it had not hallucinated what would the output string have been?
  - deleted 2y ago
    [deleted]

WheatMillington 2y ago

Your experience with generative AI is considerably different from mine.

111111101101 2y ago

I think that generative AI is a much bigger deal than the internet and maybe even the Industrial Revolution. The internet mainly sped up existing processes and made them accessible to everyone. We’ve had mail order for over a century, transatlantic communication through the telegraph and radio, and the printing press. If the Industrial Revolution was so impactful because it boosted human productivity, then the ability to spawn hundreds, even thousands, of intelligent 'humans' at will must be an even bigger deal.

weweweoo 2y ago
I'm not that impressed until one of those "intelligent humans" can make me a sandwich and deliver it to me. Gen AI's productivity boosting capabilities are seriously limited outside office work, and even there it can't be trusted to perform totally autonomously. It's a big deal, but not a revolution. Now, if combine robotics with Gen AI and some other solutions to form true AGI that can do both tasks in physical world and virtual, then things will get more interesting.

mckravchyk 2y ago

> We now have the ability to have an Einstein-level of genius in our pockets It's pretty cool but what you really mean is that it's a better UI to an encyclopedia and a story / art generator. It has no ability to reason at all and often struggles with simple things.

viking123 2y ago
Yeah but this hallucinating parrot will turn into AGI any moment now, so keep buying NVDA.

gmerc 2y ago

Even with RAG there’s hallucinations and the potential for accidental prompt injection. It remains to be seen if this can be solved in a generalizable way.

lifestyleguru 2y ago

As of now all your chatbots give me the exact answer, which made me reach out to the chatbot, and most of the times I was forced to reach out to the chatbot. Plus companies have weird excuse not to hire humans dealing with my ticket.