3 ms·

I mean, what did the author expect? A really esoteric question that few people, even if they are coders, would understand or even parse and it managed to give a

by Kiro 4y ago

I mean, what did the author expect? A really esoteric question that few people, even if they are coders, would understand or even parse and it managed to give a response that made him go "Woo! That sounds perfect.". That alone would be complete science-fiction just a couple of years ago.

the_real_sparky 4y ago
The really crazy part is that if it were trained on more domain-specific example data then I think it would give pretty great answers to many of the niche questions in those domains. I fully expect that most businesses / industries will have tailored training datasets in the next few years to enable chatbots that assist their employees to do their work. It is at least a partial answer to the high turnover problem that business now face. I have probed it at varying levels of depth in my domain and found it to answer at least as good as an entry-level engineer. This could easily be improved with extended training data. The problem is that when it begins to get things very wrong (or leave out important details), it would be difficult for an inexperienced user to determine that since ChatGPT responds so confidently to every query. It will be interesting to see how this all plays out.
adamckay 4y ago
> I mean, what did the author expect? Presumably for it to reply with its standard "I'm a LLM from OpenAI and don't have access to the internet" instead of "Just use this thing that doesn't exist", followed with "Here's more info on this thing I've totally not made up" and finishes up with "Here's the references that I've just made up to explain the other thing I've just made up". Before finally saying "You got me, I made that stuff up". Using it as-is to support humans is probably going to work well, using it as-is to replace humans is going to lead to some issues.
- Kiro 4y ago
  Imagine reading your comment just a couple of years ago. Wild how the expectations have skyrocketed. Sad that people fall back to being casually dismissive like it's nothing special without appreciating the massive leap in progress.

by Kiro 4y ago

the_real_sparky 4y ago

The really crazy part is that if it were trained on more domain-specific example data then I think it would give pretty great answers to many of the niche questions in those domains. I fully expect that most businesses / industries will have tailored training datasets in the next few years to enable chatbots that assist their employees to do their work. It is at least a partial answer to the high turnover problem that business now face. I have probed it at varying levels of depth in my domain and found it to answer at least as good as an entry-level engineer. This could easily be improved with extended training data. The problem is that when it begins to get things very wrong (or leave out important details), it would be difficult for an inexperienced user to determine that since ChatGPT responds so confidently to every query. It will be interesting to see how this all plays out.

adamckay 4y ago

> I mean, what did the author expect? Presumably for it to reply with its standard "I'm a LLM from OpenAI and don't have access to the internet" instead of "Just use this thing that doesn't exist", followed with "Here's more info on this thing I've totally not made up" and finishes up with "Here's the references that I've just made up to explain the other thing I've just made up". Before finally saying "You got me, I made that stuff up". Using it as-is to support humans is probably going to work well, using it as-is to replace humans is going to lead to some issues.

Kiro 4y ago
Imagine reading your comment just a couple of years ago. Wild how the expectations have skyrocketed. Sad that people fall back to being casually dismissive like it's nothing special without appreciating the massive leap in progress.