3 ms·

It would be cool if these models had conversations with us where they ask questions. I think the future of AI is models that ask questions. There is so much dat

It would be cool if these models had conversations with us where they ask questions. I think the future of AI is models that ask questions. There is so much data to be gained by doing this.

swalsh 3y ago
That's just a matter of fine tuning
- seccode 3y ago
  Do you have an example model I could try that does this?
  - amrrs 3y ago
    Try Pi by inflection. It asks a lot of questions.
    - seccode 3y ago
      I tried it, it just asked me how my day was going. I don't think this is doing exactly what I have in mind. But its a step in that direction
- ijustlovemath 3y ago
  That "just" is doing some heavy lifting! GPT-4 is just a few matrix multiplications, how bad can their moat really be?
  - swalsh 3y ago
    I'd bet a synthetic data set could do the job effectively.
  - BoorishBears 3y ago
    Not sure what the snark here is for: It would be trivial to produce a dataset where the model asked you questions then fine-tune on that. People already do it with chain-of-thought and you could get away with a few dozen examples if you wanted to try this.
    - BoorishBears 3y ago
      Out of boredom I decided to prove this too: I asked ChatGPT and Claude for ~200 samples in total. Just uploaded the examples as-is to OpenAI, selected 3.5 as the model to fine-tune and about 20 minutes later I had my model. Works fine, asks good questions, can ask more than 1 follow up question if needed, and actually changes its answers based on the clarifying questions. https://imgur.com/a/SsXunVN https://imgur.com/a/SsXunVN
crowcroft 3y ago
Ok im curious, but I don’t quite understand. What would you want an AI to be asking you, and what would you want it to do with your response(s)?
- seccode 3y ago
  I get advertisements all the time for conditions that I do not have, and that none of my family members have. If you had a model that asked questions, it could learn my medical history and could direct better ads to me. In order for AI to understand the world, it would have to ask questions. Understanding humans is key to understanding the world.
- globular-toast 3y ago
  Learn from them.
- BoorishBears 3y ago
  I ask AI to produce clarifying questions then answer them. Can help in not wasting a bunch of time waiting for an answer that missed the mark. - I think the sibling comment is probably the least attractive reason to have AI ask questions.
  - seccode 3y ago
    I agree, medical history is probably not the sexiest reason to have AI ask questions. I think there are many more reasons; I think the Turing Test is the best metric to evaluate AIs, and current models come nowhere close. When people first meet they ask questions about their background. It would be nice if a model replicated that
    - BoorishBears 3y ago
      > and could direct better ads to me. Is the least attractive part, by far.
      - seccode 3y ago
deleted 3y ago
[deleted]
Me1000 3y ago
100% agreed. Gemini advanced does this sometimes. I wrote about it more in an older thread here: https://news.ycombinator.com/item?id=39445484 https://news.ycombinator.com/item?id=39445484
geor9e 3y ago
Explore this idea more - it's easily implemented in a minute or two via the system prompt. API accounts are free to start and you can use the playground/workbench view, like this: https://imgur.com/h5jFoBM.jpg https://imgur.com/h5jFoBM.jpg . I like Claude but OpenAI is popular too. OpenAI has a nice way to create a gallery of system prompts that act however you like, they call them Agents or GPTs.

It would be cool if these models had conversations with us where they ask questions. I think the future of AI is models that ask questions. There is so much data to be gained by doing this.

swalsh 3y ago

That's just a matter of fine tuning

seccode 3y ago
Do you have an example model I could try that does this?
- amrrs 3y ago
  Try Pi by inflection. It asks a lot of questions.
  - seccode 3y ago
    I tried it, it just asked me how my day was going. I don't think this is doing exactly what I have in mind. But its a step in that direction
ijustlovemath 3y ago
That "just" is doing some heavy lifting! GPT-4 is just a few matrix multiplications, how bad can their moat really be?
- swalsh 3y ago
  I'd bet a synthetic data set could do the job effectively.
- BoorishBears 3y ago
  Not sure what the snark here is for: It would be trivial to produce a dataset where the model asked you questions then fine-tune on that. People already do it with chain-of-thought and you could get away with a few dozen examples if you wanted to try this.
  - BoorishBears 3y ago
    Out of boredom I decided to prove this too: I asked ChatGPT and Claude for ~200 samples in total. Just uploaded the examples as-is to OpenAI, selected 3.5 as the model to fine-tune and about 20 minutes later I had my model. Works fine, asks good questions, can ask more than 1 follow up question if needed, and actually changes its answers based on the clarifying questions. https://imgur.com/a/SsXunVN https://imgur.com/a/SsXunVN

crowcroft 3y ago

Ok im curious, but I don’t quite understand. What would you want an AI to be asking you, and what would you want it to do with your response(s)?

seccode 3y ago
I get advertisements all the time for conditions that I do not have, and that none of my family members have. If you had a model that asked questions, it could learn my medical history and could direct better ads to me. In order for AI to understand the world, it would have to ask questions. Understanding humans is key to understanding the world.
globular-toast 3y ago
Learn from them.
BoorishBears 3y ago
I ask AI to produce clarifying questions then answer them. Can help in not wasting a bunch of time waiting for an answer that missed the mark. - I think the sibling comment is probably the least attractive reason to have AI ask questions.
- seccode 3y ago
  I agree, medical history is probably not the sexiest reason to have AI ask questions. I think there are many more reasons; I think the Turing Test is the best metric to evaluate AIs, and current models come nowhere close. When people first meet they ask questions about their background. It would be nice if a model replicated that
  - BoorishBears 3y ago
    > and could direct better ads to me. Is the least attractive part, by far.
    - seccode 3y ago

deleted 3y ago

[deleted]

Me1000 3y ago

100% agreed. Gemini advanced does this sometimes. I wrote about it more in an older thread here: https://news.ycombinator.com/item?id=39445484 https://news.ycombinator.com/item?id=39445484

geor9e 3y ago

Explore this idea more - it's easily implemented in a minute or two via the system prompt. API accounts are free to start and you can use the playground/workbench view, like this: https://imgur.com/h5jFoBM.jpg https://imgur.com/h5jFoBM.jpg . I like Claude but OpenAI is popular too. OpenAI has a nice way to create a gallery of system prompts that act however you like, they call them Agents or GPTs.