4 ms·

So, the model is bad at helping in this particular task. How does this compare with a control of a beneficial human task? Like someone in a lab testing blood

So, the model is bad at helping in this particular task. How does this compare with a control of a beneficial human task? Like someone in a lab testing blood samples or working on cancer research? Is the model equally useless for those types of lab tasks? What about other complex tasks, like home repair or architecture? Is this a success of guardrails or a failing of the model in general?

colechristensen 3y ago
Here's what LLMs are good for: * Taking care of boilerplate work for people who know what they are doing (somewhat unreliably) * Brainstorming ideas for people who know what they are doing * Making people who don't quite know what they're doing look like they know what they're doing a little better (somewhat unreliably) LLMs are like having an army of very knowledgable but somewhat senseless interns to do your bidding.
- AnimalMuppet 3y ago
  So, like minions in "Despicable Me"?
- TheAceOfHearts 3y ago
  This basically matches my own experience. ChatGPT is amazing for brainstorming and coming up with crazy ideas / variations, which I can then use as a starting point and refine as needed. The other use-case is generating command line invocations with the correct flags without having to look up any reference documentation. Usually I can recognize that the flags seem correct, even if I wouldn't have been able to remember them from the top of my head.
- stcredzero 3y ago
  LLMs are like having an army of very knowledgable but somewhat senseless interns to do your bidding. I prefer to think of them as the underwear gnomes, just more widely read and better at BS-ing. What happens when everyone gets to have a tireless army of very knowledgeable and AVERAGE common sense interns who have brains directly wired to various software tools, working 24/7 at 5X the speed? In the hands of a highly motivated rogue organization, this could be quite dangerous. This is a bit beyond where we are now, but shouldn't we be prepared for this ahead of time?
kjkjadksj 3y ago
Someone working in a lab doing routine blood work isn’t going to benefit from this. They aren’t doing anything novel just running the same assay a hundred times a week. A machine can do that job without ai today. Someone working in cancer research is probably doing novel work on the other hand. They might not be doing routine assays but optimizing their own one off assay. Since gpts are trained on existing data it probably won’t be very useful for novel work outside of vetting the literature perhaps, but gpts botch that pretty badly in fact unfortunately. Lots of mistranslated information lacking correct context and not a lot of citing of sources. Better to just read human generated review articles to get a top down technical summary of the subject.

colechristensen 3y ago

Here's what LLMs are good for: * Taking care of boilerplate work for people who know what they are doing (somewhat unreliably) * Brainstorming ideas for people who know what they are doing * Making people who don't quite know what they're doing look like they know what they're doing a little better (somewhat unreliably) LLMs are like having an army of very knowledgable but somewhat senseless interns to do your bidding.

AnimalMuppet 3y ago
So, like minions in "Despicable Me"?
TheAceOfHearts 3y ago
This basically matches my own experience. ChatGPT is amazing for brainstorming and coming up with crazy ideas / variations, which I can then use as a starting point and refine as needed. The other use-case is generating command line invocations with the correct flags without having to look up any reference documentation. Usually I can recognize that the flags seem correct, even if I wouldn't have been able to remember them from the top of my head.
stcredzero 3y ago
LLMs are like having an army of very knowledgable but somewhat senseless interns to do your bidding. I prefer to think of them as the underwear gnomes, just more widely read and better at BS-ing. What happens when everyone gets to have a tireless army of very knowledgeable and AVERAGE common sense interns who have brains directly wired to various software tools, working 24/7 at 5X the speed? In the hands of a highly motivated rogue organization, this could be quite dangerous. This is a bit beyond where we are now, but shouldn't we be prepared for this ahead of time?

kjkjadksj 3y ago

Someone working in a lab doing routine blood work isn’t going to benefit from this. They aren’t doing anything novel just running the same assay a hundred times a week. A machine can do that job without ai today. Someone working in cancer research is probably doing novel work on the other hand. They might not be doing routine assays but optimizing their own one off assay. Since gpts are trained on existing data it probably won’t be very useful for novel work outside of vetting the literature perhaps, but gpts botch that pretty badly in fact unfortunately. Lots of mistranslated information lacking correct context and not a lot of citing of sources. Better to just read human generated review articles to get a top down technical summary of the subject.