4 ms·
We found that GPT-4 performs at a very high level on dermatology specialist exam questions (which it would not have been trained on) https://www.medrxiv.org/co
by sungam 3y ago
We found that GPT-4 performs at a very high level on dermatology specialist exam questions (which it would not have been trained on)
https://www.medrxiv.org/content/10.1101/2023.07.13.23292418v1 https://www.medrxiv.org/content/10.1101/2023.07.13.23292418v...
- RandomLensman 3y agoThe questions were public available. The point is the model wasn't specifically trained for dermatology.
- 4death4 3y agoWhy wouldn’t it have been trained on such questions?
- sungam 3y agoNot publicly available
- RandomLensman 3y agoAbstract says the sample questions were public available. The point they are making is that the model wasn't specifically trained for dermatology.
- pyinstallwoes 3y agoWhat makes you think that the entire body of private access journals and books hasn’t been used?
- civilized 3y agoExtensive medical information is publicly available on websites like www.nhs.uk. So even if it wasn't literally trained on exam questions, it may have picked up substantially identical information elsewhere. Which is still a significant feat. But I doubt it's doing anything more than the sort of semantic lookup that is already well-known to be within its capabilities.