3 ms·

ChatGPT uses a 1.7 trillion parameter model IIRC. I wouldn't expect a 70b model to compare well. There are medical finetunes that might be better to try for thi

by nperez 3y ago

ChatGPT uses a 1.7 trillion parameter model IIRC. I wouldn't expect a 70b model to compare well. There are medical finetunes that might be better to try for this, like https://huggingface.co/wanglab/ClinicalCamel-70B https://huggingface.co/wanglab/ClinicalCamel-70B Edit/Correction: as mentioned below, free tier used by OP is in the neighborhood of 175b

johntiger1 3y ago
Where are you getting the 1.7T number from? Genuinely curious, as sources like [1] generally cite 175B. [1]: https://ecoagi.ai/articles/chatgpt-parameters https://ecoagi.ai/articles/chatgpt-parameters
- nperez 3y ago
  I'm not sure, I've tried looking it up and couldn't find an official answer. But that site says GPT3 is 175b and GPT4 is 170 trillion. That's insane if true Edit: and this one says 1.7, idk https://levelup.gitconnected.com/gpt-4-parameters-explained-everything-you-need-to-know-e210c20576ca https://levelup.gitconnected.com/gpt-4-parameters-explained-... Haven't used chatgpt in a bit, but looks like the free tier is GPT3 still, so 175b may be correct if OP isn't a subscriber
  - johntiger1 3y ago
    I was testing on GPT3.5-Turbo, the free tier.
    - nperez 3y ago
      Ah, 175b it is then. That's actually kind of encouraging that an open source trillion+ param model isn't needed to get there. A 180b Falcon model very recently came out https://huggingface.co/tiiuae/falcon-180B https://huggingface.co/tiiuae/falcon-180B A finetune of this might be competitive, but I haven't tried it.
    - nickthegreek 3y ago
      That should be in your article.