3 ms·
In the benchmarks, are they using the base GPT-4, or are they using a GPT like Grimoire which will be better at coding? If they aren't using Grimoire, isn't it
by hackerlight 3y ago
In the benchmarks, are they using the base GPT-4, or are they using a GPT like Grimoire which will be better at coding? If they aren't using Grimoire, isn't it unfair to compare their fine tuned model to base GPT-4?
- BugsJustFindMe 3y agoIs it unfair if GPT4 still beats them handily?
- anakaine 3y agoIt's probably unfair to the readers that they are only presenting performance against GPT3.5 turbo and not against GPT 4. We could all make our numbers look excellent if we compared them to lesser models.
- BugsJustFindMe 3y ago> they are only presenting performance against GPT3.5 turbo and not against GPT 4 GPT4 is represented in all of the images as the top performer. Are you blind and using a screen reader that doesn't OCR images, by chance? If so you may need to access the linked PDF where the charts are given as text.