3 ms·
Commented this on a submission that was a duplicate of this one, but: When GPT's details were allegedly leaked [0] I read about the mixture of experts and wond
by s3p 3y ago
Commented this on a submission that was a duplicate of this one, but:
When GPT's details were allegedly leaked [0] I read about the mixture of experts and wondered if this explains my recent distaste for GPT. Lately I have been using Anthropic's offering (mainly since it is free and has a 100k context window) and I've been surprised at just how well it reasons and understands what I'm asking. It responds like GPT 4 used to, and speaks to me with nuance I haven't seen since Bing released their original chatbot. I still find GPT 4 better if I want to fine-tune the model and make it adopt a persona-- Claude will almost always refuse.
Either way, I'm a bit confused with the way GPT 4 has been changing over time. It seems the team made significant changes to the model quality in favor of performance. Whether accuracy or performance is more important is up for debate, but something is clearly changing.
[0] https://archive.ph/2RQ8X https://archive.ph/2RQ8X
- swyx 3y agoreminder that that "leak" was by a twitter grifter that accessed and reposted wholesale without attribution the contents of a paid newsletter and had the gall to chargeback the credit card. dont encourage him or link to him.