4 ms·
This recent article on Hacker News seems to suggest similar inconsistencies. GPT-4 Turbo with Vision is a step backward for coding (aider.chat) https://news.yc
by thomashop 2y ago
This recent article on Hacker News seems to suggest similar inconsistencies.
GPT-4 Turbo with Vision is a step backward for coding (aider.chat)
https://news.ycombinator.com/item?id=39985596 https://news.ycombinator.com/item?id=39985596
Without looking deeply at how cross-attention works, I imagine the instruction tuning of the multimodal models to be challenging.
Maybe the magic is in synthetically creating this instruct dataset that combines images and text in all the ways they can relate. I don't know if I can even begin to imagine how they could be used together.
- afro88 2y agoThe same guy found 4o to be much better GPT-4o takes #1 and #2 on the Aider LLM leaderboards https://news.ycombinator.com/item?id=40349655 https://news.ycombinator.com/item?id=40349655 Subjectively, I've found Aider to be much more useful on 4o. It still makes mistakes applying changes to files occasionally, but not so much to make me give up on it.
- deleted 2y ago[deleted]
- IanCal 2y agoAnecdotally 4o has been working much better for coding for me, building things right the first time with less prodding. It may be a small shift in performance but it crosses a threshold where it's now useful enough and fast enough to be different from turbo.