3 ms·
Tried to replicate Chinchilla paper and discovered discrepancies
- dragontamer 3y agoI only can see the first post, which is basically useless. I see its a 1/9 post but Twitter is no longer a good place to have these kinds of discussions. Nitter.net is also dead, so my #1 way of reading Twitter posts is gone. I've never posted to Twitter before and rarely read it, so I don't expect to ever need an account.
- aport 3y agoYou can find the preprint, which the Twitter thread summarizes, here (https://arxiv.org/abs/2404.10102 https://arxiv.org/abs/2404.10102)
- cbhl 3y agoOne of the replies to the thread (that you also can't see signed out) contains a link to an "unrolling" of the thread: https://threadreaderapp.com/thread/1780639257389904013.html?utm_campaign=topunroll https://threadreaderapp.com/thread/1780639257389904013.html?...
- RockyMcNuts 3y agoSince they extracted the data shown in a chart and found it didn't match the equations, I'm wondering if this might just mean the chart is messed up.