3 ms·
this is fairly easy to test for yourself. What did you try?
by gabipurcaru 3y ago
this is fairly easy to test for yourself. What did you try?
- bberrry 3y agoI don't think it's easy at all without access to the training data. I could ask about some information I find obscure in my native language but I can't be confident someone didn't write about it in English on e.g. reddit.
- sebzim4500 3y agoHow exactly are you proposing he tests this without access to hundreds of thousands of dollars worth of compute? Toy models don't work for this kind of thing, small language models behave qualitatively differently from large ones.