4 ms·
Probably because there's a ton of code that deals with nested parentheses across languages in the training data, and models have learned how to work around toke
by kgeist 7mo ago
Probably because there's a ton of code that deals with nested parentheses across languages in the training data, and models have learned how to work around tokenization limitations, when it comes to parentheses.
- astrange 7mo agoIt's because the models wouldn't work for coding if they couldn't do nested scopes, so people don't release models unless they work. They can only do it in a limited form though, because transformer models only have limited "memory". I don't think they can fully implement parsing.