Working on the AST is quite an interesting idea, until your comments aren't in the AST and you want to commit a syntax error of work in progress. Not to mentio

Working on the AST is quite an interesting idea, until your comments aren't in the AST and you want to commit a syntax error of work in progress. Not to mention changing ASTs (while maintaining concrete syntax) in different versions of the language.