I wonder if we can use the vector representations from the inner layers of LLMs to create some kind of semantic code and text analysis tools. Maybe such a tool

I wonder if we can use the vector representations from the inner layers of LLMs to create some kind of semantic code and text analysis tools. Maybe such a tool can highlight salient areas, and tag regions of code as "boilerplate", "standard idiom in this language", "business logic", "performance optimization", et alia. As for taking notes, is there a IDE (or better yet a Vim plugin) that lets me annotate specific lines or regions with my own notes and comments? Or even annotate functions and classes that way, so I can see those comments in a pop-up box whenever I hover over an annotated function.