2 ms·
You found it because LLMs are incredibly good search engines. But anything they give you that isn't a search result is bullshit. So, they have those two modes
by marcosdumay 3y ago
You found it because LLMs are incredibly good search engines. But anything they give you that isn't a search result is bullshit.
So, they have those two modes of operation, and most of them are built in a way that won't let you know which mode they are working on. That can be useful depending on what you want to do, but it doesn't strike me as the most effective architecture for them.
(They are also reasonably good pattern fitters, what is kinda nice for code autocompletion on some languages. But they are way too inefficient here. Yet, nobody created any good high-efficiency autocomplete that merges searching and pattern fitting, so people use them.)