2 ms·
> I'm waiting for people to start experimenting with the text mining and concordance kind of things LLM techniques can do on those data sets. There's already a
by dragonwriter 3y ago
> I'm waiting for people to start experimenting with the text mining and concordance kind of things LLM techniques can do on those data sets. There's already a market for that kind of thing, but those established systems are dinosaurs that will crumble with a push.
Those established systems have a wealth of expert human annotations and related information that is either not readily publicly available and copyright protected (including their own first-party data), including masses of licensed texts, as well as the ability to enhance what they have with usage data from their extensive network of existing professional and academic users.
Yes, LLMs will transform the space, but LLMs tied into the systems and proprietary data sets of the existing incumbents are likely to be the professional standard and way better than what is publicly available in the near term, unless the incumbents really fumble the ball.
That said, sure, public LLM based systems tying into public, noncopyrighted data can make what is available to the public without expensive subscriptions a lot better than it is today.