3 ms·
But what real insights do the topics give? The only LDA results I've seen are "fairly obvious" or "not understandable". Seeing a "car, road, light, drive, tri
by stuartaxelowen 10y ago
But what real insights do the topics give? The only LDA results I've seen are "fairly obvious" or "not understandable". Seeing a "car, road, light, drive, trip, ..." topic is not insightful - this is a topic that is obvious to most humans.
A more interesting topic would be one that is understandable but was not obvious, even to the people intimately involved in data's subject matter. These are harder to discover, but they do exist - and I have never seen LDA surface them.
- autokad 10y agoI see quantifiable and visualizible insights. Its also good for generating features, and I can also create interaction features with important n-grams. If it cant give you what you are looking for, maybe you are asking a fish to climb a tree
- nl 10y agoThe purpose of LDA/topic visualisations isn't to do something humans can't do. It's to do it extremely rapidly on large amounts of data.