4 ms·
If you start processing web articles on the scale of millions you'll be surprised by how creative people can be. Not talking about tweets, just news and blog ar
by rmbyrro 4y ago
If you start processing web articles on the scale of millions you'll be surprised by how creative people can be. Not talking about tweets, just news and blog articles.
- JimDabell 4y agoNot surprised, just not relevant. The criteria here is “you can get pretty good results”, not “you must be able to process millions of articles without failure”.
- rmbyrro 4y agoIf a method is not generalizable to the entire dataset, it's not that useful. When processing text at large scale, the usefulness of heuristic approaches like the one we're discussing diminishes rapidly.
- JimDabell 4y ago> If a method is not generalizable to the entire dataset, it's not that useful. No, in many situations, something doesn’t have to be perfect to be useful. Again, I think you are missing the original point being made: > Depending upon your use-case, you can get pretty good results by… You seem to be responding as if I said: > For all use-cases, you can get flawless results by… Pointing out that this is not perfect is irrelevant to the point I was making. “Good enough” is usually good enough.