4 ms·

I could understand if you don't want to reveal the nature of the data, but what kind of data is it? IM Conversations? Reviews? Data mining wise, it would be nea

I could understand if you don't want to reveal the nature of the data, but what kind of data is it? IM Conversations? Reviews? Data mining wise, it would be neat to build something like a named entity tagger or doing sentiment analysis with it. If you're really ambitious, you could do something like relation extraction with it. There are a lot of monetization options you could do with data like that. Using some of the tools already mentioned here, there's a lot of options available.

philtar 13y ago
The majority of it is newspapers, tweets, facebook statuses, wikipedia, tv show and movie scripts. I've been able to do sentiment analysis with a high (80%+) level of accuracy using only a fraction of what I currently have. I don't think it's really monetizable even though it's (afaik) the only one of it's kind. Not that hard to make. I'm interested in named entity tagging and other things like that that I know for a fact don't exist for Arabic or any of its dialects. Who would pay for that, though?
- agibsonccc 13y ago
  Since you have all of this text, I'm assuming you have access to that audience. You could easily fill a language specific niche that lots of others don't. Here's an example: http://blog.repustate.com/arabic-sentiment-analysis-a-long-journey-is-complete/2012/09/17/ http://blog.repustate.com/arabic-sentiment-analysis-a-long-j... Many of the text analysis APIs on the web only do english, spanish, and maybe chinese. If you could come up with a semi decent system, you could talk to marketers, and actually other developers. For example, I've had people come to me for something as obscure as recognizing locations so they could do geo tagging in a mobile app based on text. If you have any particular industry verticals you're familiar with, there's probably a niche somewhere.

4 ms·

I could understand if you don't want to reveal the nature of the data, but what kind of data is it? IM Conversations? Reviews? Data mining wise, it would be nea

by agibsonccc 13y ago

philtar 13y ago
The majority of it is newspapers, tweets, facebook statuses, wikipedia, tv show and movie scripts. I've been able to do sentiment analysis with a high (80%+) level of accuracy using only a fraction of what I currently have. I don't think it's really monetizable even though it's (afaik) the only one of it's kind. Not that hard to make. I'm interested in named entity tagging and other things like that that I know for a fact don't exist for Arabic or any of its dialects. Who would pay for that, though?
- agibsonccc 13y ago
  Since you have all of this text, I'm assuming you have access to that audience. You could easily fill a language specific niche that lots of others don't. Here's an example: http://blog.repustate.com/arabic-sentiment-analysis-a-long-journey-is-complete/2012/09/17/ http://blog.repustate.com/arabic-sentiment-analysis-a-long-j... Many of the text analysis APIs on the web only do english, spanish, and maybe chinese. If you could come up with a semi decent system, you could talk to marketers, and actually other developers. For example, I've had people come to me for something as obscure as recognizing locations so they could do geo tagging in a mobile app based on text. If you have any particular industry verticals you're familiar with, there's probably a niche somewhere.