3 ms·
I was having this exact thought around 2015, not longer after spaCy became open source. When I first tested it out, I was blow away how well it performed in eve
by axegon_ 3y ago
I was having this exact thought around 2015, not longer after spaCy became open source. When I first tested it out, I was blow away how well it performed in every possible task: it was light years ahead of nltk and gensim, which were the big and well established players in that space. Even back then I was certain that in the not-so distant future, data will cost a fortune: considerably more than it already did. And I won't lie, starting to harvest data online on a massive scale did cross my mind and capitalize on it when the day comes. And now I really regret not doing it. Reddit closed itself off, so did stackoverflow, twitter is a no go, facebook made it nearly impossible. Cloudflare makes traditional scraping nearly impossible, if scraping wasn't already a nightmare with the modern web stacks: the doors are nearly shut and it will only get worse.
It really hurts me to know that I expected this to happen and didn't do anything about it. Oh well... One of many missed opportunities in my life I suppose(WAY more than I'd like to admit).