gerenuk

9 ms·

31.
Ask HN: How do you manage to keep improving your ML models accuracy?
3 points by gerenuk 9y ago|1 comments
32.
by gerenuk 9y ago
Deepcrawl does that, but again it entirely depends on the website type and infastructure you have got.
33.
by gerenuk 9y ago
For topic modeling, take a look at gensim along with k-means. Also, you can use tf-idf to improve the accuracy.
34.
by gerenuk 9y ago
What would you suggest instead of mongodb for large scale production db? Our DB size is growing on daily basis and currently near to 200GB on a dedicated machine.
35.
by gerenuk 9y ago
Have a look at wasabi.
36.
by gerenuk 9y ago
+1 for incapsula or cloudflare. BTW, interested in learning a bit more about your stack, we are on the same route but at smaller scale.
37.
Ask HN: Storage for Raw HTML? ElasticSearch or Something Else?
2 points by gerenuk 9y ago|1 comments
38.
by gerenuk 9y ago
Check out fastspring.com
39.
by gerenuk 9y ago
Diffbot.com If you want to build your own, take a look at readability library or goose. Their precision is nearly 80%. To remove further noise you can use goldminer algorithm to have improvement furthermore.
40.
by gerenuk 9y ago
We have written distributed crawler using celery/Rabbitmq. Analyzing social signals real time and it is processing more than 10 million requests everyday. On the way to scale it to process more than 50-100 million requests per day. Oth
41.
by gerenuk 9y ago
Vowpal wabbit is approx. 4-8x faster than gensim but the accuracy will be less compared to gensim.
42.
by gerenuk 9y ago
Ezoic.com and taboola.com for the good cpm rates.
43.
Golang or Python for the large scale distributed crawler?
1 points by gerenuk 9y ago|1 comments
44.
by gerenuk 9y ago
Mind sharing which algorithm you are using?
45.
by gerenuk 9y ago
Celery with gevent/process.
46.
by gerenuk 9y ago
The api request was made by users from quite few years but I don't think so they intend to release it any soon.
47.
by gerenuk 9y ago
Thank you, most of the sales were generated through affiliates, our profits after the launch were about 95k. If you check out jvnotifypro or jvzoo.com, you will get an idea. To drive $200k was not simple, we partnered up with a person w
48.
by gerenuk 9y ago
If your product is related to SEO, social media, ppc this can work really well. We recently launched a side project in SEO vertical with couple other partners and did over $200k in sales revenue over a week through our affiliate channel. I
49.
by gerenuk 10y ago
How about asyncio in python 3 and gevent etc. in python 2?
50.
by gerenuk 10y ago
Well said, both Gnip and datasift costs are way too much for the startup companies. And the funny thing about datasift is you can not sign up for the monthly plan and they charge you annually which starts from $60,000 for their basic plan.