3 ms·
It's a lot of data, but not THAT much data. Nothing that a small amazon cluster Hadooping it couldn't do in just an hour or so. If anything, the bottleneck woul
by tibbon 17y ago
It's a lot of data, but not THAT much data. Nothing that a small amazon cluster Hadooping it couldn't do in just an hour or so. If anything, the bottleneck would probably be the URL shorting services themselves.
- chronomex 17y agoYeah. I have a multithreaded perl script that can basically peg the database on the far end. This usually happens at about 20-30 threads. It sort of leaks memory, to the point that restarting it every day or so is advisable. http://github.com/chronomex/urlteam http://github.com/chronomex/urlteam if you're interested in my code.