2 ms·
I built something that does this idea. I wanted to be able to do expensive computations, but I did not want the person on the website to wait on them. It is s
by tmaly 10y ago
I built something that does this idea. I wanted to be able to do expensive computations, but I did not want the person on the website to wait on them. It is sort of like how the old school craigslist does it not updating a category till it gets around to batch processing it.
One example I use it for is image processing of an image that is uploaded. Another is sending an email. And yet another is a ton of database inserts for metrics.
It works in the same manner as a bank queue processing one thing at a time, so you can run it on a smaller server and not worry about overloading your system.
I plan to open source the code in the next week or two if you are interested. I wrote it in Go, and the job queue part uses beanstalkd
- ge96 10y agoWow, Go. I've been listening to a podcast about that "Go time on Change log" I hear a lot of great stuff about it "2000 servers to 2" for example haha, 25,000 concurrent requests per second or some crazy thing. I would have thought this was a common thing. I am interested thanks for offering however I can't really contribute/possibly even use it as I don't know how to use Go at this time. Good luck though with it, I think Go by the sound of it will be even more popular than it is now. I mean they even talked about hardware-control with Go. It sounds incredible. I'll keep it in mind though but yeah outside of my scope at this time, unless it's not difficult to integrate into what I use right now which is LAMP stack on a single-core VPS. Pretty pathetic I know but I domain map. Probably not related but I have a raspberry pi server with Cron (actually working cron) as well that I look to use for prototyping.