3 ms·
sorry, what transformation? A future is simply a placeholder for something being computed asynchronously. On a threadful design you would simply spawn a thread
by gpderetta 6y ago
sorry, what transformation? A future is simply a placeholder for something being computed asynchronously. On a threadful design you would simply spawn a thread (or pick one from a thread pool) to handle the computation. Normally your future runtime would handle it for you.
Basically you end up with something similar to the fork-join model.
- lmm 6y ago> sorry, what transformation? Whenever you want to transform a result that's in a future, e.g. you have a future for a number and want to add 2 to it. > On a threadful design you would simply spawn a thread (or pick one from a thread pool) to handle the computation. If you allow yourself to spawn threads everywhere you'll quickly run out of resources. So you have to manage which thread pool you're using where and ensure you're not bringing in priority inversions etc.. It's really not that easy. > Basically you end up with something similar to the fork-join model. The fork-join model isn't really a purely thread-based model - the work-stealing technique is pretty much trying to reimplement what async-style code would do naturally.
- mlyle 6y ago> ensure you're not bringing in priority inversions etc.. Remember we're comparing to async/futures, which are not really guaranteed to not starve either. At least with thread pools you can, in theory, manage this well.
- lmm 6y ago> Remember we're comparing to async/futures, which are not really guaranteed to not starve either. At least with thread pools you can, in theory, manage this well. With async/futures you're giving the runtime control over these decisions, whereas with threads you're managing them yourself, which can be an advantage but only if you don't make errors with that manual control. An async/future runtime can know which tasks are waiting for which other tasks, letting it avoid deadlocks and a lot of possible priority inversions, and the async style naturally lends itself to writing code that's logically end-to-end (on a single "fiber" even as that fiber moves between threads), which means there's less need to balance resources across multiple thread pools.
- gpderetta 6y agoIf you want to add 2 to a future, you block and then extract the content and add to it. Re spawning threads, depending on the semantics of your framework you cana always execute async operations sychronously.
- lmm 6y ago> If you want to add 2 to a future, you block and then extract the content and add to it. That makes using futures completely pointless. Why not just write blocking code if you're going to block anyway?
- gpderetta 6y agoPipelining and opportunity for parallelization: A = computeA() B = computeB() C = A+B Vs futA = asyncComputeA() futB = asyncComputeB() A, B = waitAll(futA, futB) C = A+B
- lmm 6y agoThat's almost certainly a bad idea in a web server context like this article is talking about. You improve best-case latency when the server's not loaded, but now you're using 3 threads per request to get a less than 2x speedup (and in a bigger example it would be worse), so your scaling behaviour will get worse.
- gpderetta 6y agoalways spawning a thread is of course the naive implementation. You can put an upper bound on the number of threads and fallback to synchronous execution of async operations in the worst case (for example inside the wait call). If your threads are a bit more than dumb os threads (say, an hybrid M:N scheduler) you can do smarter scheduling, including work stealing of course.
- lmm 6y agoWell, as your threads become less like threads and more like a future/async runtime you come closer to the advantages and disadvantages of a future/async runtime, yes.