3 ms·
Almost everything is faster if you can precompute.
by TX81Z 3y ago
Almost everything is faster if you can precompute.
- bshipp 3y agoFor sure, but the approach is quite viable. If 19 out of 20 searches by a user are almost instantaneous and single novel one requires a few seconds, they'll assume a hiccup in their internet connection and still view the site as "really fast". It's certainly useful for limiting demands on expensive hardware.
- teej 3y ago20% of all Google searches are brand new
- andrelaszlo 3y agoAnd use 80% of the resources?
- TX81Z 3y agoEh, a non trivial % of those are likely just brand new misspellings.
- bagels 3y agoThen 80% aren't, and those ones will perform very well.
- paxys 3y agoThe other 20% also perform well. I have quite literally never encountered a Google search that took more than some tens of milliseconds for a round trip.
- bshipp 3y agoYou're absolutely correct. Caching common search queries allows the site to allocate hardware for processing "expensive" queries, with the objective of having both complete at near the same time. Without caching, the cost of operating the site would dramatically escalate.
- winrid 3y agoYup, all FastComments threads are precomputed for all sort directions! Each page comes from the DB in < 1.5ms 75% of the time. It gets tough with pages with 100k+ comments though, so there are different tricks and switches for different flows and data sizes.
- qingcharles 3y agoYour site is killing me. Every page I visit I have to accept the cookies :(
- winddude 3y agowhich is why es uses multiple levels of caching
- magicalhippo 3y agoI recall reading about the local transit department which had gotten some fancy accelerator card to help with route searches, ie when a customer wanted to go from A to B, which busses, trams etc to take. Can't recall if it was "just" a bunch of FPGAs but it was a big-ass PCI card. Some years later I tried to find this story again, and to check if they still used it. Turned out they had ditched it after just a couple of years. As memory sizes had increased, they could just precompute all possible routes for the next day and keep them all in memory...