4 ms·
The empirical argument actually states that memory access is O(n^1/2) https://www.ilikebigbits.com/2014_04_21_myth_of_ram_1/3_fit.png https://www.ilikebigbits.
by jychang 1y ago
The empirical argument actually states that memory access is O(n^1/2)
https://www.ilikebigbits.com/2014_04_21_myth_of_ram_1/3_fit.png https://www.ilikebigbits.com/2014_04_21_myth_of_ram_1/3_fit.... "The blue line is O(√N)."
This has been rehashed many times before, and the best blog post on this topic is here: https://www.ilikebigbits.com/2014_04_21_myth_of_ram_1.html https://www.ilikebigbits.com/2014_04_21_myth_of_ram_1.html
- mathgradthrow 1y agoEmpirical arguments do not apply to asymptotics anyway.
- bollu 1y agoThat's really neat, I hadn't seen the black hole argument before, that's really cute
- acje 1y agoThanks for the good links. I think we generally have become so accustomed to the scaled up von Neumann strategy that we don´t see how much efficiency and performance we leave on the table by not building much smaller memory hierarchies. Shameless plug here, where I explore possible gains in efficiency, performance and security by scaling out rather than up; (no subscription) https://anderscj.substack.com/p/liberal-democracies-needs-a-new-compute-d56 https://anderscj.substack.com/p/liberal-democracies-needs-a-...