3 ms·
Dell has been pushing a new memory standard for laptops (https://news.ycombinator.com/item?id=33048948 https://news.ycombinator.com/item?id=33048948) and even t
by rldjbpin 3y ago
Dell has been pushing a new memory standard for laptops (https://news.ycombinator.com/item?id=33048948 https://news.ycombinator.com/item?id=33048948) and even there you face the realities of latency tradeoffs when physically moving the memory away from the CPU.
i would like to see whether the high memory use cases (like running LLMs) can benefit more from direct memory access to GPU that efforts such as DirectStorage is working on (https://news.ycombinator.com/item?id=33265666 https://news.ycombinator.com/item?id=33265666) and just faster, low-latency drives can bridge this gap faster.