mmap does not hide the real RAM usage, it just maps a part of virtual memory address space to an I/O-bound storage medium (e.g. file). That trick does not consu

mmap does not hide the real RAM usage, it just maps a part of virtual memory address space to an I/O-bound storage medium (e.g. file). That trick does not consume RAM in any significant amounts, so there is nothing to hide. However, such image mapping technique is not always suitable for data-intensive workloads due to page thrashing. If it works for llama.cpp then it can be considered a huge success.