3 ms·
How does one set this up?
by ycombinatrix 2y ago
How does one set this up?
- ignoramous 2y agoWith ggml the mmap part is the default. It isn't a panacea though [0]. Note that most runtimes (like MLX, ONNX, TensorFlow, JAX/XLA etc) will employ a number of techniques for efficient inference and mmap is just one part of it. [0] https://news.ycombinator.com/item?id=35455930 https://news.ycombinator.com/item?id=35455930