I'm not convinced that there isn't more to the story than that. People (including Justine who implemented MMAPing the model and knows how to monitor memory use

I'm not convinced that there isn't more to the story than that. People (including Justine who implemented MMAPing the model and knows how to monitor memory use properly) are seeing that much of the file isn't being paged into memory, and are not quite sure why[1]. Is it a bug? Is the distribution of weights used highly dependent on the prompts? Are some weights somehow unused altogether? This twitter thread rules out some of those, but I don't think it closes the door. [1] https://news.ycombinator.com/item?id=35393615 https://news.ycombinator.com/item?id=35393615 edit: softened some of my claims after reading more updates from over the weekend.