This just in for the 8GB (4GB?) crowd... https://github.com/lyogavin/Anima/tree/main/air_llm https://github.com/lyogavin/Anima/tree/main/air_llm ..seems to b

This just in for the 8GB (4GB?) crowd... https://github.com/lyogavin/Anima/tree/main/air_llm https://github.com/lyogavin/Anima/tree/main/air_llm ..seems to be enabled by Apple's new MLX framework (which could become even faster https://github.com/ml-explore/mlx/issues/18 https://github.com/ml-explore/mlx/issues/18 --ANE support would be particularly important on a lowly M1, which is the main system that would have been configured with only 8GB)