It would be amazing to add support for M1 aka Metal: I was able to run Q8 version with llama.cpp and it's blazingly fast. The problem: I don't know how much acc

It would be amazing to add support for M1 aka Metal: I was able to run Q8 version with llama.cpp and it's blazingly fast. The problem: I don't know how much accuracy it loses and https://huggingface.co/google/gemma-2b-it/tree/main https://huggingface.co/google/gemma-2b-it/tree/main takes too much memory which results in OOMs. Do you have any estimates on getting Metal support similar to how llama.cpp works? Why `.gguf` files are so giant compared to `.sbs`? Is it just because they use fp32?