Fun project. I'm sure it will get a lot of interest here. For those into vector storage in general, one thing that has interested me lately is the idea of stor

Fun project. I'm sure it will get a lot of interest here. For those into vector storage in general, one thing that has interested me lately is the idea of storing vectors as GGUF files and bring the familiar llama.cpp style quants to it (i.e. Q4_K, MXFP4 etc). An example of this is below. https://gist.github.com/davidmezzetti/ca31dff155d2450ea1b51634a814d37f https://gist.github.com/davidmezzetti/ca31dff155d2450ea1b516...