https://www.reddit.com/r/LocalLLaMA/comments/16bynin/falcon_180b_initial_cpu_performance_numbers/ https://www.reddit.com/r/LocalLLaMA/comments/16bynin/falcon_..

https://www.reddit.com/r/LocalLLaMA/comments/16bynin/falcon_180b_initial_cpu_performance_numbers/ https://www.reddit.com/r/LocalLLaMA/comments/16bynin/falcon_... has some more data like sample answers with various level of quantizations and https://huggingface.co/TheBloke/Falcon-180B-Chat-GGUF https://huggingface.co/TheBloke/Falcon-180B-Chat-GGUF if you want to try