I've been running Falcon 40bn instruct with 8 and 4bit quantization to great effect with the projects I'm developing locally. In terms of reasoning it's able to

I've been running Falcon 40bn instruct with 8 and 4bit quantization to great effect with the projects I'm developing locally. In terms of reasoning it's able to get many things in one shot that smaller models take n where n is 5 or more shots to get. The jump in performance is obvious for anyone following along with LLM scaling laws, but this is the only model of its scale where you can go out and build a product without concerns. At first they had a pretty onerous commercialization clause they added to the Apache V2 (10% of revenue after 1MM), but it has since been removed making this fully open and good as a base for all types of tasks. I'm very excited to see what people are going to be able to do over the next few months.