LLM's generally don't do math well. GPT-4 has made some strides but I have to wonder if it's using special mechanisms to support it with delegation to special t

LLM's generally don't do math well. GPT-4 has made some strides but I have to wonder if it's using special mechanisms to support it with delegation to special training or modes. I know for a fact Google's Bing has some mechanisms specifically for it too but it's really just crutches that also easily fall apart. These are first and foremost specifically for language... and no, not the "language of math" ;-) If you're interested in doing math on an open model, I'd rather look into integrating LLaMa 2 with Wolfram Alpha. That would be a very nice complement! And there's no reason to see it as admitting defeat. AI and engineering at large is all about using the best tools for the purpose!