3 ms·
Your question makes it sound like you believe it succeeds, but the answer you pasted is incorrect. As for why it fails, it is likely a bias arising from the qu
by espadrine 4y ago
Your question makes it sound like you believe it succeeds, but the answer you pasted is incorrect.
As for why it fails, it is likely a bias arising from the question being way more commonly asked in the corpus with equal mass than with distinct mass, increasing attention weights towards an answer expressing equality.
I believe current LLMs lack some common sense at an architectural level. They learn both specialized facts and general deduction in the same weights class: in my mind, they should separate their world model from their instance model.