I don't think either word, "puzzle" or "problem", requires it to have a solution. I would say the distinction is that the purpose of a puzzle is in the act of

I don't think either word, "puzzle" or "problem", requires it to have a solution. I would say the distinction is that the purpose of a puzzle is in the act of solving, while the purpose of a (business) problem is to have the solution.