I guess you could have a system where you were required to pay the patent holder if you made money off of their patent, but the patent holder couldn't outright

I guess you could have a system where you were required to pay the patent holder if you made money off of their patent, but the patent holder couldn't outright prevent you from using it. You could also set some upper limit as to what they could charge, so that the patent holder couldn't set the fee to some prohibitively high level. Maybe some ratio relative to the cost of production and documented cost of development? It would bureaucratic and annoying for patent holders, no doubt, but at least this way the people who develop technology could be rewarded for it while not squelching other innovation.