Isn't the fundamental problem in software patents that patent holders have the option of NOT licensing their patents to infringing parties? Outright ban based o

Isn't the fundamental problem in software patents that patent holders have the option of NOT licensing their patents to infringing parties? Outright ban based on patent infringement is criminal in my view. Collecting rent based on infringement is completely fair, on the other hand.