I think that you are mostly correct. In that, you do not want to lead your customers on too much and with simply testing one thing you will not be sure if the

I think that you are mostly correct. In that, you do not want to lead your customers on too much and with simply testing one thing you will not be sure if the idea as a whole is bad. But there is a time and a place to ask a customer to decide between two choices. Usually this is done using discrete choice models and is pretty useful for ranking feature sets and even can help understand pricing. I found a random white paper from a software company that I have never heard of before that actually gives a pretty simple example and explanation. (http://sawtoothsoftware.com/download/techpap/undca15.pdf http://sawtoothsoftware.com/download/techpap/undca15.pdf) In a SaaS application this could be extremely useful in seeing how much perceived utility people get from X GB more space or Y more users... For the OP it might be cool to extend the idea to having multiple binary choices and performing the necessary math to understand the utility for features (multi-linear regression).