4 ms·
the mistaken belief that you can deduce intent via inferred behaviors Maybe this is just a phrasing error, however the idea of inferred behavior doesn't make s
by AndrewKemendo 9y ago
the mistaken belief that you can deduce intent via inferred behaviors
Maybe this is just a phrasing error, however the idea of inferred behavior doesn't make sense. If you view an action that is measurable (buy x, go to y) then it is an explicit behavior.
Further, the concept you seem to be arguing against is the economic concept of revealed preferences. If I understand your argument, it is that it is impossible to derive a users preference from observing the users behavior. This is contrary to decades of empirical research in economics and cognitive science proving that you can rank preferences based on such behavioral profiling.
Your example builds a strawman by introducing a value judgement into the example (evil vs good) that is unmeasurable. It conflates some kind of moral state with a series of actions without any way to empirically value them.
The reality is that most people cannot accurately state what their true preferences actually are, and thus your actions reveal more about your future behavior than your "intentions" do. This is a classic debate in philosophy of the mind.
- fallous 9y agoYeah, it's a phrasing error... although there are species of inferred behaviors (he went into a room for an hour and then came out and walked to a store. I don't know what he did in that room but I can infer that he breathed while in it, although as with all inferences that may be untrue.) I'm not arguing against revealed preferences as useful aggregate information regarding the probabilities of someone choosing X, I'm saying that you both can't know their intentions regarding those choices and more specifically those preferences are untrustworthy in predicting any single opportunity to choose X. The idiocy of many current products, be they physical or informational, is replacing the user's ability to make a choice with what the product designers believe... especially without explicit agreement. In most cases the user didn't opt-in to outsourcing or subordinating their decision-making to product X and every time their intent conflicts with the product's decision-making the user will become more discontented with the product.
- fallous 9y agoAnd no it's not a strawman to introduce my intentions into the example... it's the entire point. Measure everything you like with the exception of my brain and you cannot know my intentions which means that you lack the necessary information to substitute your own judgement or decision-making for mine.
- AndrewKemendo 9y agoThe problem is, you seem to be making a blanket statement about the theoretical possibility of prediction and suggestion rather than arguing against the limitations of current predictive systems. It's simply that current recommendation/prediction systems have incomplete information. In this case an explicit goal or preference is not stated by the users. In the absence of explicit preference statements, a recommendation system can only act based on the behaviors it measures. The purpose of my life's work is to align revealed preferences with stated preferences, to determine optimal action. The majority of systems are confounded because 1. They don't ask for preferences and 2. People state preferences (signaling) that are not aligned with their true beliefs.
- fallous 9y agoI am indeed making a blanket statement about the theoretical possibilities of prediction and suggestion as a preferred or comparable replacement for allowing the user to choose for themselves, and that statement is that it's neither comparable nor preferred. Your work, at least as you present it, does not seem to collide with that statement because it asks the user for intent and then examines behaviors to see how they align with that intent... there is no inferring trap. Determining optimal action, while its own complex kettle of fish, is only a concern if it over-rules the user's decision-making WITHOUT the user opting in to such an arrangement.