I see. First let me explain what I mean by implicit incentive with our biology example. You have the protein sequence, G46AKT5778FAG4 The predictor is given

I see. First let me explain what I mean by implicit incentive with our biology example. You have the protein sequence, G46AKT5778FAG4 The predictor is given "G46A____" The only way to predict this correctly consistently across multiple proteins is learn the underlying biological structure. Now, I pulled this snippet of a recipe randomly from the web. "Add the tomato purée and turn up the heat slightly, cooking until it has darkened, about 2-3 mins." Block out some information. "Add the tomato purée and turn up the heat slightly, cooking until it has ____" The only way a predictor is getting what kind of completion to make consistently correct across multiple unseen recipes and food items is if it has some model of the visible effects of heat on food in general. The predictor will be forced learn what kind of foods darken in heated water and group them together internally so it doesn't have to memorize every single instance (more effort than simply learning it) Now let's put back darkened and block out the time. "Add the tomato purée and turn up the heat slightly, cooking until it has darkened, about____." The only way a predictor is consistently correct on what time interval this should be across multiple recipes is if it has some model of the effects of heat and time on whatever it is you're cooking. Implicit incentives are everywhere.