Here is what they say they did: >"A Bayesian analysis was performed to test the relative likelihood of observing our results given the null hypothesis (i.e., t

Here is what they say they did: >"A Bayesian analysis was performed to test the relative likelihood of observing our results given the null hypothesis (i.e., the absence of any depletion effect) versus the likelihood of observing our results given the alternative hypothesis (the presence of a nonzero effect)." I mean that I have no interest in the result of this "test" at all. First of all, they are not directly testing for the existence of a "depletion effect". From the paper: >"Participants in both conditions were provided with a lengthy passage of text. Those in the Control condition simply crossed out with a pencil all occurrences of the letter ‘e’ in a passage of text, whereas those in the Depletion condition were given the following instructions: ‘cross off the letter “e” every time it appears with the following exceptions: 1. Do not cross out the “e” if it is adjacent to another vowel (e.g., friend); 2. Do not cross out the “e” if it is one letter away from another vowel (e.g., vowel); 3. Do not cross out the “e” if the word has 6 letters (e.g., “there”); 4.Do not cross out the “e” if it is the third to last letter (e.g., customers); 5.Do not cross out the “e” if there are double letters in the word (e.g., “hello”)’. Participants were asked to continue the writing task for six minutes, after which the experimenter instructed participants to discontinue. [...] Participants were given a sheet on which 30 anagrams were listed. Participants were asked to complete as many anagrams as they could within five minutes. After the anagram task, participants were asked to refer to a Likert scale to rate the difficulty of the initial crossing-out letters task (1 = not at all difficult; 7 = very difficult). The number of correctly completed anagrams was recorded for each participant." So "depletion effect" means "got fewer anagrams correct after inspecting text closely for 6 minutes". How about their eyes just got tired from squinting closer at the page? Or they were primed to think/write slower since they had to cross out fewer e's? I'm sure you can come up with more alternatives. Second of all, who is actually predicting exactly zero effect of crossing out the letter e more or less often on filling out anagrams? It seems totally implausible to me there is no effect, especially if you go for longer than 6 minutes. Because that is what they are comparing: exactly zero effect vs any other size effect. This is not "small effect" vs "large effect". Literally any way they can mess up the experiments will tend toward non-zero effect. It is only a matter of sample size. Bayes factors vs p-values is irrelevant to the actual problems with these studies.