I'm not OP, but I've used similar styles of pub/coffee shop testing. When I do it, I don't give scenarios or bother measuring things like success rate. It's ver

I'm not OP, but I've used similar styles of pub/coffee shop testing. When I do it, I don't give scenarios or bother measuring things like success rate. It's very freeform, unscripted and raw. It's kind of like hallway testing for people who work alone. And, instead of coworkers, you're working with complete strangers who might not have any idea what's happening. If I had to pick one thing to measure, I'd be more inclined to measure positive versus negative fucks (I'm not joking), but honestly, it's more about the experience and the totally raw, sometimes terrifyingly honest feedback I hear. Numbers aren't useful because the most useful sessions go way off the rails.