It can be even more awkward... at that kind of establishment often they'll either cater to Japanese people only, or tourists only (you do get some mixed places)

It can be even more awkward... at that kind of establishment often they'll either cater to Japanese people only, or tourists only (you do get some mixed places). The thing is, they're so polite that it can take a long time to realize that you're just in the wrong place. Note: this goes for almost everything, from baths to ramen shops.