I think user-in-the-loop use cases are not uncommon for semi-supervised learning broadly speaking. In your case I'm not sure you need to conceive anything as 3-

I think user-in-the-loop use cases are not uncommon for semi-supervised learning broadly speaking. In your case I'm not sure you need to conceive anything as 3-valued logic. For example: 1. There is either a tag or there is not. 2. If there is a tag, it is either a is_x tag or a is_not_x tag. 3. If there is a tag, it is either validated or it isn't. Three valued logic has different semantics.