My litmus test question for LLMs is about negative mutual information. Its a weird quirk of probability theory where pairwise variables always have non-negative

My litmus test question for LLMs is about negative mutual information. Its a weird quirk of probability theory where pairwise variables always have non-negative MI, but a set of three variables can have negative MI. Its both a non-intuitive result and one where there is a tooon of text about pairwise MI and little about negative MI. So far, nothing has passed the test.