4 ms·
I defined [x _] to denote the size of the hole _ in the context x. By "size" I mean some measure of the width of the distribution of things that can sensibly f
by tmoertel 14y ago
I defined [x _] to denote the size of the hole _ in the context x. By "size" I mean some measure of the width of the distribution of things that can sensibly fill the hole. One reasonable measure would be entropy. So, for example, we could say that [_] means the entropy of the distribution of things that could sensibly fill a hole in the empty context, which is to say start a new phrase. Similarly, [great _] denotes the entropy of the phrases that could sensibly follow "great". Does the notation make sense now?
Update: The * and - symbols are just the usual arithmetic operators applied to the sizes.