4 ms·
Depends on the table, the digikey catalog is thousands of small tables, but most are around 20 rows. It's worth noting some header rows are multi line, which is
by tlarkworthy 7y ago
Depends on the table, the digikey catalog is thousands of small tables, but most are around 20 rows. It's worth noting some header rows are multi line, which is part of the difficulty, the MIP encodes where to start in the ASCII representation where the header ends and the data starts.
> these problem instances are not pathological instances
With MIP, the solver churns when you get a lot of information suggesting that one path is likely to be the optimal but actually it's another path but you have been mislead by red herrings. One cause would be a subset of weak classifiers are configured incorrectly so they are actively misleading. Another cause might be that the table structure is very ambiguous and requires a lot of global deductive reasoning to figure it out.
However, given digikey is not maliciously trying to create difficult to read tables, I don't think these cases really come up. Misleading weak classifiers would be a bug, though its sometimes hard to spot if enough of the system still reaches the correct decision. There is probably some math to assign utility to certain classifiers though I never looked at it beyond case by case debugging of decision samples.
Also worth noting this never went into full production due to the surrounding business being broken for completely non-technical reasons. But I do think the MIP + MLE is a useful technique for a few different forms of problems where you want to integrate hard ontological constraints over a fuzzy reasoning system.