that's one of the problems that i considered since html is not that descriptive. i could also see sites purposely changing format just to cause incompatibility

that's one of the problems that i considered since html is not that descriptive. i could also see sites purposely changing format just to cause incompatibility if they're not excited about you ripping data from them. i feel that html should be slightly overhauled to add context to all data, so instead of a <td>, it's stock 52 week high or something along those lines. i just had a thought, perhaps rss is the answer! do sites still use that? i kind of feel rss is a dead technology.