4 ms·

> I also truncated page content to 250KB before passing it to the parser. WTF did I just read?

• tengada1 8mo ago
  It's just HTML, presumably not requesting JS libraries. So 250K is a large amount.
  • gethly 8mo ago
    Exactly - how can a html page need to be trimmed to 250 KB??? That is insane. Something is not right with this article.
    • iggldiggl 8mo ago
      A transcript for a half-hour radio comedy show with some formatting takes up about 60 kB. The English Wikipedia page for Monty Python is about 130 kB in pure UTF-8 text and the actual HTML page takes up around around 660 kB (plus/minus, depending on which Wikipedia theme exactly you use). So large, text-heavy pages don't seem too unlikely to exceed 250 kB, especially if they also include some amount of formatting that's more substantial than just a minimal bunch of <p> tags.