I think the page you link to explains ti very well: its a combination of the existence of Gothic ruins, a negative view of the Middle Ages, and the association

I think the page you link to explains ti very well: its a combination of the existence of Gothic ruins, a negative view of the Middle Ages, and the association with the Catholic church in the context of anti-Catholic prejudice in Britain (and other Anglophone countries).