3 ms·
Wouldn't this need to be listed on the disallow on the robots.txt if they didnt want them to index the page?
by sithlord 7y ago
Wouldn't this need to be listed on the disallow on the robots.txt if they didnt want them to index the page?
- deleted 7y ago[deleted]
- zamadatix 7y agoThe article has sections detailing how blocking works and literally provides pictures of highlighted sections of the websites source code covering this question.
- ceejayoz 7y agoNo. That's one approach, but the page has a meta tag that has the same effect: <meta name="robots" content="noindex,nofollow,noodp" />
- Zenst 7y agoSaw that on every page they have, not scrutinised the sanity of their code, but looks like it is part of their site template. Also the site code - egads, 200+_ blank lines as a header, then clearly some extra padding blank lines here and there.
- ceejayoz 7y agoIt is not part of their site template. The Turbotax home page has "yes, do index" meta tags. So does their deceptive "free edition" page at https://turbotax.intuit.com/personal-taxes/online/free-edition.jsp https://turbotax.intuit.com/personal-taxes/online/free-editi...: <meta name="robots" content="index,follow,noodp" /> You've been tricked. Imagine how easily people who can't read source code get sucked into the wrong version.
- Zenst 7y agoYes, I see the issue more clearly now. So many aspects about American TAX I never understood, the one were citizens who are living in another country and paying tax there also have to pay American income TAX always seemed brutal. Most people in the UK are PAYE and the employer does tax fillings and as such the need for a individual to file any form of tax return is lower than the American system that from my understanding - mandates it and the onus for any tax information is placed solely upon the individual. Which I would of thought opens up a larger can of worms for fraud potential from the payer and payee as well as opening up less skilled people into realms they will make mistakes to their own detrement. Yet if you're a corporation - tax seems to offer more freedom in expression compared to individuals. Which is the norm in many a country.