4 ms·

Actually, I'd argue that Microsoft's assessment of Acid3 is reasonably fair. Acid 3 isn't like Acid 1 (sane CSS box model) or Acid 2 (good resiliant consistent

by halo 17y ago

Actually, I'd argue that Microsoft's assessment of Acid3 is reasonably fair. Acid 3 isn't like Acid 1 (sane CSS box model) or Acid 2 (good resiliant consistent CSS2 support) - rather, it tests a whole bunch of random features and JavaScript edge cases. I can perfectly understand why Microsoft would prioritise implementing certain up-and-coming features or improving their rendering speed and stability over implementing parts of Acid3.

wgj 17y ago
> it tests a whole bunch of random features It clearly can't be random if four other major browser vendors independently score over 90%, and if: Firefox 2, a browser released in 2006 and predates Acid 3, scores a 52/100 versus the current IE9 score of 32/100. The only possible explanations are either a) it's an insidious and well organized campaign to unfairly discredit IE, or b) IE, even unreleased IE9, is way behind everybody. No matter which you believe, random is not an option.
- halo 17y ago
  Sorry, but I don't understand the point you are trying to make here. By "random features" I mean that the features chosen are fairly arbitrary in nature, taken from arbitrary sections of a fairly arbitrary selection of standards. That's what makes the Acid3 test different from the Acid1 and Acid2 tests which were rather more specific in what they tested (i.e. CSS), something which is much more fundamental to the web than anything Acid3 tests. Also, the Acid tests are deliberately constructed with browser bugs in mind. That's why IE fails it incredibly badly since it's been designed to make IE fail incredibly badly. There's no conspiracy when the entire point of the test is that it reveals browser bugs. That said, Microsoft are behind everybody else, and no-one has said otherwise. However, given inherent limited resources, I'm not sure if I'd rather Microsoft focus on passing Acid3 than improving other aspects of their browser. Given the choice between good CSS3 support and Canvas or SVG Fonts and SMIL I'd prefer the prior pair, and I'm sure many of their users would gladly choose improved performance and stability over web standards.
  - wgj 17y ago
    My point was simply that describing the tests as random or arbitrary diminishes the value of the results without requiring an alternate viewpoint. That would be fair if it were truly random, but I don't think it is. Edit: Your last edit provides the alternate viewpoint. Your position seems to be more that the attention is misguided, not random.
- RyanMcGreal 17y ago
  > It clearly can't be random if four other major browser vendors independently score over 90% ?? The other browser makers score well on ACID3 because they've been developing and bugfixing to ACID3 as a benchmark. It's not random, it's a tautology.
  - InclinedPlane 17y ago
    Pay attention, FF 2 predates acid 3, yet it scores much higher on acid 3 than even IE 9.
    - zaatar 17y ago
      IE9 hasn't been released yet; or did you mean, a super early preliminary build in the early stages of IE9 development which probably has little to do with how the final product will look like? We haven't even shipped a developer preview release yet ... (disclosure: I work on the IE team)
      - tl 17y ago
        "IE8 scores 20/100, which is still much worse than all relevant competitors in their versions from the test's release, and has some problems with rendering the Acid3 test page." Source: http://en.wikipedia.org/wiki/Acid3 http://en.wikipedia.org/wiki/Acid3 So you're "IE9 is beta" argument doesn't hold, IE8 doesn't beat a browser that predates Acid3, either.
rimantas 17y ago
Somehow it did not help IE with neither rendering capabilities nor speed. And no, Acid3 does not test for "random features"—it test for stuff that is essential in web apps, mainly DOM manipulation.
spamizbad 17y ago
I wish I was as optimistic as you. Right now I'm fighting with all sorts of buggy edge cases in IE8's allegedly complete CSS 2.1 implementation. At the end of the day I'll put more faith in a hokey Internet benchmark than I would any organization's technical marketing efforts.
kenver 17y ago
If everyone else is at a point where they can do both reasonably well now, then I think it reflects pretty badly on Microsoft that they cant even do it with their next generation browser.
pohl 17y ago
I've heard people say this about Acid 3 before, but without justification. To me, it appears that the tests for Acid 3 were neither chosen at random, nor arbitrarily. They were specifically selected so that every major browser failed at the time of its release. Moreover, tests were specifically selected to emphasize modern, DHTML (a.k.a "web 2.0") apps: with the bulk of the tests being in DOM, DOM2, and EcmaScript. Only one out of the 6 "buckets" do not - and those were chosen from a competition designed to include things the web community wanted. It's not like hixie threw darts at a board to get the tests. http://en.wikipedia.org/wiki/Acid_3#Standards_tested http://en.wikipedia.org/wiki/Acid_3#Standards_tested
- Periodic 17y ago
  A huge part of making the web easy to develop for is having things fail in predictable ways. There is very little that is more frustrating than making a few changes to your website and having it suddenly break in one of the major browsers and spending a day figuring out that it's because of a small edge case that doesn't follow the standard model.
- boucher 17y ago
  I think that almost by definition tests which fail in every major browser shouldn't be considered a high priority. It's nice that they have been fixed in some browsers, but I can't fault IE for prioritizing other things more.
  - steveklabnik 17y ago
    But they now _don't_ fail in every browser, because everyone else didn't slack off and actually implemented them. I tested this earlier today, and Chromium get 100/100, FX3.5 on Linux got 97/100, and FX Windows 3.5.5 here gets 93/100. IE8 gets 12.
    - boucher 17y ago
      In my mind, this still isn't a particularly good reason to do it. Let's say the last 9-12 months is when ACID3 became compliant in most browsers (I think it's actually less). That means, by definition, only apps written in that timeframe even had an opportunity to use whatever features were previously broken. This is a tiny percentage of code on the web. Now, it could be that ACID3 is testing the 100 most useful things that previously did not work. Somehow, though, I doubt that's really the case. And even if it was, there are without a doubt 100 more important bugs in IE to fix. So, yes, ACID3 compliance is pretty low on my wishlist for IE bugs to fix. If they were fixing ACID3 bugs and letting more important things fall through the crack, I would be even more displeased with IE.

by halo 17y ago

wgj 17y ago

> it tests a whole bunch of random features It clearly can't be random if four other major browser vendors independently score over 90%, and if: Firefox 2, a browser released in 2006 and predates Acid 3, scores a 52/100 versus the current IE9 score of 32/100. The only possible explanations are either a) it's an insidious and well organized campaign to unfairly discredit IE, or b) IE, even unreleased IE9, is way behind everybody. No matter which you believe, random is not an option.

halo 17y ago
Sorry, but I don't understand the point you are trying to make here. By "random features" I mean that the features chosen are fairly arbitrary in nature, taken from arbitrary sections of a fairly arbitrary selection of standards. That's what makes the Acid3 test different from the Acid1 and Acid2 tests which were rather more specific in what they tested (i.e. CSS), something which is much more fundamental to the web than anything Acid3 tests. Also, the Acid tests are deliberately constructed with browser bugs in mind. That's why IE fails it incredibly badly since it's been designed to make IE fail incredibly badly. There's no conspiracy when the entire point of the test is that it reveals browser bugs. That said, Microsoft are behind everybody else, and no-one has said otherwise. However, given inherent limited resources, I'm not sure if I'd rather Microsoft focus on passing Acid3 than improving other aspects of their browser. Given the choice between good CSS3 support and Canvas or SVG Fonts and SMIL I'd prefer the prior pair, and I'm sure many of their users would gladly choose improved performance and stability over web standards.
- wgj 17y ago
  My point was simply that describing the tests as random or arbitrary diminishes the value of the results without requiring an alternate viewpoint. That would be fair if it were truly random, but I don't think it is. Edit: Your last edit provides the alternate viewpoint. Your position seems to be more that the attention is misguided, not random.
RyanMcGreal 17y ago
> It clearly can't be random if four other major browser vendors independently score over 90% ?? The other browser makers score well on ACID3 because they've been developing and bugfixing to ACID3 as a benchmark. It's not random, it's a tautology.
- InclinedPlane 17y ago
  Pay attention, FF 2 predates acid 3, yet it scores much higher on acid 3 than even IE 9.
  - zaatar 17y ago
    IE9 hasn't been released yet; or did you mean, a super early preliminary build in the early stages of IE9 development which probably has little to do with how the final product will look like? We haven't even shipped a developer preview release yet ... (disclosure: I work on the IE team)
    - tl 17y ago
      "IE8 scores 20/100, which is still much worse than all relevant competitors in their versions from the test's release, and has some problems with rendering the Acid3 test page." Source: http://en.wikipedia.org/wiki/Acid3 http://en.wikipedia.org/wiki/Acid3 So you're "IE9 is beta" argument doesn't hold, IE8 doesn't beat a browser that predates Acid3, either.

rimantas 17y ago

Somehow it did not help IE with neither rendering capabilities nor speed. And no, Acid3 does not test for "random features"—it test for stuff that is essential in web apps, mainly DOM manipulation.

spamizbad 17y ago

I wish I was as optimistic as you. Right now I'm fighting with all sorts of buggy edge cases in IE8's allegedly complete CSS 2.1 implementation. At the end of the day I'll put more faith in a hokey Internet benchmark than I would any organization's technical marketing efforts.

kenver 17y ago

If everyone else is at a point where they can do both reasonably well now, then I think it reflects pretty badly on Microsoft that they cant even do it with their next generation browser.

pohl 17y ago

I've heard people say this about Acid 3 before, but without justification. To me, it appears that the tests for Acid 3 were neither chosen at random, nor arbitrarily. They were specifically selected so that every major browser failed at the time of its release. Moreover, tests were specifically selected to emphasize modern, DHTML (a.k.a "web 2.0") apps: with the bulk of the tests being in DOM, DOM2, and EcmaScript. Only one out of the 6 "buckets" do not - and those were chosen from a competition designed to include things the web community wanted. It's not like hixie threw darts at a board to get the tests. http://en.wikipedia.org/wiki/Acid_3#Standards_tested http://en.wikipedia.org/wiki/Acid_3#Standards_tested

Periodic 17y ago
A huge part of making the web easy to develop for is having things fail in predictable ways. There is very little that is more frustrating than making a few changes to your website and having it suddenly break in one of the major browsers and spending a day figuring out that it's because of a small edge case that doesn't follow the standard model.
boucher 17y ago
I think that almost by definition tests which fail in every major browser shouldn't be considered a high priority. It's nice that they have been fixed in some browsers, but I can't fault IE for prioritizing other things more.
- steveklabnik 17y ago
  But they now _don't_ fail in every browser, because everyone else didn't slack off and actually implemented them. I tested this earlier today, and Chromium get 100/100, FX3.5 on Linux got 97/100, and FX Windows 3.5.5 here gets 93/100. IE8 gets 12.
  - boucher 17y ago
    In my mind, this still isn't a particularly good reason to do it. Let's say the last 9-12 months is when ACID3 became compliant in most browsers (I think it's actually less). That means, by definition, only apps written in that timeframe even had an opportunity to use whatever features were previously broken. This is a tiny percentage of code on the web. Now, it could be that ACID3 is testing the 100 most useful things that previously did not work. Somehow, though, I doubt that's really the case. And even if it was, there are without a doubt 100 more important bugs in IE to fix. So, yes, ACID3 compliance is pretty low on my wishlist for IE bugs to fix. If they were fixing ACID3 bugs and letting more important things fall through the crack, I would be even more displeased with IE.