5 ms·

>>Wrong. Yes it was a reasonable test, but their results are invalid. I'm confused. In what way are the results invalid? The results were as a result of a bug

by skc 10y ago

>>Wrong. Yes it was a reasonable test, but their results are invalid. I'm confused. In what way are the results invalid? The results were as a result of a bug in Apple's software, no?

iaml 10y ago
I'm not the person that you are asking, but I agree with them. The premise of this test is to measure battery life in a common use case. To achieve this, they use an option that nobody apart from testers would use and this inherently makes a use case not so common. This is a methodology error in my opinion. What they could have done instead was to use incognito mode of safari which they reopen each cycle.
- jdalgetty 10y ago
  I use this feature quite often when testing site development. I'm sure other web developers do the same. I actually run two safari browser windows at once. One with private browsing and one normal. This helps to see how a site functions under different circumstances.
  - iaml 10y ago
    Do you actually refresh the pages as often as they do though?
    - jdalgetty 10y ago
      Nope :)
BugsJustFindMe 10y ago
Let me put it another way with a car analogy. Everyone loves car analogies. Scenario: You want to test how far your car can go at its top speed on a full tank of gas. You're too lazy to actually sit in the car with your foot on the accelerator the entire time so you go and find a brick to lay across the pedal. Unfortunately, when you place the brick across the pedal, you accidentally, unbeknownst to you, deploy the drogue parachute[0]. You walk away, hit the remote start button in your pocket, and the car takes off. RACING RACING RACING, except, you know, parachuted. Actually you don't know. You didn't do it in purpose. You didn't know it deployed. You didn't even see it, because you were walking away. You only found out later when you got back to your car and saw, oh shit, you accidentally deployed the chute. What a boner. Why was the deploy button so close to the accelerator where a carelessly placed brick could bump into it anyway? What a stupid design mistake THAT was. Now. Do you call your test valid? [0] https://en.wikipedia.org/wiki/Drogue_parachute https://en.wikipedia.org/wiki/Drogue_parachute
caconym_ 10y ago
Then the conversation should be about how Safari was defective, not the machine itself. Implying that the test revealed a problem with the machine is not correct, simply because it didn't. Installing a non-Safari browser is trivial.

by skc 10y ago

>>Wrong. Yes it was a reasonable test, but their results are invalid. I'm confused. In what way are the results invalid? The results were as a result of a bug in Apple's software, no?

iaml 10y ago

I'm not the person that you are asking, but I agree with them. The premise of this test is to measure battery life in a common use case. To achieve this, they use an option that nobody apart from testers would use and this inherently makes a use case not so common. This is a methodology error in my opinion. What they could have done instead was to use incognito mode of safari which they reopen each cycle.

jdalgetty 10y ago
I use this feature quite often when testing site development. I'm sure other web developers do the same. I actually run two safari browser windows at once. One with private browsing and one normal. This helps to see how a site functions under different circumstances.
- iaml 10y ago
  Do you actually refresh the pages as often as they do though?
  - jdalgetty 10y ago
    Nope :)

BugsJustFindMe 10y ago

Let me put it another way with a car analogy. Everyone loves car analogies. Scenario: You want to test how far your car can go at its top speed on a full tank of gas. You're too lazy to actually sit in the car with your foot on the accelerator the entire time so you go and find a brick to lay across the pedal. Unfortunately, when you place the brick across the pedal, you accidentally, unbeknownst to you, deploy the drogue parachute[0]. You walk away, hit the remote start button in your pocket, and the car takes off. RACING RACING RACING, except, you know, parachuted. Actually you don't know. You didn't do it in purpose. You didn't know it deployed. You didn't even see it, because you were walking away. You only found out later when you got back to your car and saw, oh shit, you accidentally deployed the chute. What a boner. Why was the deploy button so close to the accelerator where a carelessly placed brick could bump into it anyway? What a stupid design mistake THAT was. Now. Do you call your test valid? [0] https://en.wikipedia.org/wiki/Drogue_parachute https://en.wikipedia.org/wiki/Drogue_parachute

caconym_ 10y ago

Then the conversation should be about how Safari was defective, not the machine itself. Implying that the test revealed a problem with the machine is not correct, simply because it didn't. Installing a non-Safari browser is trivial.