15 ms·
Why we challenge Microsoft’s battery test
- stephenr 10y agoSo do the WebKit/safari teams' respective efforts to reduce power consumption not count? It seems odd that they didn't compare against safari given Apple makes a dedicated effort to reduce power consumption. That it's a "mode" which defaults to off says a lot - the things it does aren't acceptable all of the time apparently, so you choose between features/performance, and battery life.
- vilmosi 10y agoWell you can't really compare Safari with Edge as they are are exclusive to different platforms.
- blacksmith_tb 10y agoIt wouldn't be too hard to dual-boot Win10 on Apple hardware and compare them, but it might be a little awkward for Microsoft to do so officially.
- adrianN 10y agoThe OS is a pretty obvious confounding factor, don't you think?
- JulienSchmidt 10y agoI think it would still be interesting. Win10 + Edge vs macOS + Safari. In the end the user does not care which OS runs in the background, just which platform offers the best experience - in this case the longest battery time.
- kraftman 10y agoDepends really. I prefer using ubuntu but win 10 + edge gives nearly double the battery life, so when I'm out and about I have to use win 10.
- Tloewald 10y agoThere are plenty of suitable comparisons from which one can make an educated guess. In general, Macs do better than comparable Windows machines in browsing endurance tests, and Safari clobbers every other browser it has been tested in for battery life (I have _not_ seen a comparison of Safari to this new version of Opera, but judging by its performance relative to Chrome it could be competitive with Safari). Safari, of course, has lots of support for ad blocking short of Apple actually doing the ad blocking itself. I suspect Safari + ad blockers would be the best option across the board (it absolutely rocks on iOS devices).
- blacksmith_tb 10y agoIt is, but with the Boot Camp drivers, it seems like a fair fight. Obviously both OSes do some things behind the scenes that impact battery life, but we hope both are tuned to conserve battery when not charging. Though to turn the argument around, given that ChromeOS isn't known for wasting a lot of battery while browsing with Chrome, having less OS is probably a boon.
- guroot 10y agoThat wouldn't work. You don't get the same battery life out of a mac on windows as you do on macOS just sitting idle. I don't know how you would control for that.
- mackey 10y agoBut they could do a separate test of Opera, Safari, and Chrome on the Mac.
- sliverstorm 10y agoOpera was specifically aiming at Edge in this, it seems.
- JaRail 10y agoOpera was responding to something published a few days ago by Microsoft's marketing/Edge team. That's why it's directed at Edge.
- stephenr 10y agoOk so for those who didn't quite get it - my point was that Opera are claiming to be the first 'battery saving' browser, and then completely ignore Safari in their tests.
- amq 10y agoOpera with an ad blocker vs Edge without it doesn't seem like an ubiased test.
- rubber_duck 10y agoAnd they say "Opera Developer (39.0.2248.0)" - which is presumably a dev build of the browser. Like it would be fine if they say "in next version we will retake the top" or whatever but don't try to dispute their results by providing something they had no way of measuring.
- Quai 10y agoThe developer stream is public, and so is the exact build they used[1]. [1] http://get.opera.com/pub/opera-developer/39.0.2248.0/ http://get.opera.com/pub/opera-developer/39.0.2248.0/
- xiphias 10y agoI wouldn't switch to an unstable browser just to improve battery life. It just shows that they're not really trying to get a fair test. I'm running ad blocker in Chrome and it works perfectly. I'd be interested if they could improve on that significantly, but I trust Google more in creating a stable software.
- takeda 10y agoI think you are unaware how marketing works (the whole power saving competition from both Microsoft and Opera is just marketing). Essentially they did some power saving improvements and want to create a bit of noise about it to increase their popularity. It's kind of same as how Apple, Google etc announce new features/products before you even can use them.
- bitmapbrother 10y agoAt least Opera was transparent about the details of their test. Was Microsoft?
- lavalampkid 10y agoDefinitely not a fair test... Edge was rendering a lot more without an ad-blocker.
- someear 10y agoespecially if there were animations going on in those ads. Most battery savings come during (even super short) periods of idle time, when various hardware components can enter lower power states
- Quai 10y agoYou might argue that not rendering ads is a valid method to save battery.
- bialpio 10y agoCorrect, it is a valid method to save a battery. It makes the comparisons invalid though, since you are not testing with the same input.
- Retric 10y agoYou are testing more or less the same input just producing different output. This was a common strategy where graphics cards for example would degrade image quality for speed when a driver noticed you where running a benchmark. Which is one of the reasons benchmarks are so difficult. PS: A more insidious problem is when you specifically optimize for something because it's a benchmark.
- bialpio 10y agoNot neccessarily same input - all depends how adblock works. I assumed that with adblock, my browser will not even send a request to fetch the ads, so I save on network traffic, and the browser will not have to render whatever would have been fetched - this to me is a different input (to the browser's rendering engine) than you would have without adblock. With all this said, "proper-er" benchmark would be to show each of the browser's power consumption with or without adblock, with or without battery saver in Opera's case, all this done on a set of websites which are ad-heavy and ad-light. :)
- Theodores 10y agoOpera need to market themselves as the browser that extends your battery life so you can surf without the range anxiety. Testimonials are better than tests plus word of mouth.
- outworlder 10y agoThis is the first time I've heard the term "range anxiety" applied to laptops, as opposed to electric vehicles.
- kraftman 10y agoObviously this is anecdotal but I've been messing around with my laptop a lot recently trying to get to a full day of work on battery, and the best setup I've found is windows 10 Insider with Edge + adblock. Opera battery saver is great but they should enable it automatically whenever you're on battery, as it has no performance impact that I've noticed.
- JTon 10y agoEdge allows extensions now or are you using an OS-level adblock?
- dangrossman 10y agoEdge allows extensions now. https://developer.microsoft.com/en-us/microsoft-edge/extensions/ https://developer.microsoft.com/en-us/microsoft-edge/extensi...
- vxNsr 10y agoI like how RES is one of the first options. I remember when the Windows 10 team did an AMA and a lot of the redditors said they'd try edge as soon as RES was available. Apparently that's now.
- nachtigall 10y agoWhere's firefox in the perf?
- Sylos 10y agoIn the battery-benchmarks that I've seen so far, Firefox was always the leading browser, so granted those benchmarks did not test Opera's battery saving mode, Firefox should still be at least in second place. And Firefox does also have a native ad-blocker, so if you enable that, too, I could imagine that it maybe even still outperforms Opera's battery saving mode, but yeah, a proper benchmark would be good...
- nachtigall 10y ago> Firefox does also have a native ad-blocker I don't think it has one natively. Which one do you mean? Or are you referring to tracking protection (private mode only, but available in Fx 49 also in "normal" mode iirc)
- Sylos 10y agoYeah, I'm referring to Tracking Protection. It's not supposed to be an ad-blocker, but with almost all ads using tracking code, you rarely encounter ads when it's enabled. It's probably even better for battery life than just an ad-blocker, as a lot of webpages also execute tracking code which isn't bound to ads. And you could always enable it in normal browsing by setting "privacy.trackingprotection.enabled" in about:config to true...
- darkmuck 10y agoNow that Opera Software is owned by a Chinese company I've avoided their browser anyways, regardless of potential battery/performance benefits.
- mwcampbell 10y agoIsn't that just xenophobia?
- darkmuck 10y agoNo, I don't think so. Maybe I'm a bit paranoid but I tend to avoid software from Chinese companies because of all recent stories of a apps stealing/sending data that they don't necessarily need to function. But I suppose software from any country could do the same thing though...
- grouchoboy 10y agoAnd what is your position about hardware?
- curiousDog 10y agoMost hardware we use here, though manufactured in China, is still wholly owned by American companies though.
- CaptSpify 10y agoI'm personally just as wary of Edge...
- pfortuny 10y agoNope: it is Statephobia and States have no right to honor, just people eith individual bodies.
- mwcampbell 10y agoThat seems like splitting hairs to me. Would you want people to reject your software just because of your nationality or that of your company? Probably not. So it seems to me that an implication of the golden rule is that we shouldn't do that.
- overgryphon 10y agoMicrosoft didn't just do a battery test, they also release statistics based on Windows 10 telemetry showing that Edge has better battery life than Chrome, Firefox: "In addition to testing battery life internally, Microsoft also looks at tens of millions of PCs that send telemetry data to the firm, Weber said. And what it sees there is simple: A small advantage over Firefox, but massive gains of about 50 percent additional battery life when compared to Chrome." https://www.thurrott.com/windows/windows-10/68176/microsoft-touts-battery-life-advantages-edge-browser https://www.thurrott.com/windows/windows-10/68176/microsoft-...
- Splines 10y agoNot to discredit their results, but what it shows is that users who used Edge consumed less power than Chrome or Firefox. Whether that means Edge is more power efficient, or devices where Edge is used more often are more power efficient, or users who select for Edge tend to visit sites that allow Edge to be more power efficient isn't clear. To be fair to both sides, this is a really hard thing to measure.
- AnthonyMouse 10y ago> To be fair to both sides, this is a really hard thing to measure. Is it though? It's more the fact that Big Data is totally useless because it contains thousands of uncontrolled variables that confound the results. If you really want to know which browser is more power efficient, get a sample of the commonly visited sites and then visit the same sites on the same common devices in different browsers and see which one uses less power. You can still get the wrong outcome by using a biased sample on purpose, but then the outcome is wrong because you fudged it, not because it's hard to get the real answer.
- luckystarr 10y agoThey should also release control videos which show both machines with battery saver on or both off.
- dep_b 10y agoOpera being better than Edge is a claim I might believe but I don't think Edge is almost as bad as Chrome. I stopped using Chrome when I discovered it took hours off my battery life on a MacBook. Edge can't be almost as bad. Intuitively I would believe the ranking in terms of battery life would be Safari > Edge or Opera > Firefox > Chrome.
- LoSboccacc 10y agoopera likes to boldly claim it was the first browser to do power management on pages but truth is Microsoft has done this for many years prior and has the operating system integration as an advantage. http://www.sevenforums.com/tutorials/159269-internet-explorer-javascript-timer-frequency-power-plan-settings.html http://www.sevenforums.com/tutorials/159269-internet-explore...
- post_break 10y agoWhat really surprised me were the run times of that laptop. Man that is crappy battery life for both instances. My thinkpad T220 with extended battery and 13" Macbook pro both decimate that battery life.
- callesgg 10y agoI have found that safari gives best battery time on OSX (like 9 hours of use vs 6-7 when on firefox). But i generally dont use safari as battery time is not the most important factor in my common use cases.
- Jerry2 10y ago>But i generally dont use safari as battery time is not the most important factor in my common use cases. I use Safari for almost everything. It's by far the best browser for browsing and just reading & enjoying the web. Reader interface and the speed of it is still unbeatable. I use Chrome for web development, however.
- eddieh 10y agoI agree Safari is the best. Every other browser is a clunker IMO. The Safari web inspector keeps getting better. You might want to take another look at it.
- xufi 10y agoI agree here, its excellent for when I'm low on battery or just don't want to use the charger. It manages my tabs well, I was even watching a 5 hour movie on Youtube once and my battery was at 80 percent after I was done
- JoBrad 10y agoSafari has the same problem that Edge/IE has - it's only on one OS.
- stephenr 10y agoIf it's on the OS that you use, that's hardly a problem.
- z3t4 10y agoI wonder how much battery would be saved if not every site you visited was reported to bing api or opera sitecheck. <g> But most power is is probably used to light the screen, so an extension to make every page use a black theme would probably beat most optimizations.
- andromeduck 10y agoI don't think it would take much of a difference on an LCD display because your backlight is going to be on regardless.
- Raphael 10y ago> Reducing frame rate to 30 frames per second Many users may not like this.
- randyrand 10y agoOnly enabled in power saver mode
- barsonme 10y agoprobably depends what you're doing, right? e.g., if i'm just sitting here reading hacker news i can't tell the difference between 60 fps or 30 fps repainting, right?
- deleted 10y ago[deleted]
- XCSme 10y agoSame, I stopped reading after that. I got it, they got more battery life by reducing performance, not something I'm interested in.
- kylealden 10y agoEdge platform team employee here. A couple thoughts on methodology, focusing on our scripted test (under "stay productive longer" at https://blogs.windows.com/windowsexperience/2016/06/20/more-battery-with-edge/ https://blogs.windows.com/windowsexperience/2016/06/20/more-...), which is most comparable to Opera's test; nobody seems to challenge our Netflix results: * We did not enable ad blockers, because we were testing the efficiency of the network stack, browser rendering pipeline, etc.; if you cut off ads, you're effectively skipping half the assignment. This is a valid way to improve the user experience, but not a valid way to measure browser efficiency, especially because it will disproportionately impact some sites (like the news sites that Opera's test focused on) and have no impact on other sites (like Netflix, where Edge demolishes the other browsers). It's basically skipping a lap of the race and then bragging that you finished faster. * It's also worth noting that the ad blockers are often detected by many news sites and will actually prevent the main page content from loading at all. Not sure if Opera's test accounted for this. * Our test was designed to mimic real-world behavior: Watching YouTube (foreground and background), shopping on Amazon, browsing the Facebook news feed, searching on Google, opening email in Gmail, and reading Wikipedia. To reduce variability, we used WebDriver to instrument the tests (supported by all four browsers tested) and made sure each task was timed rather than just a loop of consecutive tasks (which could disadvantage or advantage browsers depending on other factors like pageload performance or network conditions, in a way that doesn't reflect user experience, which is likely to linger on a page once it's loaded). We then used the Maxim 34407 power instrumentation built into the Surface Book (which is why we chose the Surface Book for this test) to measure actual instantaneous power consumption at the hardware, sampled once per second and then averaged across the duration of the test. We feel strongly that this is a highly scientific and defensible test setup which mimics typical user behavior and, significantly, measures the same markup and the same duration, on the same hardware, in every browser.
- wernerb 10y agoThe way I read the blog is that the adblocking is enabled to show that even _with_ an expensive extension enabled it still beats Edge, but that was in my opinion not the gist of the post. The post was about that microsoft is not transparent about the methodology/setup/scripts/target websites used. A third party should be able to support Microsoft's claims. Is it possible for the setup to be published to your github.com/microsoft so that it may be executed automatically? Heck, go the extra mile put it in a CI and publish the data on regular basis :)
- l34ch 10y agoWait, Opera is still a thing?
- n-gauge 10y agoOn a side note: I've been testing edge on a Dell 1012 netbook (atom, 2gb) and it beats Chrome for rendering YouTube videos (480p max!) which I found surprising (video stutters on Chrome). However on my main laptop when running scratch (ok flash based), cloud based games are better sync'd when using Chrome (it's a slither.io clone). Overall battery life is exceptable for both browsers.
- jordanthoms 10y agoIt's great to see battery efficiency becoming something browser vendors fight over (even if it does come with a side of the usual benchmark gaming). Hopefully it shames Google into improving Chrome's battery performance.
- hristov 10y agoWow thanks for the moderation! I guess here in Hacker News we are all smart engineers and scientists that rely on the scientific method except for when it comes to microsoft when we all turn into drooling idol worshiping children. I wonder whether MS has a well orchestrated campaign to have multiple employees troll hn, or whether they just go to the source and buy moderation points in bulk from ycombinator.
- dewiz 10y agoIt's not about the question, it's about the tone ;-)
- hristov 10y agoOk I will try asking nicer, and see if I get the script.
- hristov 10y agoSo I did put in another comment that was in an overwhelmingly positive tone and that one got downvoted as well. And no they have not released the script. So I guess it was not about the tone.
- hristov 10y agoAnd of course couple of minutes after I made my point about my second comment being downvoted, the downvotes were reversed and that comment was upvoted instead.
- yitchelle 10y agoComing from the embedded world, I have always concern about CPU loading which translates to how much power you are sucking. I can't not understand why minimal CPU load is not on top of design requirement of many software products, totally ignored if on a desktop system.
- XCSme 10y agoBecause PC Master Race. We only want 300FPS+ and 4k graphics, we don't care about $5 extra to our electricity bill, so why would software developers even bother with this and spend extra time and money for improving power drain?
- yitchelle 10y agoThanks for the laugh! Seriously, imagine the world collective savings on energy if everyone reduces their power consumption by small modest 5%.
- KirinDave 10y agoWe're even seeing websites now care about how they cause power consumption. Folks at PWAS did hallway talks about measuring it. Very cool.
- buremba 10y agoAd-blockers are taking over the internet. It seems that most people here believe that Ad-blockers must be enabled by default in browsers which is quite strange.
- deleted 10y ago[deleted]
- petre 10y agoAfter I read this I've installed Opera mobile and it's now my default browser. The ad blocker runs pretty well, along with a customized hosts file mapping advertisers' domains to localhost. Too bad DuckDuckGo is only available as a search engine in Opera Mini beta. Looking forward to get rid of Google search.