3 ms·
Next time I get a new phone, I'm going to put together a performance testing plan and record a video of it on the new phone. Then any time I wonder about this,
by mikeash 9y ago
Next time I get a new phone, I'm going to put together a performance testing plan and record a video of it on the new phone. Then any time I wonder about this, I can run through the plan again and compare with the recording. So, ask me again in a few years.
- kbenson 9y agoPlease publish/open source the testing criteria, so others can do the test and submit their own results. That would be awesome. I would probably run around the house and test all the phones in my family. Even something as simple as Github and using pull requests for those that know how to do so (or manually just adding for those that email and don't) would give a lot of introspection, and allow you to share commit bits so people could help (as well as making it easy for people to clone to run analysis on if they desire).
- mikeash 9y agoSounds good. I'll at least toss up the testing plan on GitHub, and maybe compile results too. I'll probably be doing this for the next iPhone, so it'll be soon.
- walterbell 9y agoMight need an identical control device that does not receive software updates.
- mikeash 9y agoThat would be ideal, but a little more money than I'm willing to spend for such a thing.
- woobar 9y agoThanks for the idea. I just created a list of built-in apps, set them to point to some deafults that do not depened on the network performance (for instance, Calendar only includes Holidays, and displays year view), rebooted and measured time to start them in a succession. Apps that depends on internet are excluded. While this is not super accurate because OS and app updates could affect their startup time, it is still something measurable. It will be interesting to see if a year from now a set of same apps with basically same functionality will take more time to start on the same (or newer) hardware.
- mikeash 9y agoI think it's OK for OS updates to affect it. Ideally you'd measure both, but measuring it with updates is the more useful of the two. The fact that security fixes don't get backported very much essentially makes updates mandatory, and as a user it doesn't really matter whether slowdowns come from hardware or software. The main thing is to confirm whether the devices really do get slower, or whether it's all a matter of rose-colored nostalgia glasses.