How to fool benchmarking apps

Anand Lai Shimpi and Brian Klug trace the tricks used by electronics giants to bamboozle benchmarking apps--a practice widely associated with Samsung, but also used by at least some of its competitors. At The Observer, Charles Arthur suggests that it's time to stop trusting benchmarking apps altogether.

Notable Replies

  1. teapot says:

    I agree entirely. The fact is that very very few apps use the ridiculous power of the computers many of us carry around in our pockets. My phone has a quad core 1.7GHz processor and 2GB of RAM.. how many apps do people think really take advantage of that hardware? The answer is: very few, so it entirely makes sense to turn off some of this hardware if it's not being used. There is nothing that the benchmarking apps are doing to game the results and the same settings could be turned on by any app to get at that power. The reason they don't leave it on the whole time is so the battery doesn't drain in an hour, so the worst possible accusation one could make is that they're messing with non-power-hungry apps to game battery life results (also known as optimisation).

    I'd also like to add that Charles Arthur is a fool who writes scaremongering linkbaity crap. I'm shocked that he remains The Guardian's tech editor and that his opinions are repeated here on BB.

    PS: On a recent ep of All About Android they mentioned that if you want to get "unoptimised" results out of the benchmarking apps you simply have to rename the apk before installing because the S4 (and others) apparently use the apk title as a cue to turn on optimisation.

Continue the discussion bbs.boingboing.net

10 more replies

Participants