GameBench: Thwarting Cheaters, Taking Names | Pocketnow

Опубликовано 8 августа 2014, 18:26

Read more: /2014/08/08/gamebench

We all want fast devices, but RAM, CPU, and GPU are all just lines on a spec sheet. That's where benchmarking comes in, but they can be gamed, and even cheated. Today we're going hands on with GameBench: thwarting cheaters, taking names

With so many components inside our devices, and complex interrelations between them, it's all but impossible for us to gauge "how fast" something is just by looking at its specifications.

Additional cores have an impact. How fast those cores are clocked play into the equation. Why type of technology is inside those cores plays a huge role in how fast our devices are.

Add to that the amount, type and speed of RAM, and all the same considerations for the graphics processor, and you can see how the stack of variables keeps getting higher. Changing one spec can have unexpected consequences when the device is looked at on the whole.

That's where benchmarking comes into play. In theory, benchmarking is a concept wherein you run several devices through the same set of tests. Since the tests themselves are the same, the devices themselves are tested. The result is a score that should be comparable and telling of just how fast one device is when compared to another.

The issue with benchmarks in general is that those tests are often weighted such that the score you're interested in is factored lower than that of a score that someone else has interest -- and vice versa.

And then there's the potential for cheating. Not long ago we saw some manufacturers "gaming" the benchmarks, to artificially ramp up their speeds when they detected a benchmark was loading. This resulted in false highs. Another issue is in the tests themselves. Especially when comparing graphics processing, benchmark apps often have to build their own graphics engines which usually lag behind what "real" games and graphics apps can do -- and the manner in which they do it.

That's where GameBench comes in to play.

It's a new kind of benchmarking utility that approaches the problem from a completely different angle. Rather than running a series of tests that may or may not represent what you actually use your device for, GameBench lets you test your own apps.

Testing is a bit unique. Rather than installing the app and pressing the "go" or "start" button, here you select which apps you want GameBench to monitor. When you fire off the test you'll notice a time with a stop sign placed on your screen. This is a visual indicator that lets you know not only that GameBench is monitoring the game, but is also recording the session so it can analyze it later.

You must run these tests yourself -- play the games -- the app won't do it automatically for you.

While that's a bit inconvenient -- I mean really, who actually ~likes~ playing games, right? -- it does provide you with some very interesting data, and brings a lot of "firsts" to the mobile benchmarking industry.

GameBench is the first app to provide detailed Performance and Battery analysis across Android devices
- First Usability Benchmark in the market
- Record frame rates and battery drain rates!
- Visually correlate on-screen events to Frames Per Second
- Simple to understand ratings
- Game performance and battery analysis
- Reports on Frame Rates
- Quick identification of bottlenecks in the game
- Graphs showing usage of CPU and GPU
- Battery drain rates

There are some nuances to be aware of.
- Currently, devices powered by MediaTek processors aren't supported because many of them have not enabled systrace in the kernel options.
- Getting this kind of data needed for deep-digging benchmarks like this would usually require a rooted device. Although GameBench does not require root, it does need you to enable USB debugging, connect to and run an app on your desktop computer, though you only have to do this once.

Overall, GameBench is a huge step in the right direction!

Subscribe: bit.ly/pocketnowsub
pocketnow.com

Follow us:
flipboard.com/@Pocketnow
facebook.com/pocketnow
twitter.com/pocketnow
google.com/+pocketnow
instagram.com/pocketnow

About us:
Pocketnow has been a key source of mobile technology news and reviews since its establishment in 2000. With offices on three continents, Pocketnow offers round-the-clock coverage of the mobile technology landscape, from smartphones to tablets to wearables. We aim to be your number-one source for mobile tech news, reviews, comparisons, and commentary. If you love mobile as much as we do, be sure to subscribe!

GameBench: Thwarting Cheaters, Taking Names | Pocketnow
youtube.com/watch?v=snQ25ustyD

PocketNow
youtube.com/pocketnow