Month: June 2013

A new version and a new video

on June 27, 2013

As we said in It’s finally here!, the Android ecosystem is very diverse and we knew that MobileXPRT might have problems on some devices. So far, we have encountered a couple of issues:

The Slideshow test failed during post validation check on the Onda tablet.
The Zoom-n-pinch test was unstable, failing part of the time, on the Zopo phone

On Friday, we will be releasing MobileXPRT 2013 community preview 1.1 (CP1.1), which fixes these problems. The results from version CP1.1 are comparable to the current community preview. If you have any problems, or questions, please e-mail us at benchmarkxprtsupport@principledtechnologies.com

We will release the source for CP1.1 next week.

In other news, we released a new video this week, BenchmarkXPRT: It’s not a benchmark. In this video, Bill answers some common questions about the BenchmarkXPRT Development Community. If you’ve ever wondered what exactly BenchmarkXPRT is, or why the world needs more benchmarks, this is the video for you.

Eric

Comment on this post in the forums

Posted in Android, BenchmarkXPRT, BenchmarkXPRT development community, MobileXPRT, MobileXPRT 2013 source, Video |

The truth hurts

By Eric Hale

on June 20, 2013

The truth hurts sometimes. Bill loves to mention how long he, Mark, and I have been involved in benchmark software. I am, of course, grateful to him for reminding me of just how old we all are.

Another truth that hurts is that sometimes things don’t happen when you want them to. Case in point: The preview of Windows 8.1 is supposed to be available on June 26. We released TouchXPRT, which is based on Windows 8, to the public in February.

The problem of timing is not limited to benchmarks. All software has timing issues. While the advance descriptions of the changes in Windows 8.1 don’t mention anything that should break the benchmark, we need to see what, if any, effect, the new version of the OS may have on the benchmark and its results.

As soon as the preview is available, we’ll start testing with it. As soon as we know whether TouchXPRT runs on Windows 8.1 and gives results comparable to Windows 8, we will let you know. We would appreciate help from any of you in trying out TouchXPRT with Windows 8.1. Let us know what you find out!

Eric

Comment on this post in the forums

Posted in Benchmarking, TouchXPRT, Windows 8.1 |

Chaos and opportunity

By Eric Hale

on June 13, 2013

With both E3 and Apple’s WWDC happening this week, there’s been a lot of news. There’s also been a lot of hyperbolic commentary. I am not about to get into the arguments about the PS4 vs. the Xbox One or iOS 7 vs. Android.

It was Tim Cook’s presentation at WWDC that really got my attention. It’s unusual in an executive presentation to focus so much attention on a particular competitor, but Android was clearly on his mind. At one point, he focused harsh attention on fragmentation in the Android market, calling it “terrible” for developers. You can see the video here, at about 74 minutes.

As we saw in the 90s, chaos can breed innovation. At that time, the paradigm was that Macs always worked, but if you wanted the most advanced hardware, you should get a PC. I remember the editors at MacWorld, who deeply, truly loved the Mac, lusting over the (by the standards of the time) small, light, cheap notebooks PC users could get.

That being said, we understand the challenges of developing in the Android market. As I said in It’s finally here!, the Android ecosystem is sufficiently diverse that we know the benchmark will encounter configurations we’ve not seen before. If you have any problems with the MobileXPRT CP, please let us know at benchmarkxprtsupport@principledtechnologies.com. We want the benchmark to be the best it can be.

Eric

Comment on this post in the forums

Posted in Android, BenchmarkXPRT development community, History of benchmarking, History of computers, MobileXPRT |

Kick the tires. Look under the hood.

By Eric Hale

on June 6, 2013

Today, we released the source code for the MobileXPRT 2013 CP to the community (community login required). If you already have an Android development environment set up, building the benchmark is very straightforward. If you do not have a build environment, it’s not difficult to create one. All the necessary software is free, and the build documentation includes detailed instructions for creating the build environment on Windows 8.

Of course, you can also build Android applications using Linux or Mac OS X. The instructions include links to the information you need to set up those environments as well.

If you have suggestions about how we could make the application better, or you write some code you would like to submit for inclusion in the benchmark, please contact us at benchmarkxprtsupport@principledtechologies.com.

Bill wrote about a presentation he gave to Mobile PC Extended Battery Life Working Group (EBL WG) in the post Presentation XPRT. We’ve put the slides from that presentation up on Slideshare. Check them out!

Eric

Comment on this post in the forums

Posted in Android, BenchmarkXPRT development community, MobileXPRT, MobileXPRT 2013 source |

Month: June 2013

A new version and a new video

The truth hurts

Chaos and opportunity

Kick the tires. Look under the hood.

Check out the other XPRTs: