BenchmarkXPRT Blog banner

Author Archives: Bill Catchings

Five years later…

Five years ago this month, we started what we then called the HDXPRT Development Community. The first benchmark, HDXPRT 2011, appeared six months later. A LOT has happened since then.

We’ve grown to six benchmarks (HDXPRT, TouchXPRT, WebXPRT, MobileXPRT, BatteryXPRT, and CrXPRT) with plenty of updates. As a result, we had to change the name to the BenchmarkXPRT Development Community, though we’ve come to refer to the benchmarks themselves as the XPRTs.

To tell the world about the XPRTs and the BenchmarkXPRT Development Community, we’ve written over 200 blog entries. We’ve created videos, a training course, infographics, and white papers. We’ve met members of the community at their companies, via webinars, and at trade shows. We’ve quite literally traveled around the world to shows in Las Vegas, Barcelona, Taipei, and Shenzhen.

As a result, the community has grown to about 150 individuals at over 60 companies and organizations. People have downloaded or run the benchmarks over 100,000 times in over 44 countries. The XPRTs have been cited over 3,800 times in a wide variety of websites around the world.

Yes, a lot has happened over these five years.

On behalf of the BenchmarkXPRT team, I want to convey my sincere thanks to all of you for your involvement over these years. I’m really looking forward to what the next five years will look like. We’re just getting started!

Explaining the BenchmarkXPRT Development Community

Over the last year, I’ve spoken about the XPRT benchmarks with people across America, in China (at IDF Shenzhen), and in Europe (at Mobile World Congress). I regularly found myself having to explain how the BenchmarkXPRT Development Community works. While I was glad to do so, I found myself wishing that the many people I wasn’t able to talk with could also learn about how the community works.

To help make that happen, we’ve developed a simple and engaging video. My (admittedly prejudiced) opinion is that it does a great job of explaining how the community works in less than two minutes. That’s a lot faster than I was able to explain it to folks!

We hope you enjoy the video. And we hope you’ll pass it along to other folks who aren’t already part of the community so they can learn how it works and hopefully be persuaded to join us. Thanks!

Bill

Golden tickets go global

I’ve spent the last week at Mobile World Congress (MWC) in Barcelona. The show is somewhat reminiscent of CES in January, but with a much more European/global feel. There are seven large halls of booths with phones, tablets, accessories, and gadgets of every sort.

MWC picture

I have felt Fujitsu’s haptic technology on a tablet, seen phones operating under water such as Kyocera’s and others, and even talked with someone at Oral-B about their Bluetooth-enabled electric toothbrush.

As at CES , my primary goal has not been to play with cool gadgets, see the sights, and eat good food. (Though, admittedly, all of that has been fun!) Instead, I was here to spread the word about the XPRT benchmarks. I handed out more of the special golden tickets that invite folks to be heard by joining the BenchmarkXPRT community and to take advantage of the opportunity to have PT test devices for free with all the applicable XPRT benchmarks.

If you were not able to attend CES or MWC, or I missed you and did not give you a golden ticket (or one of our cool shirts), please contact us. We don’t want any members of the community to feel left out! And, we’d love any of the rest of you readers to join the community and be part of creating the benchmarks for the next wave of cool phones, tablets, and devices.

-Bill Catchings

Comment on this post in the forums

Golden tickets

We (Bill and Mark) are on our way home from CES. There were lots of cool things to see, from electric cars to health and fitness wearables to all manner of mobile devices. And, more, a whole lot more.

We enjoyed seeing many of those products, but that was not our primary mission at the show. Our main goal was to spread the word about the XPRT benchmarks. We did that by visiting multiple mobile-device members and giving out to many of them a very special golden ticket. Yes, we’re talking a physical, Willy Wonka-style golden ticket. The two-sided tickets look really cool.

One side invites folks to be heard by joining the BenchmarkXPRT community. The other offers them the opportunity to have PT test devices for free with all the applicable XPRT benchmarks. All a vendor has to do to get this free testing is send the device to PT. We hope to get many devices in-house and to provide a great many results on our Web sites.

We wore the new BenchmarkXPRT shirts as we walked the floor.

We will soon be sending one shirt—and one golden ticket—to each member of the community. Please make sure we have your latest mailing address so we can ship those to you.

-Bill & Mark

Comment on this post in the forums

Thankful for consumers

This week in the US occur a pair of days that push in opposite directions—Thanksgiving and Black Friday. The former implores us to be thankful and the latter to consume. It seems like Black Friday is surpassing Thanksgiving in terms of importance, or at least media coverage.

I don’t particularly want to fight the Black Friday crowds, but I love reading all the ads. In them, I see all manner of consumer devices from smartphones to 4K TVs to computers to tablets. I see lots of cool devices I might want, but little help in choosing between them.

Which of the many Android smartphones will provide me with a better experience? Are any of the TVs really capable of browsing the Web or is that just a checkbox item? Is this notebook computer the best choice for creating the complex content my Web site needs? Which of these Windows 8.1 tablets will best let me manipulate my photos and videos?

I see consumers in need of tools like the XPRTs to help select products. Their ability to help uncover and understand the facts that differentiate products can be an important part of the buying process. For that, I’m thankful! My hope is that over the coming months, the next version of each of the XPRTs will make great strides in helping buyers make more informed decisions when choosing between products.

I’m also thankful to the community that makes the XPRTs possible. And, to the folks who work hard making the devices we all want to buy on Black Friday.

Finally, thanks to all of you who read this blog. Have a great Thanksgiving!

Bill

Comment on this post in the forums

Endurance

In There’s always something new to measure, we proposed several possible tests for the next version of WebXPRT. Of those, battery life testing generated the most interest.

Battery life testing poses a number of challenges. It’s not as simple as making WebXPRT loop. The biggest challenge is that different devices take different measures when the battery runs low. These measures range from dimming the screen, to stopping the hard disk, to totally shutting down the device. While these are perfectly reasonable, they are out of the benchmark’s control. Worse, most current browsers offer no way of knowing that these measures even happen nor do they offer good ways of querying the device to find out the state of its battery. We want to make sure that our approach does not unfairly advantage one device over another and gives a fair and accurate measure.

Because WebXPRT is a hosted application, we are looking at one of the other XPRT benchmarks for our first attempt at adding battery life to an existing benchmark. MobileXPRT seems to be the best fit. It runs on Android, which has a functional API for monitoring and managing power events, and the diversity of the Android ecosystem forces the benchmark to deal with a greater range of devices and OS configurations than TouchXPRT.

We are trying a number of approaches, and we have made some progress. We will discuss what we have learned in the next few weeks.

Our hope is that what we learn from MobileXPRT will better equip us to add battery life testing to WebXPRT.

Have any thoughts or comments? Post to the forums or e-mail benchmarkxprtsupport@principledtechnologies.com to let us know.

-Bill

Comment on this post in the forums

Check out the other XPRTs:

Forgot your password?