Author Archives: Justin Greene

Detective work

on January 21, 2016

A few weeks ago, we described an issue with TouchXPRT’s Create Slideshow test. On some systems, this test would take longer than expected to complete due to the output video not rendering correctly. Since then, we released TouchXPRT 2016 CP2, which includes a check that verifies the output and reports an error if there’s a problem.

It took a lot of detective work, but I’m happy to say that we’ve been able to resolve this issue. We had to make a couple of changes. First, we changed the pixel format in which the photo content is read from GUID_WICPixelFormat32bppPBGRA to GUID_WICPixelFormat32bppBGR. Second, we changed the media format of the input into the video converter from MFVideoFormat_ARGB32 to MFVideoFormat_RGB32.

After making these changes, the Create Slideshow test ran in the expected amount of time, and rendered the output video correctly.

In our testing so far, results have not changed noticeably. However, we’re continuing to test. We want to be sure that the updated build is stable and that results are comparable to earlier TouchXPRT CPs. We’ll then release it to the community.

Here’s looking forward to the release of TouchXPRT 2016 to the world at large!

Posted in BenchmarkXPRT development community, TouchXPRT, TouchXPRT 2016, TouchXPRT development process, TouchXPRT release cycle, TouchXPRT results, Windows 10 |

The XPRTs at IDF15 Shenzhen

By Justin Greene

on April 23, 2015

We recently traveled to Shenzhen, China to anchor Principled Technologies’ booth in the IDF15 Shenzhen technology showcase. Over 60 companies set up displays to interact with approximately 2,000 attendees, and it was a great opportunity for us to connect with innovators in one of the fastest-growing technology hubs in the world.

We spent most of our time talking with people about the benefits of the BenchmarkXPRT Development Community, demonstrating the XPRTs on our display systems, and describing the scope and abilities of each XPRT. Many of the people we talked with showed great interest in the XPRTs’ commitment to developing easy-to-use benchmarks that measure performance and battery life while doing everyday tasks.

Of course, we also spent a good deal of free time exploring Shenzhen and nearby Hong Kong. If you ever get the opportunity to visit either of these dynamic cities, you won’t be disappointed!

The IDF15 Shenzhen technology showcase floor. Our booth is just to the right of the gray-and-white balloon. The booming Shenzhen skyline, including the soon-to-be-second-tallest building in the world.

If we missed you at IDF15, or you have questions or comments about the Benchmark XPRT Development Community, feel free to contact us.

Justin

Posted in BenchmarkXPRT development community, Chinese, Collaborative benchmark development, IDF, Principled Technologies, Simplified Chinese, Trade Shows |

Activity all around

By Justin Greene

on October 2, 2014

It’s a busy time in XPRT land, and we wanted to share some news about upcoming events.

The first bit is an update about the CrXPRT 2014 Community Preview. We’ve been busy refining the benchmark, and feel like the current candidate build under test is likely to ship as our Community Preview. We’ll publish more details about the app and its workloads soon, but don’t be surprised to see a Community Preview announcement in the near future.

In Patching and future proofing, we discussed two potential problems while running MobileXPRT 2013 on some versions of Android 4.4 and the developer’s preview of Android L. The first problem involves the benchmark not showing scores when running on a Nexus 5 with the ART runtime enabled. The second problem was a failure of the Create Slideshow workload on Android L. In order to address the underlying cause of both problems, we’ll soon be issuing a patched MobileXPRT 2013 build. We’re still wrapping up our testing, but expect to release the patch at some point next week.

We’ll also be posting BatteryXPRT 2014 for Android APKs directly on the BatteryXPRT.com site. For users who have low bandwidth or trouble accessing the Google Play store, these APKs will make it easier to download the benchmark.

If you have any questions or concerns, please don’t hesitate to contact us at BenchmarkXPRTsupport@principledtechnologies.com.

Justin

Comment on this post in the forums

Posted in Android, BatteryXPRT 2014 for Android, Community Preview, CrXPRT, MobileXPRT |

Patching and future proofing

By Justin Greene

on September 18, 2014

We recently became aware of two potential issues with running MobileXPRT 2013 on versions of Android 4.4 (KitKat) and a pre-release version of Android L. The first involves a reported failure of MobileXPRT 2013 to display scores when running on a Nexus 5 running KitKat with the ART runtime enabled. ART is an experimental Android Runtime available on a number of mobile devices, and offers several features not found in Android’s current default runtime, Dalvik. We have not been able to reproduce this specific problem, and have successfully tested MobileXPRT on a Nexus 5 running Android 4.4.3 with ART enabled. If you encounter this problem, contact us at BenchmarkXPRTsupport@principledtechnologies.com.

The second issue is specific to the pre-release version of Android L. On that OS, we have seen a failure of the MobileXPRT Create Slideshow workload. We found that while previous versions of Android used specific addresses when loading libraries, this pre-release version of Android L loads libraries at different addresses as a security precaution. This appeared to be causing the workload failure. Recompiling with the –pie flag, so as to be position independent, seems to fix the problem.

As soon as thorough testing is complete, we’ll be releasing a patched build on MobileXPRT.com, and expect no problems running MobileXPRT on Android L.

If you have any questions about MobileXPRT or any of the other benchmarks, feel free to send us a message.

Justin

Comment on this post in the forums

Posted in Android, MobileXPRT, MobileXPRT 2013 source |

What do you think when you hear “Chromebook”?

By Justin Greene

on September 11, 2014

We’ve been thinking a lot about Chromebooks while doing all of our testing in preparation for the CrXPRT Community Preview. In both the models we’re testing and the ones announced in the press, we’ve seen just how much the Chromebook market is changing. Some folks even claim that Chromebook sales made up 35 percent of US commercial laptop sales in the first half of 2014. What’s even more interesting to us is the wide variety of Chromebooks on the market.

Choosing between Chromebooks these days is becoming more complicated than it used to be. There’s a greater range of hardware choices, and those choices can have a direct impact on performance and battery life. Some Chromebooks offer local storage up to 320 GB, touch screens, and 4G/LTE connectivity. Prices range widely, from $199 to $1,499. Even seemingly comparable systems can perform much differently when put to the test. For instance, we recently tested two Chromebooks separated by only $50 in price, but over 5 hours of estimated battery life!

Whether a consumer’s ultimate purchasing decision is based on price, specs, or a combination of factors, there are few things more valuable to buyers than reliable facts about performance and battery life. Benchmarking is ultimately about gaining useful data for decision making, and that’s why we’re excited about the value that CrXPRT will bring to the Chromebook discussion!

Justin

Comment on this post in the forums

Posted in Chrome OS, CrXPRT, Google Chrome, Performance of computing devices, What makes a good benchmark? |

HDXPRT 2014 source code is now available

By Justin Greene

on September 9, 2014

As mentioned in the XPRT blog, we are making the source code available to community members.

Download the HDXPRT 2014 source here.

We’re also posting HDXPRT build instructions in the Members Area. If you want more information, please contact BenchmarkXPRTsupport@principledtechnologies.com.

We look forward to your feedback!

Justin

Comment on this post in the forums

Posted in BenchmarkXPRT development community, HDXPRT, HDXPRT 2014, Source code |

Author Archives: Justin Greene

Detective work

The XPRTs at IDF15 Shenzhen

Activity all around

Patching and future proofing

What do you think when you hear “Chromebook”?

HDXPRT 2014 source code is now available

Check out the other XPRTs: