BenchmarkXPRT Blog banner

The MobileXPRT 3 Community Preview is here!

Justin Greene
By Justin Greene
on December 19, 2018

The MobileXPRT 3 Community Preview is now available to BenchmarkXPRT Development Community members! If you are not familiar with the updates and changes we implemented in the newest version of MobileXPRT, you can read more in the XPRT blog.

Members can access the MobileXPRT 3 Community Preview APK on the MobileXPRT tab in the Members’ Area. We also posted an installation guide that provides a general overview of the app and walks users through each step. The entire process takes about five minutes on most devices.

If you have any questions about MobileXPRT 3 or joining the community, please let us know. Happy testing!

Justin

Posted in Android, Benchmarking, BenchmarkXPRT, BenchmarkXPRT development community, Mobile devices, MobileXPRT, MobileXPRT 3, Phones, Tablets |

The MobileXPRT 3 Community Preview is almost here!

Justin Greene
By Justin Greene
on December 13, 2018

We appreciate everyone’s patience and feedback during the MobileXPRT 3 development process. We’re in the process of wrapping up some final testing and expect to release the Community Preview (CP) within the next week.

The first thing testers will notice about the CP is a new UI/UX experience. The aesthetic is completely different than MobileXPRT 2015. We’ve made it easy to select and deselect individual workloads by tapping the workload name, and we’ve consolidated common menu items into an Android-style task bar at the bottom of the screen to improve navigation.

Fundamentally, we rebuilt MobileXPRT with Android Studio SDK 27 to bring it up to date with contemporary Android development standards. While we kept the five workloads from MobileXPRT 2015, we gave one a major overhaul, updated the test content in the remaining four, and added a sixth workload: Optical Character Recognition. You can find more details about these changes in our earlier discussion about MobileXPRT 3 development in the blog.

The screenshots below show the MobileXPRT 3 main screen, how the screen looks when users customize the combination of workloads, the end-of-test results screen, and the archived results page with one test result view expanded. Note that the archived results page also displays the median of all overall test scores completed to date.

We’ll announce the CP in a community message and here on the blog when it goes live. As with all community previews, the MobileXPRT 3 CP will be available only to BenchmarkXPRT Development Community members. If you have any questions about MobileXPRT 3 or joining the community, please let us know. Happy testing!

Justin

MobileXPRT 3 start screen   MobileXPRT 3 select workloadsMobileXPRT 3 results   MobileXPRT 3 results library

Posted in Android, BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, Mobile devices, MobileXPRT, MobileXPRT 2015, MobileXPRT 3 |

XPRT collaborations: North Carolina State University

Justin Greene
By Justin Greene
on December 6, 2018

For those of us who work on the BenchmarkXPRT tools, a core goal is involving new contributors and interested parties in the benchmark development process. Adding voices to the discussion fosters the collaboration and innovation that lead to powerful benchmark tools with lasting relevance.

One vehicle for outreach that we especially enjoy is sponsoring a student project through North Carolina State University. Each semester, the Senior Design Center in the university’s Department of Computer Science partners with external companies and organizations to provide student teams with an opportunity to work on real-world programming projects. If you’ve followed the XPRTs for a while, you may remember previous student projects such as Nebula Wolf, a mini-game that shows how well different devices handle games, and VR Demo, a virtual reality prototype workload based on a room escape scenario.

This fall, a team of NC State students is developing a software console for automating machine learning tests. Ideally, the tool will let future testers specify custom workload combinations, compute a performance metric, and upload results to our database. The project will also assess the impact of the framework on performance scores. In fact, the console will perform many of the same functions we plan to implement with AIXPRT.

The students have worked very hard on the project, and have learned quite a bit about benchmarking practices and several new software tools. The project will wrap up in the next couple of weeks, and we’ll share additional details as soon as possible. Early next year, we’ll publish a video about the experience.

If you’d like to join the NC State students and hundreds of other XPRT community members in the future of benchmark development, please let us know!

Justin

Posted in AI, AIXPRT, Benchmarking, BenchmarkXPRT development community, Collaborative benchmark development, Education, Future of performance evaluation, Nebula Wolf, North Carolina State University, Virtual reality, VR Demo | Tagged , , , , , , , , , , |

Notes from the lab: Updates on HDXPRT 4, MobileXPRT 3, and AIXPRT

Justin Greene
By Justin Greene
on November 29, 2018

The next couple of months will be very busy with XPRT activity, so we want to update readers on what to expect. Depending on a number of factors, we expect to release HDXPRT 4 and MobileXPRT 3 community previews (CPs) within the next four to six weeks. We’re also hoping to publish an early AIXPRT request-for-comment (RFC) build on GitHub within the same time frame. Here’s a little more detail about each of these developments.

HDXPRT 4: We originally planned to release the HDXPRT 4 CP several weeks ago. As we recently discussed in the blog, a lot has changed in the Windows 10 development world within a short period of time, and Microsoft has released a number of new Redstone 5/October 2018 Update builds in quick succession. While our HDXPRT 4 CP candidate testing went well overall, we observed some inconsistent workload scores when testing on some of the new Windows builds. Since then, we believe we’ve narrowed down the list of possible causes to a few specific graphics driver versions, but we’re still testing to make sure there are no other immediate issues. As soon as we’re confident in that assessment, we’ll release the CP along with any relevant information about the affected graphics drivers.

MobileXPRT 3: MobileXPRT 3 development is progressing nicely, and we’re close to completing a CP candidate build. We’ll test that build extensively on our library of Android phones and tablets, and barring any unforeseen issues, we plan to release the CP in the next few weeks.

AIXPRT: AIXPRT is the umbrella name for a set of tools we’re developing to help evaluate machine learning performance. After a great deal of research, we’re getting closer to releasing a build – tentatively called the AIXPRT RFC – for community members and other interested parties to download and review. For a number of reasons, the AIXPRT RFC process will be a little different than our normal XPRT RFC and CP process. We’ll be offering more information on the AIXPRT RFC build over the next several weeks.

We’re grateful to everyone who’s contributed in any way to each of these projects, and we look forward to sharing the benchmarks with the world. If you have any questions about the XPRTs, please don’t hesitate to ask!

Justin

Posted in AI, AIXPRT, Android, BenchmarkXPRT development community, HDXPRT, HDXPRT 4, HDXPRT development process, HDXPRT release cycle, MobileXPRT, MobileXPRT 3, Windows 10 |

The XPRT Spotlight Black Friday Showcase helps you shop with confidence

Justin Greene
By Justin Greene
on November 15, 2018

Black Friday and Cyber Monday are almost here, and you may be feeling overwhelmed by the sea of tech gifts to choose from. The XPRTs are here to help. We’ve gathered the product specs and performance facts for some of the hottest tech devices in one convenient place—the XPRT Spotlight Black Friday Showcase. The Showcase is a free shopping tool that provides side-by-side comparisons of some of the season’s most popular smartphones, laptops, Chromebooks, tablets, and PCs. It helps you make informed buying decisions so you can shop with confidence this holiday season.

Want to know how the Google Pixel 3 stacks up against the Apple iPhone XS or Samsung Galaxy Note9 in web browsing performance or screen size? Simply select any two devices in the Showcase and click Compare. You can also search by device type if you’re interested in a specific form factor such as consoles or tablets.

The Showcase doesn’t go away after Black Friday. We’ll rename it the XPRT Holiday Buying Showcase and continue to add devices throughout the shopping season. So be sure to check back in and see how your tech gifts measure up.

If this is the first you’ve heard about the XPRT Weekly Tech Spotlight, here’s a little background. Our hands-on testing process equips consumers with accurate information about how devices function in the real world. We test devices using our industry-standard BenchmarkXPRT tools: WebXPRT, MobileXPRT, TouchXPRT, CrXPRT, BatteryXPRT, and HDXPRT. In addition to benchmark results, we include photographs, specs, and prices for all products. New devices come online weekly, and you can browse the full list of almost 150 that we’ve featured to date on the Spotlight page.

If you represent a device vendor and want us to feature your product in the XPRT Weekly Tech Spotlight, please visit the website for more details.

Do you have suggestions for the Spotlight page or device recommendations? Let us know!

Justin

Posted in Chromebooks, CrXPRT, HDXPRT, Interactive tools, Laptops, Mobile devices, MobileXPRT, PCs, TouchXPRT, WebXPRT, XPRT Weekly Tech Spotlight | Tagged , , , , , , , , , , , , , , , , , , , , , , , , |

HDXPRT 4: Getting it right

Justin Greene
By Justin Greene
on November 8, 2018

For BenchmarkXPRT Development Community members anticipating the HDXPRT 4 Community Preview (CP), we want to thank you for your patience and explain where we are in the release process.

This past month has brought a flurry of activity in the Windows 10 development world. We’ve been testing HDXPRT 4 extensively on each of the new prerelease builds available through the Windows Insider Program. While testing on a recent Windows 10 Redstone 5 preview build, we began to see inconsistent HDXPRT 4 workload scores on some systems. The difference between those workload scores and scores on the same systems with previous Windows 10 builds was significant enough for us to decide that the best course of action is to hold off on the CP until we understand the issue. We don’t want to release a CP only to run into serious problems with an imminent Windows release. We want to take the time to figure out what’s going on and get it right.

We hope to resolve these issues and publish the HDXPRT 4 CP as soon as possible. Thanks again for your patience. We’ll update the community soon with more information on the anticipated release schedule.

Justin

Posted in Application-based benchmarks, Benchmarking, BenchmarkXPRT, BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, HDXPRT, HDXPRT 4, HDXPRT development process, HDXPRT release cycle, Performance benchmarking, Windows 10 | Tagged , , , , , |

Check out the other XPRTs:

Forgot your password?
© Principled Technologies, Inc. 2024   |   Privacy policy

Cookie Notice: Our website uses cookies to deliver a smooth experience by storing logins and saving user information. By continuing to use our site, you agree with our usage of cookies as our privacy policy outlines.

x