Category: Benchmarking

In the spotlight

on January 14, 2016

I’m happy to be back in North Carolina, but I had a really great time at CES. I talked to over a dozen companies about the XPRTs and the XPRT Weekly Tech Spotlight, and had some good conversations. Hopefully, some of these companies’ devices will be among the first ones we showcase when the XPRT Weekly Tech Spotlight goes live next month.

Of course, I saw some really great tech at CES! Amazing TVs and cars, magic mirrors, all kinds of drones, and the list goes on. Before the show, the Internet of Things was predicted to be big this year, and boy, was it! Smart refrigerators, door locks, and thermostats were just the beginning. Some of my favorite examples were the chopsticks and footbath—both Bluetooth enabled—and “the world’s first remote controlled game shoe.”

Clearly IoT is the Wild West of technology right now. We’re had some conversations about how the XPRTs might be able to help consumers navigate the chaos. However, with a class of products this diverse, there are a lot of issues to consider. If you have any thoughts about this, let us know!

Eric

Posted in CES, Collaborative benchmark development, Future of performance evaluation, Internet of things, IoT, What makes a good benchmark?, XPRT Weekly Tech Spotlight |

CES day 1

By Eric Hale

on January 7, 2016

It’s Wednesday night as I’m writing this. CES started in earnest today, and I had a really great day. I saw a lot of cool technology. I really liked the TVs. As I tweeted earlier today, I’m not sure that real life looks that good! That being said, the Ferrari was probably my favorite.

I’m not yet convinced about having the family calendar on a tablet embedded in the refrigerator. However, several earnest people made a very good case for it.

This morning PT announced a new program called the XPRT Weekly Tech Spotlight. This is a new way for device vendors and manufacturers to share verified results with buyers around the world. I was happy to talk with a number of different vendors about it and about the XPRTs.

I’ve also met with some community members while I’ve been here. It’s always great to hear from the community, but there’s nothing like being able to sit and talk. The conversations raised some interesting issues, and I’ll be writing about them in future blog posts.

I’m really looking forward to the rest of the show!

Eric

Posted in BenchmarkXPRT, BenchmarkXPRT development community, CES, Collaborative benchmark development, XPRT Weekly Tech Spotlight |

Another great year

By Eric Hale

on December 31, 2015

A lot of great stuff happened this year! In addition to releasing new versions of the benchmarks, videos, infographics, and white papers, we released our first-ever German UI and sponsored our first student partnership at North Carolina State University. We visited three continents to promote the XPRTs and saw XPRT results published in six of them (we’re still working on Antarctica).

Perhaps most exciting, we reached our fifth anniversary. Users have downloaded or run the XPRTs over 100,000 times.

As great as the year has been, we are sprinting into 2016. Though I can’t talk about them yet, there are some big pieces of news coming soon. Even sooner, I will be at CES next week. If you would like to talk about the XPRTs or the future of benchmarking, let me know and we’ll find a time to meet.

Whatever your holiday traditions are, I hope you are having a great holiday season. Here’s wishing you all the best in 2016!

Eric

Posted in Benchmarking, Benchmarks in general, BenchmarkXPRT development community, CES, Collaborative benchmark development, Future of performance evaluation, German, History of benchmarking |

Auf Deutsche

By Eric Hale

on December 17, 2015

Early next week, we will update WebXPRT by adding a German UI. This brings the number of available languages to three. WebXPRT has had a Simplified Chinese UI for a while, but you had to click a link on the WebXPRT page to get it. The new version removes that limitation, and lets you select Simplified Chinese, English, or German from the UI.

We’re working on getting WebXPRT to automatically detect the language of your device, but for now, the UI defaults to English.

We would like to expand the range of languages the XPRTs support over time. This is an area where you can help. If you’d like to see your language represented and are willing to help with translation, please let us know.

I know it’s the holiday season, but remember that CES will be here before we know it. I’m really looking forward to seeing the show, and I may have some big news to talk about while I’m there! If you’re planning to be at CES, send a message and let’s find a time to meet!

We will not have a blog post next week. Happy holidays!

Eric

Last week in the XPRTs
We published the December 2015 BenchmarkXPRT Development Community newsletter.
We added one new BatteryXPRT ’14 result.
We added nine new MobileXPRT ’13 results.
We added one new MobileXPRT ’15 result.
We added four new WebXPRT ’15 results.

Posted in BenchmarkXPRT development community, CES, Collaborative benchmark development, German, Simplified Chinese, WebXPRT, WebXPRT 2015, What makes a good benchmark? |

Nebula Wolf

By Eric Hale

on December 10, 2015

A couple of months ago, we talked about the senior project we sponsored with North Carolina State University. We asked a small team of students to take a crack at implementing a game that we could use as the basis of a benchmark test.

Last Friday, the project culminated with a presentation at the annual Posters and Pies event.

The team gave a great presentation, and I was impressed by how much they accomplished in 3 months. They implemented a game that they called Nebula Wolf – the mascot for NC State is a wolf. It’s a space-themed rail shooter. You can play the game, or click a button to run a script for benchmarking purposes. In the scripted mode, Nebula Wolf unlocks the frame rate so the device can run at full speed.

Over the next couple of weeks, we’re going to be testing Nebula Wolf, digging into the code and getting a deeper understanding of what the team did. We’re hoping to make the game available on our web site soon.

Tomorrow, AJ, Brien, and Rachel will present one last time, here at PT. It’s been a real pleasure working with them. I wish them all good luck as they finish college and start their careers.

Eric

Posted in Benchmark metrics, Benchmarking, Collaborative benchmark development, Future of performance evaluation |

Looking forward

By Eric Hale

on December 3, 2015

If you’re in the US, I hope you had a great Thanksgiving, and that you survived Black Friday!

On Monday, we released the second community preview for TouchXPRT 2016 (CP2). It detects the issue we described last week, by checking whether the Create Slideshow scenario completes correctly, and alerts you if it does not. We’re continuing to investigate this issue and will let you know as soon as we have more information. Results from CP2 are comparable to results from CP1. Please let us know if you have any questions or problems.

In other news, I’ll be at CES 2016 in Las Vegas in January. I can’t wait! We’re going to have some big news after the first of the year. I can’t say anything about it yet, but I’m looking forward to discussing it with folks there. If you’re planning to be at CES, send me a message, and let’s meet!

Eric

Posted in CES, Community Preview, TouchXPRT 2016, TouchXPRT development process, TouchXPRT release cycle, Trade Shows, Windows 10 |

Category: Benchmarking

In the spotlight

CES day 1

Another great year

Auf Deutsche

Nebula Wolf

Looking forward

Check out the other XPRTs: