In July, we discussed the Chrome OS team’s decision to end support for Chrome apps, and how that will prevent us from publishing any future fixes or updates for CrXPRT 2. We also announced our goal of beginning development of an all-new Chrome OS XPRT benchmark by the end of this year. While we are actively discussing this benchmark and researching workload technologies and scenarios, we don’t foresee releasing a preview build this year.
The good news is that,
in spite of a lack of formal support from the Chrome OS team, the CrXPRT 2
performance and battery life tests currently run without any known issues. We
continue to monitor the status of CrXPRT and will inform our blog readers of
any significant changes.
If you have any questions about CrXPRT, or ideas about the types of features or workloads you’d like to see in a new Chrome OS benchmark, please let us know!
Tom’s Guide published an interesting article
about how they used ChromeOS Flex to turn a
ten-year-old Apple MacBook Pro into a functioning Chromebook by replacing the
laptop’s macOS operating system with ChromeOS. ChromeOS Flex is a free Google
tool that allows users to create a bootable USB drive that they can then use to
install ChromeOS on a wide variety
of hardware platforms that traditionally run other operating systems such as
macOS or Windows. Because ChromeOS is a cloud-first, relatively low-overhead
operating system, the ChromeOS Flex option could breathe new life into an old
laptop that you have lying around.
Never having encountered a MacBook Pro with ChromeOS, we were interested to learn about Tom’s experience running XPRT benchmarks in this new environment. WebXPRT 4, WebXPRT 3, and the CrXPRT 2 performance test apparently ran without any issues, but we have not yet seen a CrXPRT 2 battery life result from a ChromeOS Flex environment. We plan to experiment with this soon.
were happy to publish the results on our site, and will consider any ChromeOS
Flex results we receive for publication. If you submit results from ChromeOS
Flex testing, we ask that you use the “Additional information” field in the
results submission form to clarify that you ran the tests in a ChromeOS Flex
environment. This will prevent any possible confusion when we see a submission
that lists a traditional macOS or Windows hardware platform along with a
ChromeOS version number.
Do you have experience running CrXPRT or WebXPRT with ChromeOS Flex? We’d love to hear about it!
The new school year is
upon us, and learners of all ages are looking for tech devices that have the
capabilities they will need in the coming year. The tech marketplace can be
confusing, and competing claims can be hard to navigate. The XPRTs are here to
help! Whether you’re shopping for a new phone, tablet, Chromebook, laptop, or
desktop, the XPRTs can provide reliable, industry-trusted performance scores
that can cut through all the noise.
A good place to start looking
for scores is the WebXPRT 4 results viewer. The viewer displays WebXPRT 4 scores from
over 175 devices—including many hot new releases—and we’re adding new scores
all the time. To learn more about the viewer’s capabilities and how you can use
it to compare devices, check out this blog post.
Another resource we
offer is the XPRT results browser. The browser is the most efficient way to access the XPRT
results database, which currently holds more than 3,000 test results from over 120
sources, including major tech review publications around the world, OEMs, and
independent testers. It offers a wealth of current and historical performance
data across all of the XPRT benchmarks and hundreds of devices. You can read
more about how to use the results browser here.
Also, if you’re considering a popular device, chances are good that a recent tech review includes an XPRT score for that device. Two quick ways to find these reviews: (1) go to your favorite tech review site and search for “XPRT” and (2) go to a search engine and enter the device name and XPRT name (e.g., “Apple MacBook Air” and “WebXPRT”). Here are a few recent tech reviews that use one of the XPRTs to evaluate a popular device:
- Notebookcheck used WebXPRT in reviews of the Acer Swift X 16, Apple MacBook Air, ASUS ROG Flow X16, Lenovo V17G2, Nothing Phone (1); and a recent article titled, “The Best Smartphones.”
- PCMag used WebXPRT 3 to compare the M1 Max and M1 Ultra versions of the Apple Mac Studio, and to review the Apple Macbook Air (2022, M2).
- PCWorld used CrXPRT 2 in a feature called, “The best Chromebooks: Best overall, best battery life, and more.”
- ZDNet used CrXPRT 2 in a review titled, “The 5 best Chromebooks for students: Top back-to-school picks.”
The XPRTs can help consumers make better-informed and more confident tech purchases. As this school year begins, we hope you’ll find the data you need on our site or in an XPRT-related tech review. If you have any questions about the XPRTs, XPRT scores, or the results database please feel free to ask!
In March, we discussed the Chrome OS team’s plan to end support for Chrome apps in June and instead focus their
efforts on Chrome extensions and Progressive Web Apps. After receiving feedback
on their published timeline, the Chrome OS team decided to extend Chrome app support for Enterprise and Education account
customers through January 2025. Because we publish our Chrome app (CrXPRT) through a private BenchmarkXPRT developer account, and because
we have not seen any further updates to the support timeline, we don’t assume
that the support extension will apply to CrXPRT.
Since June has come and gone, and the support extension probably does not apply to our account, we do not expect to be able to publish any future fixes or updates for CrXPRT. As of now, and up through Chrome 105, the CrXPRT 2 performance and battery life tests are still working without a hitch. We will continue to run the benchmark on a regular basis to monitor functionality, and we will disclose any future issues here in the blog and on CrXPRT.com. We hope the app will continue to run both performance and battery life tests well into the future. However, given the frequency of Chrome updates, it’s difficult for us to predict how long the benchmark will remain viable.
As we mentioned back in March, we hope to begin development of an all-new Chrome OS XPRT benchmark by the end of this year. We’ll discuss that prospect in more detail in future blog posts, but if you have ideas about the types of features or workloads you’d like to see in a new Chrome OS benchmark, please let us know!
Each month, we send a newsletter to members of the BenchmarkXPRT Development Community. In the newsletter, we recap the latest updates from the XPRT world and provide a summary of the previous month’s XPRT-related activity, including uses or mentions of the XPRTs in the tech press. More people read the weekly XPRT blog than receive the monthly newsletter, so we realized that some blog readers may be unaware of the wide variety of tech outlets that regularly use or mention the XPRTs.
So for today’s blog, we want to give readers a sampling of the XPRT press usage we see on a weekly basis. Recent mentions include:
- Tom’s Guide used HDXPRT 4 to compare the performance of the Geekom Mini IT8 and Dell OptiPlex 7090 Ultra small-form-factor PCs.
- Intel used WebXPRT 4 test data in promotional material for their line of 12th Gen) Intel Core processors(Alder Lake). Hundreds of press outlets then republished the presentation.
- AnandTech used WebXPRT 4 to evaluate the Cincoze DS-1300 Industrial PC.
- ZDNet used CrXPRT 2 in a review titled The best Chromebooks for students: Student-proof laptops.
- PCWorld used CrXPRT 2 to provide data for an article listing their top Chromebook recommendations.
- TechPowerUp used WebXPRT 3 to compare the browser performance of Intel Core i9-12900KS processor-based systems and other Intel- and AMD processor-based systems.
- Other outlets that have published articles, ads, or reviews mentioning the experts in the last few months include: Android Authority, ASUS, BenchLife, Gadgets 360, Good Gear Guide, Hardware.info, Hot Hardware, ITHardware (Poland), ITMedia (Japan), Itndaily (Russia), Mobile01.com (China), Notebookcheck, PCMag, ProClockers, Sohu.com (China), Tom’s Hardware, and Tweakers.
If you don’t currently receive the monthly
BenchmarkXPRT newsletter, but would like to join the mailing list, please let us know! We will not publish or sell any of the contact information you
provide, and will only send the monthly newsletter and occasional benchmark-related
announcements such as patch notifications or new benchmark releases.
we heard from a BenchmarkXPRT Development Community member who was testing
Chromebooks in their lab. On a few of the Chromebooks, they saw sporadic CrXPRT
2 battery life test failures where CrXPRT 2 would successfully complete a
battery life test and produce a result for the initial run, but then fail at
the end of later runs.
a considerable amount of troubleshooting, they determined that the issue seemed
to be related to the way some systems automatically shut down before the
battery is completely exhausted, and the way some systems will automatically
boot up once the tester plugs in the power adapter for charging. This member found
that when they added a few system configuration steps before battery life tests
and made slight changes to their post-test routine, the systems that had
previously experienced consistent failures would successfully complete battery
life tests and produce results.
added steps are quick and straightforward, and we decided to add them to the
Configuring the test device and Running the tests sections of the CrXPRT 2 user manual.
We hope this updated guidance will help to prevent future frustration for
CrXPRT 2 testers.
If you have any questions or comments about the CrXPRT 2 battery life test, please feel free to contact us!