BenchmarkXPRT Blog banner

Category: Browser-based benchmarks

How to use the WebXPRT 5 source code

In our previous blog post, we discussed the WebXPRT 5 source code and how to contact us to request free access to the server setup package. In this post, we’ll answer the two most common questions about code access. The first question is, “How do I create a local instance of WebXPRT?” The second is, “What can I do with it?” Warning: this one gets a bit technical.

How to create a local WebXPRT 5 instance

After we receive your request for access, we’ll send you a secure link to the current WebXPRT 5 server package, which contains all the necessary source files and server setup instructions. To follow the server setup instructions, you’ll need a system to use as a server, and you’ll need to be proficient with Apache, PHP, and MySQL configuration. WebXPRT 5 uses a XAMPP for Windows (cross-platform, Apache, MariaDB, PHP, and Perl) setup on the server system, which includes Apache 2.4.58 (Win64), OpenSSL 3.1.3, and PHP 8.2.12. Please note that while the instructions focus on setting up a XAMPP stack, it is also possible to set up an instance by using a LAMP or WAMP stack.

The instructions include a step-by-step methodology for setting up the server. If you are familiar with XAMPP stack configuration, the setup and configuration process should take about two to three hours, depending on whether your XAMPP-related extensions and libraries are current. If those are not current, you might want to consider updating them to current versions or just plan on a somewhat longer installation process.

What you can do with a local WebXPRT 5 instance

We let you set up their own WebXPRT 5 instances for purposes of review, internal testing, or experimentation.

One use example is internal testing in an OEM lab. Some labs use WebXPRT to conduct extensive performance testing on pre-production gear or components, and the testers very carefully avoid any scenarios where hardware or test information could leave the lab. Even though we have our own strict policies about how we handle the small amount of data that WebXPRT gathers from tests, a local WebXPRT 5 instance provides those labs with an extra layer of security for sensitive tests.

Because benchmarking requires a consistent product that enables valid comparisons over time, we do ask that users publish results only from tests that they run on WebXPRT.com. In addition, while we allow people to download the source, we reserve the right to control both derivative works and which products can use the name “WebXPRT.” That way, when people see WebXPRT scores in tech press articles or vendor marketing materials, they can be confident that they can compare those results to the results they get from running their tests on WebXPRT.com.

If you have any questions about using the WebXPRT 5 source code, let us know!

Justin

The WebXPRT 5 source code is now available!

We’re happy to announce that the WebXPRT 5 source code is now available! We’re offering the source code in the form of a build package that contains all the necessary files and step-by-step instructions for setting up a locally hosted version of WebXPRT 5. While you’re free to use the code for purposes of review, internal testing, or experimentation, we do ask that you publish only test results from the official version of WebXPRT 5 that we host at WebXPRT.com.

We’re offering the build package upon request, rather than posting a permanent download link, to prevent bots or other malicious actors from downloading it. This method also lets us engage with folks who are interested in the source code and answer any questions they may have.

To request the code, simply click the “Request WebXPRT 5 source code” link in the gray Helpful Info box on the WebXPRT 5 home page (see Figure 1 below). Clicking the link will allow you to email the BenchmarkXPRT Support team directly and request the code.

Figure 1: A screenshot showing the location of the link to request WebXPRT 5 source code on WebXPRT.com

After we receive your request, we’ll send you a secure link to the current WebXPRT 5 build package.

If you have any questions about accessing the WebXPRT 5 source code, let us know!

Justin

WebXPRT 5 source code access is on the way

Recently, a member of the tech press asked us if we were planning to offer a way for users to set up an offline version of WebXPRT 5 for locally hosted tests. The short answer is “yes.”

The long answer is that the question provides us with a good opportunity to talk about XPRT source code access and let new users know how it works.

Since the early days of the BenchmarkXPRT Development Community, we’ve provided free access to the benchmark source code. We believe that by publishing XPRT code and allowing interested parties to access and review that code, we’re doing our part to encourage transparency and honesty in the benchmarking industry.

While we offer free access to the XPRT source code, our approach to derivative work differs from some traditional open-source models that encourage developers to alter products and even take them in substantially different directions. Because benchmarking requires a product that remains static to enable valid comparisons, we prioritize maintaining the integrity and consistency of the benchmark over time. So, we allow people to download the source, but we also reserve the right to control derivative works. This approach discourages a situation where someone publishes an unauthorized version of the benchmark and calls it an “XPRT.”

For WebXPRT 5, we’ll offer the code in the form of a build package—containing all the necessary files and instructions—that will be available upon request. By offering the code upon request, as opposed to posting a permanent download link, we can prevent bots or other malicious actors from downloading it. This method also lets us engage with users interested in the source code and answer their questions.

With the WebXPRT 5 build package, you’ll be able to set up your own WebXPRT 5 instance for purposes of review, internal testing, or experimentation. We do ask that you publish only test results from the official version of WebXPRT 5 that we host at WebXPRT.com.

We expect to have the build package ready within the next few weeks. When it’s available, we’ll let readers know here in the blog, and we’ll provide more details about the access and setup process.

If you have any questions about accessing the WebXPRT 5 source code, please let us know!

Justin

WebXPRT 5 is live!

The big day has finally arrived—WebXPRT 5 is now available!

You can access the benchmark at WebXPRT.com or WebXPRT5.com. For longtime WebXPRT users, the WebXPRT 5 UI will have an all-new look but a very familiar feel. The general process for kicking off both manual and automated tests is the same as with WebXPRT 4, so the transition to WebXPRT 5 testing will be straightforward. For legacy testing purposes, we will continue to make WebXPRT 4 available on our site.

Here is a quick overview of the differences between WebXPRT 4 and WebXPRT 5:

General changes

  • We’ve updated the aesthetics of the WebXPRT UI to make WebXPRT 5 visually distinct from older versions. We did not significantly change the flow of the UI.
  • We’ve updated content in some of the workloads to reflect changes in everyday technology, such as upgrading most of the photos in the photo processing workloads to higher resolutions.
  • We’ve updated the base calibration system for score calculations and adjusted the scoring scale. WebXPRT 5 scores will be in a lower numerical range than WebXPRT 4 scores. You should not compare these results to scores from previous versions of WebXPRT.

The workloads

WebXPRT 5 includes the following seven workloads:

  • Video Background Blur with AI. Blurs the background of a video call using an AI-powered segmentation model.
  • Photo Effects. Applies a filter to six photos using the Canvas API.
  • Detect Faces with AI. Detects faces and organizes photos in an album using computer vision (OpenCV.js with Caffe Model).
  • Image Classification with AI. Labels images in an album using machine learning (OpenCV.js and ML Classify with the SqueezeNet model).
  • Document Scan with AI. Scans a document image and converts it to text using ML-based OCR (Wasm with LSTM).
  • School Science Project. Processes a DNA sequencing task using Regex and String manipulation.
  • Homework Spellcheck. Spellchecks a document using Typo.js and Web Workers.

We’re thankful for all of the feedback we received during the WebXPRT 5 development process and Preview period, and we look forward to seeing your WebXPRT 5 results. If you have any questions about WebXPRT, please feel free to contact us!

Justin

WebXPRT 5 GA is almost here!

Exciting news: We’re currently in the final stages of preparing for the WebXPRT 5 GA release and expect to take it live very soon!

The WebXPRT 5 Preview period has been very successful, and we appreciate the interest and engagement that we’ve seen from around the world. When we released the Preview and encouraged testers to submit and publish results, we said we’d try to limit any changes in the GA release to areas that would not affect test scores, such as the UI and non-workload features. We’re pleased to report that we’ve achieved that goal. WebXPRT 5 Preview testing results will be comparable with GA build results, so there will be no need to retest with the GA if you’ve already recorded Preview build scores.

If you haven’t yet used the WebXPRT 5 Preview, we encourage you to check out this blog post about the workload lineup. As we implied above, the seven core workloads in the Preview build will remain unchanged in the GA release. Additionally, while we are including a placeholder section for future experimental workloads, we’re not yet ready to include one in the GA release. We are actively working on candidate workloads for that section, but some of the underlying web technologies are not yet ready for widespread use. Taking the time to get these experimental workloads right means that there are really cool and all-new WebXPRT 5 capabilities that are still on the way!

Keep an eye on this space and WebXPRT.com for the GA announcement. This new chapter in the WebXPRT story will be the best one yet!

Justin

WebXPRT appearances in recent articles, reviews, and more!

Over the last few weeks, we’ve been excited to see steady growth in the number of people running the WebXPRT 5 Preview—as well as how widely distributed those runs are around the world. To get a picture of WebXPRT’s approximate global reach, we run the IP address data from our database through a program that provides general city- and country-level location information. By tallying that location data, we can better understand where people are running WebXPRT. By the way, this is the most detailed information we have, and all test data will remain completely anonymous unless you submit it for publication.

Based on that info—along with direct feedback from users—we’ve determined that OEM labs, tech press journalists, and individual consumers have already run the WebXPRT 5 Preview in more than 125 cities across 35 countries!

Test run data is just one of the ways that we track the progress we’re making toward our goal of providing all interested parties with benchmark tools that are reliable, relevant, and free to use. Another important way we track progress toward that goal is by paying attention to how much people use and discuss the XPRTs. When the name of one of our apps appears in an ad, article, or tech review, we call it a “mention.” Tracking those kinds of mentions helps us gauge our reach.

From time to time, we like to share a sample of recent XPRT mentions here in the blog. If you just started following the XPRTs, it may be surprising to see our global reach. Whether you’re a new visitor to the XPRT blog or a longtime reader, we hope you’ll enjoy exploring the links below!

Recent mentions include:

If you’d like to receive monthly updates on XPRT-related news and activity, we encourage you to sign up for our XPRT newsletter. It’s completely free, and all you need to do to join the newsletter mailing list is let us know! We won’t publish, share, or sell any of the contact information you provide, and we’ll only send you the monthly newsletter and occasional benchmark-related announcements, such as important news about patches or releases.

If you have any questions about the WebXPRT 5 Preview or the XPRTs in general, please feel free to contact us.

Justin

Check out the other XPRTs:

Forgot your password?