PT-Logo
Forgot your password?
CloudXPRT banner

Submit your CloudXPRT Preview results!

We invite and encourage everyone to submit benchmark results from their testing for inclusion in the public results table available here.

Please follow the process below to prepare results for submission:

  1. After completion of a benchmark run, please copy the following items into a folder for submission:

    Web microservices workload

    • The CSV results file located at CloudXPRT_vXXX_web-microservices/cnbrun/output/autoloader_mc_YYYYMMDD_*.csv.
    • The log files located at CloudXPRT_vXXX_web-microservices/cnbrun/output/autoloader_mc_YYYYMMDD_*.log.
    • The input run configuration file located at CloudXPRT_vXXX_web-microservices/cnbrun/config.json.

    Data analytics workload

    • The CSV results file generated at CloudXPRT_vXXX_data-analytics/cnbrun/results.csv, which was generated by the command line –./cnb-analytics_parse-all-results.sh | sed -e 's/\s\+/,/g' > results.csv.
    • The log files generated at CloudXPRT_vXXX_ data-analytics/cnbrun/output/autoloader_xgboost_all_ YYYYMMDD_*.log.
    • The input run configuration file located at CloudXPRT_vXXX_data-analytics/cnbrun/cnb-analytics_config.json.
  2. Fill out the required fields in the SystemInfo.csv sheet found in the root directory of each installation package. We collect this information to make it possible for others to reproduce the test and confirm that they get similar numbers.
  3. If any scripts, models, or files are customized for result generation, please describe these changes in the SystemInfo.csv file.
  4. Please zip up the system information CSV, results CSV, logs, and run configuration file and email the zip file as an attachment to the BenchmarkXPRT Community Administrator at the email address benchmarkxprtsupport@principledtechnologies.com.
  5. Use "CloudXPRT Results Submission" as the subject for your email.
  6. Do not forget to specify in the email’s body your company name and name of the person responsible for the test.
  7. Please make sure the email reply-to address you specify is a valid reply address inside your organization.
  8. Due to the complexity of CloudXPRT tests, and to be as transparent and accurate as possible with our published results, we may ask follow-up questions about the tests and/or system configuration.
  9. We will verify the tester’s identity and validate the results before publishing them to the public database.
  10. We will notify you if we publish your results.

Thank you! We look forward to your submission.

CloudXPRT results submission and review schedule

July
Submission deadline:Friday 7/17/20
Publication date:Friday 7/31/20
August
Submission deadline:Monday 8/17/20
Publication date:Monday 8/31/20
September
Submission deadline:Wednesday 9/16/20
Publication date:Wednesday 9/30/20
October
Submission deadline:Friday 10/16/20
Publication date:Friday 10/30/20
November
Submission deadline:Monday 11/16/20
Publication date:Monday 11/30/20
December
Submission deadline:N/A
Publication date:N/A

Check out the other XPRTs: