AIXPRT results
The table below presents AIXPRT results curated by the Community Administrator. Use the tabs at the top to switch from one network model to another. Click the column headers to sort the table by row. To submit your own results for inclusion in the table, click here.
Search:
System type:
x
Latency percentile:
x
Maximum latency (ms):
x
Minimum throughput (images/sec):
x
Batch size:
x
Precision:
x
Framework:
x
Target HW:
x
ResNet-50
SSD-MobileNet
Wide and Deep
Type |
Processor |
Framework |
Network |
Target HW |
Precision |
Batch size |
Concurrent instances |
Latency percentile |
Latency (ms) |
Throughput (images/sec) |
Date |
Source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | GPU - Intel HD Graphics 620 | FP32 | 32 | 1 | 90th | 1193.6 | 27.5 | 2019-02-26 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 32 | 1 | 90th | 1553.0 | 21.5 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 2 | 1 | 90th | 92.4 | 21.9 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | 90th | 44.6 | 23.0 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 4 | 1 | 90th | 195.9 | 21.9 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 8 | 1 | 90th | 389.5 | 21.7 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | 90th | 782.1 | 21.5 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 64 | 1 | 90th | 3114.5 | 21.7 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 128 | 1 | 90th | 6191.4 | 21.7 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | GPU - Intel HD Graphics 620 | FP32 | 1 | 1 | 90th | 35.1 | 28.6 | 2019-02-26 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | GPU - Intel HD Graphics 620 | FP32 | 2 | 1 | 90th | 74.8 | 27.3 | 2019-02-26 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | GPU - Intel HD Graphics 620 | FP32 | 4 | 1 | 90th | 147.4 | 27.8 | 2019-02-26 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | GPU - Intel HD Graphics 620 | FP32 | 8 | 1 | 90th | 294.2 | 27.8 | 2019-02-26 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | GPU - Intel HD Graphics 620 | FP32 | 16 | 1 | 90th | 589.4 | 27.8 | 2019-02-26 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | GPU - Intel HD Graphics 620 | FP32 | 64 | 1 | 90th | 2368.1 | 28.0 | 2019-02-26 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | ResNet-50 | GPU - Intel HD Graphics 620 | FP32 | 128 | 1 | 90th | 4693.4 | 28.1 | 2019-02-26 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 1 | 1 | 90th | 113.2 | 9.3 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 2 | 1 | 90th | 199.7 | 10.1 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 4 | 1 | 90th | 406.9 | 9.9 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 8 | 1 | 90th | 864.5 | 9.4 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 16 | 1 | 90th | 1796.5 | 9.2 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 32 | 1 | 90th | 3771.0 | 8.7 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 64 | 1 | 90th | 7663.3 | 8.5 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 128 | 1 | 90th | 15555.9 | 8.4 | 2019-03-04 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | 90th | 17.0 | 59.1 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 2 | 1 | 90th | 33.1 | 60.6 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 4 | 1 | 90th | 63.1 | 63.6 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 8 | 1 | 90th | 125.6 | 63.8 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | 90th | 249.6 | 64.1 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 32 | 1 | 90th | 497.8 | 64.2 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 64 | 1 | 90th | 995.0 | 64.4 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 128 | 1 | 90th | 1986.7 | 64.5 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 1 | 1 | 90th | 53.0 | 19.2 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 2 | 1 | 90th | 96.6 | 21.3 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 4 | 1 | 90th | 182.2 | 22.4 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 8 | 1 | 90th | 362.8 | 22.5 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 16 | 1 | 90th | 714.1 | 22.7 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 32 | 1 | 90th | 1472.3 | 21.9 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 64 | 1 | 90th | 2968.9 | 21.6 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 128 | 1 | 90th | 6113.9 | 21.0 | 2019-03-01 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | 90th | 5.2 | 195.6 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 2 | 1 | 90th | 9.6 | 212.5 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 4 | 1 | 90th | 14.3 | 283.7 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 8 | 1 | 90th | 26.7 | 309.8 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | 90th | 54.0 | 300.5 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 32 | 1 | 90th | 106.1 | 302.2 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 64 | 1 | 90th | 211.9 | 303.0 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 128 | 1 | 90th | 427.0 | 299.7 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 1 | 1 | 90th | 51.0 | 20.5 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 2 | 1 | 90th | 32.5 | 61.6 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 4 | 1 | 90th | 51.1 | 78.9 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 8 | 1 | 90th | 106.5 | 76.0 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 16 | 1 | 90th | 216.4 | 74.4 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 32 | 1 | 90th | 471.7 | 68.1 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 64 | 1 | 90th | 981.8 | 65.5 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 128 | 1 | 90th | 2139.1 | 60.0 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 1 | 1 | 90th | 8.1 | 121.4 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 2 | 1 | 90th | 8.3 | 233.9 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 4 | 1 | 90th | 10.9 | 359.6 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 8 | 1 | 90th | 16.9 | 477.2 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 16 | 1 | 90th | 28.7 | 557.8 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 32 | 1 | 90th | 53.5 | 603.9 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 64 | 1 | 90th | 113.9 | 566.7 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 128 | 1 | 90th | 246.0 | 524.2 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 1 | 1 | 90th | 4.2 | 251.1 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 2 | 1 | 90th | 5.1 | 393.6 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 4 | 1 | 90th | 7.1 | 574.2 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 8 | 1 | 90th | 11.3 | 712.3 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 16 | 1 | 90th | 20.3 | 808.0 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 32 | 1 | 90th | 36.6 | 895.5 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 64 | 1 | 90th | 72.6 | 903.5 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 128 | 1 | 90th | 141.7 | 927.4 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | 90th | 6.4 | 156.3 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 2 | 1 | 90th | 10.2 | 197.9 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 4 | 1 | 90th | 18.5 | 217.1 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 8 | 1 | 90th | 35.5 | 225.5 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | 90th | 73.9 | 216.4 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 32 | 1 | 90th | 147.1 | 218.8 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 64 | 1 | 90th | 295.7 | 216.7 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 128 | 1 | 90th | 600.1 | 213.0 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 1 | 1 | 90th | 23.3 | 42.9 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 2 | 1 | 90th | 37.8 | 53.0 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 4 | 1 | 90th | 66.8 | 59.9 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 8 | 1 | 90th | 140.7 | 57.1 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 16 | 1 | 90th | 284.4 | 56.5 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 32 | 1 | 90th | 611.5 | 52.6 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 64 | 1 | 90th | 1245.1 | 51.6 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 128 | 1 | 90th | 2685.8 | 47.7 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 1 | 1 | 90th | 8.1 | 123.8 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 2 | 1 | 90th | 8.2 | 239.4 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 4 | 1 | 90th | 11.1 | 358.0 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 8 | 1 | 90th | 16.9 | 471.9 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 16 | 1 | 90th | 28.4 | 564.4 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 32 | 1 | 90th | 53.3 | 601.5 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 64 | 1 | 90th | 117.8 | 556.2 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 128 | 1 | 90th | 254.7 | 511.4 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 1 | 1 | 90th | 4.2 | 257.7 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 2 | 1 | 90th | 5.0 | 401.8 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 4 | 1 | 90th | 7.1 | 575.2 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 8 | 1 | 90th | 11.2 | 719.5 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 16 | 1 | 90th | 19.6 | 838.8 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 32 | 1 | 90th | 37.3 | 915.4 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 64 | 1 | 90th | 73.7 | 890.8 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | ResNet-50 | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 128 | 1 | 90th | 135.9 | 988.0 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 1 | 1 | 50th | 48.9 | 20.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 2 | 1 | 50th | 91.3 | 21.9 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 4 | 1 | 50th | 164.6 | 24.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 8 | 1 | 50th | 311.7 | 25.7 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 16 | 1 | 50th | 603.9 | 26.5 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 32 | 1 | 50th | 1171.9 | 27.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 64 | 1 | 50th | 2320.3 | 27.6 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 128 | 1 | 50th | 4625.6 | 27.7 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 1 | 1 | 90th | 50.0 | 20.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 2 | 1 | 90th | 91.8 | 21.9 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 4 | 1 | 90th | 165.6 | 24.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 8 | 1 | 90th | 313.4 | 25.7 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 16 | 1 | 90th | 606.7 | 26.5 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 32 | 1 | 90th | 1178.2 | 27.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 64 | 1 | 90th | 2329.0 | 27.6 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 128 | 1 | 90th | 4635.6 | 27.7 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 1 | 1 | 95th | 50.4 | 20.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 2 | 1 | 95th | 91.8 | 21.9 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 4 | 1 | 95th | 165.6 | 24.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 8 | 1 | 95th | 314.3 | 25.7 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 16 | 1 | 95th | 608.0 | 26.5 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 32 | 1 | 95th | 1180.1 | 27.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 64 | 1 | 95th | 2334.4 | 27.6 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 128 | 1 | 95th | 4644.6 | 27.7 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 1 | 1 | 99th | 50.8 | 20.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 2 | 1 | 99th | 91.8 | 21.9 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 4 | 1 | 99th | 165.6 | 24.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 8 | 1 | 99th | 315.0 | 25.7 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 16 | 1 | 99th | 609.1 | 26.5 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 32 | 1 | 99th | 1182.3 | 27.3 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 64 | 1 | 99th | 2338.7 | 27.6 | 2019-05-20 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | ResNet-50 | CPU | FP32 | 128 | 1 | 99th | 4650.2 | 27.7 | 2019-05-20 | PT |
| Desktop | AMD Ryzen 9 3900X @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 157.6 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 9 3900X @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 66.7 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700X @ 3.60 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 111.0 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700X @ 3.60 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 76.3 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 2700X | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 64.9 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 2700X | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 48.1 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i9-9900K | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 125.4 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i9-9900K | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 101.5 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i7-8700K | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 92.7 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i7-8700K | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 79.4 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i5-8400 | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 85.2 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i5-8400 | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 74.9 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i5-8400 | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 111.6 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i5-8400 | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 139.2 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i7-8700K | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 85.2 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i7-8700K | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 153.2 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i9-9900K | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 183.3 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i9-9900K | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 163.7 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 2700X | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 62.5 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 2700X | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 67.8 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700X @ 3.60 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 67.7 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700X @ 3.60 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 91.2 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 9 3900X @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 128.6 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 9 3900X @ 3.80 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 76.1 | 2019-08-12 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 4 | 1 | Unknown | N/A | 60.5 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 54.0 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 4 | 1 | Unknown | N/A | 60.5 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 57.5 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-8565U | OpenVINO | ResNet-50 | CPU | FP32 | 4 | 1 | Unknown | N/A | 36.7 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-8565U | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 37.7 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 4 | 1 | Unknown | N/A | 196.0 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 178.3 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 4 | 1 | Unknown | N/A | 191.4 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 178.8 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-8565U | OpenVINO | ResNet-50 | CPU | INT8 | 4 | 1 | Unknown | N/A | 55.6 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-8565U | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 66.2 | 2019-08-14 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700U | OpenVINO | ResNet-50 | CPU | FP32 | Unknown | 1 | 90th | 42.78 | 24.88 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | Unknown | 1 | 90th | 17.44 | 59.48 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | FP32 | Unknown | 1 | 90th | 17.69 | 59.46 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | INT8 | Unknown | 1 | 90th | 5.70 | 196.74 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | ResNet-50 | CPU | INT8 | Unknown | 1 | 90th | 5.70 | 196.62 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-8565U | OpenVINO | ResNet-50 | CPU | INT8 | Unknown | 1 | 90th | 15.71 | 66.37 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-8565U | OpenVINO | ResNet-50 | CPU | FP32 | Unknown | 1 | 90th | 27.99 | 37.94 | 2019-08-19 | HotHardware |
| Desktop | AMD Ryzen 7 3700U | OpenVINO | ResNet-50 | CPU | INT8 | Unknown | 1 | 90th | 36.33 | 28.55 | 2019-08-19 | HotHardware |
| Desktop | AMD Ryzen 5 3600X | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 87.7 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 3600X | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 62.0 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 3600X | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 66.8 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 3600X | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 55.0 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 2600X | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 49.9 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 2600X | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 37.4 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 2600X | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 51.8 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 2600X | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 48.1 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9600K | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 92.0 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9600K | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 83.0 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9600K | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 147.6 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9600K | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 89.8 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9400F | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 88.3 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9400F | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 78.0 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9400F | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 93.4 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9400F | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 75.9 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i3-9100 | OpenVINO | ResNet-50 | CPU | FP32 | 16 | 1 | Unknown | N/A | 63.8 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i3-9100 | OpenVINO | ResNet-50 | CPU | FP32 | 1 | 1 | Unknown | N/A | 56.9 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i3-9100 | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | Unknown | N/A | 97.8 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i3-9100 | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | Unknown | N/A | 57.0 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i9-10980XE | OpenVINO | ResNet-50 | CPU | Unknown | Unknown | 1 | Unknown | Unknown | 902.0 | 2020-02-12 | Ars Technica |
| Desktop | AMD Threadripper 3970X | OpenVINO | ResNet-50 | CPU | Unknown | Unknown | 1 | Unknown | Unknown | 268.0 | 2020-02-12 | Ars Technica |
| Desktop | Intel Core i9-9980XE | OpenVINO | ResNet-50 | CPU | Unknown | Unknown | 1 | Unknown | Unknown | 310.0 | 2020-02-12 | Ars Technica |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | 90th | 7.58 | 144.58 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 2 | 1 | 90th | 13.53 | 159.49 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 4 | 1 | 90th | 24.57 | 174.86 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 8 | 1 | 90th | 48.43 | 183.73 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | 90th | 111.87 | 162.68 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | ResNet-50 | CPU | INT8 | 32 | 1 | 90th | 237.03 | 152.27 | 2020-06-26 | PT |
| Desktop | Intel Core i7-10875H | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | 90% | 8.15 | 133.94 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | ResNet-50 | CPU | INT8 | 2 | 1 | 90% | 13.67 | 156.70 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | ResNet-50 | CPU | INT8 | 4 | 1 | 90% | 25.17 | 172.27 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | ResNet-50 | CPU | INT8 | 8 | 1 | 90% | 46.52 | 183.56 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | 90% | 94.90 | 182.12 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | ResNet-50 | CPU | INT8 | 32 | 1 | 90% | 198.24 | 170.34 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | ResNet-50 | CPU | INT8 | 1 | 1 | 90% | 9.67 | 104.97 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | ResNet-50 | CPU | INT8 | 2 | 1 | 90% | 16.67 | 121.92 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | ResNet-50 | CPU | INT8 | 4 | 1 | 90% | 30.69 | 131.83 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | ResNet-50 | CPU | INT8 | 8 | 1 | 90% | 59.90 | 134.88 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | ResNet-50 | CPU | INT8 | 16 | 1 | 90% | 122.42 | 131.61 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | ResNet-50 | CPU | INT8 | 32 | 1 | 90% | 246.88 | 130.32 | 2020-08-14 | SMZDM (China) |
Type |
Processor |
Framework |
Network |
Target HW |
Precision |
Batch size |
Concurrent instances |
Latency percentile |
Latency (ms) |
Throughput (images/sec) |
Date |
Source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | GPU - Intel HD Graphics 620 | FP32 | 32 | 1 | 90th | 611.8 | 53.5 | 2019-02-26 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 32 | 1 | 90th | 617.7 | 55.5 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | 90th | 18.7 | 55.7 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 2 | 1 | 90th | 36.1 | 56.4 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 4 | 1 | 90th | 74.5 | 55.4 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 8 | 1 | 90th | 154.5 | 55.9 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | 90th | 309.2 | 56.0 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 64 | 1 | 90th | 1193.2 | 56.0 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 128 | 1 | 90th | 2414.5 | 56.2 | 2019-03-01 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | GPU - Intel HD Graphics 620 | FP32 | 1 | 1 | 90th | 23.0 | 45.5 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | GPU - Intel HD Graphics 620 | FP32 | 2 | 1 | 90th | 38.5 | 54.5 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | GPU - Intel HD Graphics 620 | FP32 | 4 | 1 | 90th | 73.4 | 56.4 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | GPU - Intel HD Graphics 620 | FP32 | 8 | 1 | 90th | 147.3 | 56.3 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | GPU - Intel HD Graphics 620 | FP32 | 16 | 1 | 90th | 306.8 | 53.5 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | GPU - Intel HD Graphics 620 | FP32 | 64 | 1 | 90th | 1230.7 | 53.2 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | OpenVINO | SSD-MobileNet | GPU - Intel HD Graphics 620 | FP32 | 128 | 1 | 90th | 2475.3 | 53.0 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 1 | 1 | 90th | 85.2 | 12.0 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 2 | 1 | 90th | 169.1 | 11.9 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 4 | 1 | 90th | 335.1 | 12.3 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 8 | 1 | 90th | 631.9 | 12.7 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 16 | 1 | 90th | 1296.8 | 12.6 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 32 | 1 | 90th | 2715.0 | 12.2 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 64 | 1 | 90th | 5534.7 | 12.0 | 2019-03-04 | PT |
| Laptop | Intel Core i7-7600U @ 2.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 128 | 1 | 90th | 11036.7 | 11.9 | 2019-03-04 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | 90th | 6.4 | 158.8 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 2 | 1 | 90th | 12.6 | 160.0 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 4 | 1 | 90th | 26.8 | 149.1 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 8 | 1 | 90th | 54.4 | 147.3 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | 90th | 108.1 | 147.9 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 32 | 1 | 90th | 215.0 | 149.2 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 64 | 1 | 90th | 430.2 | 149.0 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 1 | 1 | 90th | 37.7 | 27.1 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 2 | 1 | 90th | 69.8 | 29.2 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 4 | 1 | 90th | 134.1 | 30.3 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 8 | 1 | 90th | 266.2 | 30.6 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 32 | 1 | 90th | 1096.0 | 29.4 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 64 | 1 | 90th | 2250.8 | 28.6 | 2019-03-01 | PT |
| Desktop | Intel Core i5-7600K @ 3.80 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 128 | 1 | 90th | 4530.9 | 28.3 | 2019-03-01 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | 90th | 2.9 | 352.7 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 2 | 1 | 90th | 5.1 | 396.3 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 4 | 1 | 90th | 7.5 | 536.2 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 8 | 1 | 90th | 14.6 | 550.5 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | 90th | 37.0 | 434.3 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 32 | 1 | 90th | 77.8 | 413.4 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 64 | 1 | 90th | 156.1 | 411.3 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 128 | 1 | 90th | 307.1 | 416.5 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 1 | 1 | 90th | 45.4 | 22.5 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 2 | 1 | 90th | 60.7 | 34.7 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 4 | 1 | 90th | 73.5 | 61.3 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 8 | 1 | 90th | 128.1 | 65.0 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 16 | 1 | 90th | 270.5 | 61.1 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 32 | 1 | 90th | 570.9 | 58.6 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 64 | 1 | 90th | 1475.1 | 48.1 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 128 | 1 | 90th | 2990.3 | 45.6 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 1 | 1 | 90th | 86.9 | 11.8 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 2 | 1 | 90th | 161.2 | 12.6 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 4 | 1 | 90th | 311.3 | 13.0 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 8 | 1 | 90th | 593.7 | 13.6 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 16 | 1 | 90th | 1171.1 | 13.8 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 32 | 1 | 90th | 2421.9 | 13.5 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 64 | 1 | 90th | 4741.6 | 13.7 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 128 | 1 | 90th | 9669.0 | 13.5 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 1 | 1 | 90th | 20.9 | 50.3 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 2 | 1 | 90th | 37.5 | 55.3 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 4 | 1 | 90th | 69.7 | 59.1 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 8 | 1 | 90th | 135.5 | 61.1 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 16 | 1 | 90th | 268.6 | 60.6 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 32 | 1 | 90th | 533.5 | 61.0 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 64 | 1 | 90th | 1054.2 | 61.6 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 128 | 1 | 90th | 2100.8 | 61.8 | 2019-03-29 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | 90th | 3.2 | 318.1 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 2 | 1 | 90th | 5.1 | 400.4 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 4 | 1 | 90th | 9.8 | 413.1 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 8 | 1 | 90th | 23.8 | 337.7 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | 90th | 49.2 | 322.9 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 32 | 1 | 90th | 100.2 | 321.0 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 64 | 1 | 90th | 199.7 | 321.5 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 128 | 1 | 90th | 396.1 | 328.7 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 1 | 1 | 90th | 23.2 | 45.3 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 2 | 1 | 90th | 34.4 | 60.1 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 4 | 1 | 90th | 58.4 | 69.2 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 8 | 1 | 90th | 112.4 | 71.6 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 16 | 1 | 90th | 236.7 | 68.3 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 32 | 1 | 90th | 493.0 | 65.8 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 64 | 1 | 90th | 1073.8 | 60.4 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | CPU | FP32 | 128 | 1 | 90th | 2190.5 | 58.9 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 1 | 1 | 90th | 83.3 | 12.2 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 2 | 1 | 90th | 155.5 | 13.1 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 4 | 1 | 90th | 305.8 | 13.2 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 8 | 1 | 90th | 578.2 | 13.9 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 16 | 1 | 90th | 1151.8 | 14.0 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 32 | 1 | 90th | 2319.6 | 13.8 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 64 | 1 | 90th | 4430.6 | 14.5 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 128 | 1 | 90th | 9042.8 | 14.2 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 1 | 1 | 90th | 19.6 | 52.5 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 2 | 1 | 90th | 34.4 | 60.0 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 4 | 1 | 90th | 67.6 | 60.8 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 8 | 1 | 90th | 131.1 | 62.8 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 16 | 1 | 90th | 257.1 | 63.3 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 32 | 1 | 90th | 510.3 | 63.4 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 64 | 1 | 90th | 994.2 | 65.1 | 2019-04-15 | PT |
| Desktop | Intel Core i9-9900X @ 3.50 GHz | TensorFlow-TensorRT | SSD-MobileNet | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 128 | 1 | 90th | 1998.7 | 64.6 | 2019-04-15 | PT |
| Desktop | AMD Ryzen 9 3900X @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 274.2 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700X @ 3.60 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 230.4 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700X @ 3.60 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 161.3 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 2700X | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 150.6 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 2700X | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 123.4 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i9-9900K | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 233.2 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i9-9900K | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 162.4 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i7-8700K | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 197.6 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i7-8700K | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 190.1 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i5-8400 | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 198.1 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i5-8400 | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 153.8 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i5-8400 | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 278.8 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i5-8400 | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 236.2 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i7-8700K | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 224.0 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i7-8700K | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 304.0 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i9-9900K | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 389.3 | 2019-08-12 | Legit Reviews |
| Desktop | Intel Core i9-9900K | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 264.1 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 2700X | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 140.0 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 2700X | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 144.5 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700X @ 3.60 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 129.8 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700X @ 3.60 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 106.2 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 9 3900X @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 150.2 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 9 3900X @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 133.9 | 2019-08-12 | Legit Reviews |
| Desktop | AMD Ryzen 9 3900X @ 3.80 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 170.9 | 2019-08-12 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 4 | 1 | Unknown | N/A | 151.7 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 143.1 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 4 | 1 | Unknown | N/A | 128.6 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 142.9 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-8565U | OpenVINO | SSD-MobileNet | CPU | FP32 | 4 | 1 | Unknown | N/A | 105.8 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-8565U | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 105.5 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 4 | 1 | Unknown | N/A | 333.2 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 319.8 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 4 | 1 | Unknown | N/A | 333.8 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 321.5 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-8565U | OpenVINO | SSD-MobileNet | CPU | INT8 | 4 | 1 | Unknown | N/A | 124.4 | 2019-08-14 | Legit Reviews |
| Laptop | Intel Core i7-8565U | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 146.5 | 2019-08-14 | Legit Reviews |
| Desktop | AMD Ryzen 7 3700U | OpenVINO | SSD-MobileNet | CPU | FP32 | Unknown | 1 | 90th | 15.78 | 67.75 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | Unknown | 1 | 90th | 7.14 | 148.21 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | FP32 | Unknown | 1 | 90th | 7.17 | 148.09 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-1065G7 (15W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | Unknown | 1 | 90th | 3.15 | 350.24 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-1065G7 (25W) @ 3.50 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | Unknown | 1 | 90th | 3.13 | 350.11 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-8565U | OpenVINO | SSD-MobileNet | CPU | INT8 | Unknown | 1 | 90th | 7.32 | 138.99 | 2019-08-19 | HotHardware |
| Laptop | Intel Core i7-8565U | OpenVINO | SSD-MobileNet | CPU | FP32 | Unknown | 1 | 90th | 10.27 | 107.38 | 2019-08-19 | HotHardware |
| Desktop | AMD Ryzen 7 3700U | OpenVINO | SSD-MobileNet | CPU | INT8 | Unknown | 1 | 90th | 14.57 | 70.76 | 2019-08-19 | HotHardware |
| Desktop | AMD Ryzen 5 3600X | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 202.0 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 3600X | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 137.1 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 3600X | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 99.1 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 3600X | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 70.8 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 2600X | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 126.8 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 2600X | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 110.6 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 2600X | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 120.8 | 2019-08-23 | Legit Reviews |
| Desktop | AMD Ryzen 5 2600X | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 111.5 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9600K | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 208.1 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9600K | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 214.9 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9600K | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 252.7 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9600K | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 289.9 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9400F | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 192.8 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9400F | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 211.8 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9400F | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 235.2 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i5-9400F | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 282.8 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i3-9100 | OpenVINO | SSD-MobileNet | CPU | FP32 | 16 | 1 | Unknown | N/A | 160.8 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i3-9100 | OpenVINO | SSD-MobileNet | CPU | FP32 | 1 | 1 | Unknown | N/A | 162.3 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i3-9100 | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | Unknown | N/A | 195.9 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i3-9100 | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | Unknown | N/A | 207.4 | 2019-08-23 | Legit Reviews |
| Desktop | Intel Core i9-10980XE | OpenVINO | SSD-MobileNet | CPU | Unknown | Unknown | 1 | Unknown | Unknown | 1,167.0 | 2020-02-12 | Ars Technica |
| Desktop | AMD Threadripper 3970X | OpenVINO | SSD-MobileNet | CPU | Unknown | Unknown | 1 | Unknown | Unknown | 570.0 | 2020-02-12 | Ars Technica |
| Desktop | Intel Core i9-9980XE | OpenVINO | SSD-MobileNet | CPU | Unknown | Unknown | 1 | Unknown | Unknown | 551.0 | 2020-02-12 | Ars Technica |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | 90th | 4.05 | 335.33 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 2 | 1 | 90th | 6.33 | 376.45 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 4 | 1 | 90th | 11.61 | 375.32 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 8 | 1 | 90th | 24.55 | 354.26 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | 90th | 50.94 | 348.99 | 2020-06-26 | PT |
| Desktop | Intel Core i9-9900 @ 3.10 GHz | OpenVINO | SSD-MobileNet | CPU | INT8 | 32 | 1 | 90th | 112.02 | 324.81 | 2020-06-26 | PT |
| Desktop | Intel Core i7-10875H | OpenVINO | SSD-MobileNet | CPU | INT8 | 32 | 1 | 90% | 89.4 | 375.04 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | 90% | 44.0 | 376.44 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | SSD-MobileNet | CPU | INT8 | 8 | 1 | 90% | 22.8 | 364.02 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | SSD-MobileNet | CPU | INT8 | 4 | 1 | 90% | 11.8 | 348.15 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | SSD-MobileNet | CPU | INT8 | 2 | 1 | 90% | 6.6 | 314.88 | 2020-08-14 | SMZDM (China) |
| Desktop | Intel Core i7-10875H | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | 90% | 4.1 | 251.87 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | SSD-MobileNet | CPU | INT8 | 1 | 1 | 90% | 5.31 | 190.36 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | SSD-MobileNet | CPU | INT8 | 2 | 1 | 90% | 8.15 | 248.67 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | SSD-MobileNet | CPU | INT8 | 4 | 1 | 90% | 14.61 | 278.00 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | SSD-MobileNet | CPU | INT8 | 8 | 1 | 90% | 27.10 | 299.16 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | SSD-MobileNet | CPU | INT8 | 16 | 1 | 90% | 53.22 | 304.58 | 2020-08-14 | SMZDM (China) |
| Desktop | AMD Ryzen 9 4900H | OpenVINO | SSD-MobileNet | CPU | INT8 | 32 | 1 | 90% | 105.04 | 307.59 | 2020-08-14 | SMZDM (China) |
Type |
Processor |
Framework |
Network |
Target HW |
Precision |
Batch size |
Concurrent instances |
Latency percentile |
Latency (ms) |
Throughput (images/sec) |
Date |
Source |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | MXNet | Wide and Deep | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 256 | 1 | 90th | 2.85 | 127843.23 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | MXNet | Wide and Deep | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 512 | 1 | 90th | 2.99 | 244493.79 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | MXNet | Wide and Deep | GPU - Gigabyte GeForce GTX 1080Ti 11G | FP32 | 1024 | 1 | 90th | 3.24 | 350197.03 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | MXNet | Wide and Deep | CPU | FP32 | 256 | 1 | 90th | 3.85 | 65801.14 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | MXNet | Wide and Deep | CPU | FP32 | 512 | 1 | 90th | 6.64 | 76365.04 | 2019-03-26 | PT |
| Desktop | Intel Core i9-9980XE @ 3.00 GHz | MXNet | Wide and Deep | CPU | FP32 | 1024 | 1 | 90th | 12.21 | 84192.41 | 2019-03-26 | PT |
