Please download summary.xlsx to view the most recent results.
[2024-12-28 22:32:02,079 submission_checker.py:3167 INFO] Results=43, NoResults=0, Power Results=0
[2024-12-28 22:32:02,079 submission_checker.py:3174 INFO] ---
[2024-12-28 22:32:02,079 submission_checker.py:3175 INFO] Closed Results=8, Closed Power Results=0
[2024-12-28 22:32:02,079 submission_checker.py:3180 INFO] Open Results=35, Open Power Results=0
[2024-12-28 22:32:02,079 submission_checker.py:3185 INFO] Network Results=0, Network Power Results=0
[2024-12-28 22:32:02,079 submission_checker.py:3190 INFO] ---
[2024-12-28 22:32:02,079 submission_checker.py:3192 INFO] Systems=2, Power Systems=0
[2024-12-28 22:32:02,079 submission_checker.py:3196 INFO] Closed Systems=1, Closed Power Systems=0
[2024-12-28 22:32:02,079 submission_checker.py:3201 INFO] Open Systems=2, Open Power Systems=0
[2024-12-28 22:32:02,079 submission_checker.py:3206 INFO] Network Systems=0, Network Power Systems=0
[2024-12-28 22:32:02,079 submission_checker.py:3211 INFO] ---
[2024-12-28 22:32:02,079 submission_checker.py:3216 INFO] SUMMARY: submission looks OK
INFO:root: ! call "postprocess" from /home/runner/CM/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-submission-checker/customize.py
| Organization | Availability | Division | SystemType | SystemName | Platform | Model | MlperfModel | Scenario | Result | Accuracy | number_of_nodes | host_processor_model_name | host_processors_per_node | host_processor_core_count | accelerator_model_name | accelerators_per_node | Location | framework | operating_system | notes | compliance | errors | version | inferred | has_power | Units | weight_data_types | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | MultiStream | 5.61386 | mAP: 37.324 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/multistream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 1 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | Server | 1414.99 | mAP: 37.349 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/server | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Queries/s | int8 |
| 2 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | SingleStream | 1.73189 | mAP: 37.331 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 3 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | Offline | 1737.71 | mAP: 37.333 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 4 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | MultiStream | 0.501344 | acc: 76.064 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/multistream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 5 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | Server | 73744 | acc: 76.078 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/server | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Queries/s | int8 |
| 6 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | SingleStream | 0.305538 | acc: 76.064 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 7 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | Offline | 88119.5 | acc: 76.078 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 8 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99.9 | bert-99.9 | SingleStream | 2.17173 | F1: 90.88109554940347 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99.9/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | fp16 |
| 9 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99.9 | bert-99.9 | Offline | 3360.15 | F1: 90.8832407068292 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99.9/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp16 |
| 10 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | 3d-unet-99.9 | 3d-unet-99.9 | SingleStream | 429.34 | DICE: 0.86236 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 11 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | 3d-unet-99.9 | 3d-unet-99.9 | Offline | 8.30473 | DICE: 0.86236 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 12 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99 | bert-99 | SingleStream | 1.03202 | F1: 90.26682135974633 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 13 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99 | bert-99 | Offline | 8277.86 | F1: 90.15673510616978 | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 14 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | stable-diffusion-xl | stable-diffusion-xl | Server | 0.881818 | nan | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/stable-diffusion-xl/server | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Queries/s | int8 |
| 15 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | stable-diffusion-xl | stable-diffusion-xl | SingleStream | 1400.03 | nan | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/stable-diffusion-xl/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 16 | MLCommons | available | open | datacenter,edge | RTX4090x2 | RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config | stable-diffusion-xl | stable-diffusion-xl | Offline | 1.39663 | nan | 1 | Intel(R) Xeon(R) w7-2495X | 1 | 24 | NVIDIA GeForce RTX 4090 | 2 | open/MLCommons/results/RTX4090x2-nvidia_original-gpu-tensorrt-vdefault-default_config/stable-diffusion-xl/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 17 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | MultiStream | 11.6143 | mAP: 37.317 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/multistream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 18 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | Server | 637.175 | mAP: 37.322 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/server | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Queries/s | int8 |
| 19 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | SingleStream | 1.7078 | mAP: 37.342 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 20 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | Offline | 868.196 | mAP: 37.350 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 21 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | MultiStream | 0.457694 | acc: 76.064 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/multistream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 22 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | Server | 35357.8 | acc: 76.078 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/server | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Queries/s | int8 |
| 23 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | SingleStream | 0.282518 | acc: 76.064 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 24 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | Offline | 44354.9 | acc: 76.078 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 25 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99.9 | bert-99.9 | Server | 1414.95 | F1: 90.89127264236201 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99.9/server | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Queries/s | fp16 |
| 26 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99.9 | bert-99.9 | SingleStream | 2.16735 | F1: 90.88109554940347 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99.9/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | fp16 |
| 27 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99.9 | bert-99.9 | Offline | 1675.11 | F1: 90.8832407068292 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99.9/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | fp16 |
| 28 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | 3d-unet-99.9 | 3d-unet-99.9 | SingleStream | 497.76 | DICE: 0.86236 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 29 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | 3d-unet-99.9 | 3d-unet-99.9 | Offline | 3.45061 | DICE: 0.86236 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/3d-unet-99.9/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 30 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99 | bert-99 | Server | 3841.13 | F1: 90.25897829249658 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99/server | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Queries/s | int8 |
| 31 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99 | bert-99 | SingleStream | 1.01571 | F1: 90.26682135974633 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 32 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | bert-99 | bert-99 | Offline | 4125.31 | F1: 90.15673510616978 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/bert-99/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 33 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | stable-diffusion-xl | stable-diffusion-xl | SingleStream | 1423.64 | nan | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/stable-diffusion-xl/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 34 | MLCommons | available | open | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | stable-diffusion-xl | stable-diffusion-xl | Offline | 0.697572 | nan | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | open/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/stable-diffusion-xl/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 35 | MLCommons | available | closed | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | MultiStream | 10.8705 | mAP: 37.341 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | closed/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/multistream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 36 | MLCommons | available | closed | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | Server | 637.174 | mAP: 37.355 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | closed/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/server | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Queries/s | int8 |
| 37 | MLCommons | available | closed | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | SingleStream | 1.75073 | mAP: 37.331 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | closed/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 38 | MLCommons | available | closed | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | retinanet | retinanet | Offline | 863.003 | mAP: 37.376 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | closed/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/retinanet/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |
| 39 | MLCommons | available | closed | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | MultiStream | 0.473275 | acc: 76.064 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | closed/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/multistream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 40 | MLCommons | available | closed | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | Server | 35357.7 | acc: 76.078 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | closed/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/server | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Queries/s | int8 |
| 41 | MLCommons | available | closed | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | SingleStream | 0.276862 | acc: 76.064 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | closed/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/singlestream | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Latency (ms) | int8 |
| 42 | MLCommons | available | closed | datacenter,edge | RTX4090x1 | RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config | resnet50 | resnet | Offline | 43782.5 | acc: 76.078 | 1 | 13th Gen Intel(R) Core(TM) i9-13900K | 1 | 24 | NVIDIA GeForce RTX 4090 | 1 | closed/MLCommons/results/RTX4090x1-nvidia_original-gpu-tensorrt-vdefault-default_config/resnet50/offline | TensorRT | Ubuntu 20.04 (linux-6.8.0-49-generic-glibc2.31) | nan | 1 | 0 | v5.0 | 0 | False | Samples/s | int8 |