7F72 2P ONNX Runtime

2 x AMD EPYC 7F72 24-Core testing with a Supermicro H11DSi-NT v2.00 (2.1 BIOS) and llvmpipe on Ubuntu 20.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2101173-HA-7F722PONN31
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
January 17 2021
  1 Hour, 31 Minutes
2
January 17 2021
  1 Hour, 1 Minute
Invert Hiding All Results Option
  1 Hour, 16 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

{ "title": "7F72 2P ONNX Runtime", "last_modified": "2021-01-17 16:16:54", "description": "2 x AMD EPYC 7F72 24-Core testing with a Supermicro H11DSi-NT v2.00 (2.1 BIOS) and llvmpipe on Ubuntu 20.10 via the Phoronix Test Suite.", "systems": { "1": { "identifier": "1", "hardware": { "Processor": "2 x AMD EPYC 7F72 24-Core @ 3.20GHz (48 Cores \/ 96 Threads)", "Motherboard": "Supermicro H11DSi-NT v2.00 (2.1 BIOS)", "Chipset": "AMD Starship\/Matisse", "Memory": "126GB", "Disk": "1000GB Western Digital WD_BLACK SN850 1TB", "Graphics": "llvmpipe", "Monitor": "VE228", "Network": "2 x Intel 10G X550T" }, "software": { "OS": "Ubuntu 20.10", "Kernel": "5.11.0-rc2-phx (x86_64) 20210108", "Desktop": "GNOME Shell 3.38.1", "Display Server": "X Server 1.20.9", "Display Driver": "modesetting 1.20.9", "OpenGL": "4.5 Mesa 20.2.1 (LLVM 11.0.0 256 bits)", "Compiler": "GCC 10.2.0", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "phoronix", "timestamp": "2021-01-17 13:28:11", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-10-JvwpWM\/gcc-10-10.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-10-JvwpWM\/gcc-10-10.2.0\/debian\/tmp-gcn\/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "acpi-cpufreq schedutil (Boost: Enabled)", "cpu-microcode": "0x8301034", "python": "Python 3.8.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected" } }, "2": { "identifier": "2", "hardware": { "Processor": "2 x AMD EPYC 7F72 24-Core @ 3.20GHz (48 Cores \/ 96 Threads)", "Motherboard": "Supermicro H11DSi-NT v2.00 (2.1 BIOS)", "Chipset": "AMD Starship\/Matisse", "Memory": "126GB", "Disk": "1000GB Western Digital WD_BLACK SN850 1TB", "Graphics": "llvmpipe", "Monitor": "VE228", "Network": "2 x Intel 10G X550T" }, "software": { "OS": "Ubuntu 20.10", "Kernel": "5.11.0-rc2-phx (x86_64) 20210108", "Desktop": "GNOME Shell 3.38.1", "Display Server": "X Server 1.20.9", "Display Driver": "modesetting 1.20.9", "OpenGL": "4.5 Mesa 20.2.1 (LLVM 11.0.0 256 bits)", "Compiler": "GCC 10.2.0", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "phoronix", "timestamp": "2021-01-17 15:02:36", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-10-JvwpWM\/gcc-10-10.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-10-JvwpWM\/gcc-10-10.2.0\/debian\/tmp-gcn\/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "acpi-cpufreq schedutil (Boost: Enabled)", "cpu-microcode": "0x8301034", "python": "Python 3.8.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "3f18709d3c7f9e803cb87cc6ad8d233a2da996e4": { "identifier": "pts\/onnx-1.0.1", "title": "ONNX Runtime", "app_version": "1.6", "arguments": "yolov4\/yolov4.onnx -e cpu", "description": "Model: yolov4 - Device: OpenMP CPU", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "1": { "value": 190, "raw_values": [ 192, 188, 188.5 ], "test_run_times": [ 121.06999999999999317878973670303821563720703125, 121.099999999999994315658113919198513031005859375, 121.150000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt" } } }, "2": { "value": 187, "raw_values": [ 185, 189.5, 185.5 ], "test_run_times": [ 121.0799999999999982946974341757595539093017578125, 120.9800000000000039790393202565610408782958984375, 121.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt" } } } } }, "7300bbd52287628b003abce3412a8be8298a22e2": { "identifier": "pts\/onnx-1.0.1", "title": "ONNX Runtime", "app_version": "1.6", "arguments": "download_sample_10\/bertsquad10.onnx -e cpu", "description": "Model: bertsquad-10 - Device: OpenMP CPU", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "1": { "value": 248, "raw_values": [ 240, 200.5, 217.5, 208, 254.5, 305, 259, 316.5, 230 ], "test_run_times": [ 121.25, 121.8299999999999982946974341757595539093017578125, 128.460000000000007958078640513122081756591796875, 120.9800000000000039790393202565610408782958984375, 121.2000000000000028421709430404007434844970703125, 120.9899999999999948840923025272786617279052734375, 120.9800000000000039790393202565610408782958984375, 121.219999999999998863131622783839702606201171875, 121.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt" } } }, "2": { "value": 247, "raw_values": [ 275, 208.5, 341, 271.5, 232.5, 247, 283.5, 205, 230, 247.5, 215, 206.5 ], "test_run_times": [ 121.0799999999999982946974341757595539093017578125, 121.0400000000000062527760746888816356658935546875, 121.06000000000000227373675443232059478759765625, 120.9800000000000039790393202565610408782958984375, 121.1400000000000005684341886080801486968994140625, 121.1299999999999954525264911353588104248046875, 121.2099999999999937472239253111183643341064453125, 121.0400000000000062527760746888816356658935546875, 120.9500000000000028421709430404007434844970703125, 121.06000000000000227373675443232059478759765625, 120.9800000000000039790393202565610408782958984375, 121.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt" } } } } }, "a375f09e6b4be03b4dc0f75c5c5205d94090751a": { "identifier": "pts\/onnx-1.0.1", "title": "ONNX Runtime", "app_version": "1.6", "arguments": "fcn-resnet101-11\/model.onnx -e cpu", "description": "Model: fcn-resnet101-11 - Device: OpenMP CPU", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "1": { "value": 54, "raw_values": [ 52.5, 52, 59, 55.5, 51.5, 57, 54.5, 53.5, 53.5, 58, 52.5, 53 ], "test_run_times": [ 122.25, 122.400000000000005684341886080801486968994140625, 121.9500000000000028421709430404007434844970703125, 122.2000000000000028421709430404007434844970703125, 121.840000000000003410605131648480892181396484375, 122.1299999999999954525264911353588104248046875, 122.5499999999999971578290569595992565155029296875, 121.7900000000000062527760746888816356658935546875, 121.6400000000000005684341886080801486968994140625, 122.219999999999998863131622783839702606201171875, 122.18000000000000682121026329696178436279296875, 122.340000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt" } } }, "2": { "value": 53, "raw_values": [ 54, 53, 51.5 ], "test_run_times": [ 122.0400000000000062527760746888816356658935546875, 123.0799999999999982946974341757595539093017578125, 121.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt" } } } } }, "38b72f29b34da291e48524d235cb5fcec03555cf": { "identifier": "pts\/onnx-1.0.1", "title": "ONNX Runtime", "app_version": "1.6", "arguments": "model\/test_shufflenetv2\/model.onnx -e cpu", "description": "Model: shufflenet-v2-10 - Device: OpenMP CPU", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "1": { "value": 3716, "raw_values": [ 6043, 6083.5, 3799.5, 3882.5, 2465.5, 3076, 2557.5, 2619.5, 2913.5 ], "test_run_times": [ 120.099999999999994315658113919198513031005859375, 120.090000000000003410605131648480892181396484375, 120.090000000000003410605131648480892181396484375, 120.1099999999999994315658113919198513031005859375, 120.099999999999994315658113919198513031005859375, 120.150000000000005684341886080801486968994140625, 120.1099999999999994315658113919198513031005859375, 120.1099999999999994315658113919198513031005859375, 120.18000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt" } } }, "2": { "value": 4423, "raw_values": [ 4460.5, 6582, 5500, 3715.5, 5538.5, 3089.5, 4352, 5202, 3574.5, 2974, 2985, 5105.5 ], "test_run_times": [ 120.090000000000003410605131648480892181396484375, 120.090000000000003410605131648480892181396484375, 120.090000000000003410605131648480892181396484375, 120.099999999999994315658113919198513031005859375, 120.090000000000003410605131648480892181396484375, 120.099999999999994315658113919198513031005859375, 120.090000000000003410605131648480892181396484375, 120.090000000000003410605131648480892181396484375, 120.159999999999996589394868351519107818603515625, 120.090000000000003410605131648480892181396484375, 120.090000000000003410605131648480892181396484375, 120.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt" } } } } }, "f3a32663f6a18da5a42e44f97308413c7d4cd0da": { "identifier": "pts\/onnx-1.0.1", "title": "ONNX Runtime", "app_version": "1.6", "arguments": "super_resolution\/super_resolution.onnx -e cpu", "description": "Model: super-resolution-10 - Device: OpenMP CPU", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "1": { "value": 3935, "raw_values": [ 3731, 3643, 4244, 4318.5, 3617, 3949, 4032.5, 4167.5, 3846, 4201.5, 3638, 3835 ], "test_run_times": [ 120.099999999999994315658113919198513031005859375, 120.06000000000000227373675443232059478759765625, 120.06000000000000227373675443232059478759765625, 120.06000000000000227373675443232059478759765625, 120.06000000000000227373675443232059478759765625, 120.06999999999999317878973670303821563720703125, 120.06000000000000227373675443232059478759765625, 120.06999999999999317878973670303821563720703125, 120.090000000000003410605131648480892181396484375, 120.06999999999999317878973670303821563720703125, 120.090000000000003410605131648480892181396484375, 120.06000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt" } } } } } } }