Intel Xeon Max Linux Kernels

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2310079-NE-XEONMAXLI86&gru.

Intel Xeon Max Linux KernelsProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolutionv6.4v6.5v6.6 6 Oct2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)Supermicro X13DEM v1.10 (1.3 BIOS)Intel Device 1bce512GB2 x 7682GB INTEL SSDPF2KX076TZASPEEDVE2282 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200GbUbuntu 23.046.4.0-060400-generic (x86_64)GNOME Shell 44.0X Server 1.21.1.7GCC 12.2.0ext41920x10806.5.0-060500-generic (x86_64)1024x7686.6.0-060600rc4daily20231006-generic (x86_64)1920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c0001d1Java Details- OpenJDK Runtime Environment (build 17.0.6+10-Ubuntu-1ubuntu2)Python Details- Python 3.11.2Security Details- v6.4: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - v6.5: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - v6.6 6 Oct: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Intel Xeon Max Linux Kernelsstress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pipestress-ng: Zlibstress-ng: Mutexstress-ng: Mallocstress-ng: Pthreadstress-ng: AVL Treestress-ng: IO_uringstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: AVX-512 VNNIstress-ng: Function Callstress-ng: x86_64 RdRandstress-ng: Floating Pointstress-ng: Matrix 3D Mathstress-ng: Memory Copyingstress-ng: Vector Shufflestress-ng: Wide Vector Mathstress-ng: Fused Multiply-Addstress-ng: Vector Floating Pointstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingnekrs: Kershawnekrs: TurboPipe Periodicopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUaom-av1: Speed 0 Two-Pass - Bosphorus 4Kaom-av1: Speed 4 Two-Pass - Bosphorus 4Kaom-av1: Speed 6 Realtime - Bosphorus 4Kaom-av1: Speed 6 Two-Pass - Bosphorus 4Kaom-av1: Speed 8 Realtime - Bosphorus 4Kaom-av1: Speed 9 Realtime - Bosphorus 4Kaom-av1: Speed 10 Realtime - Bosphorus 4Kaom-av1: Speed 11 Realtime - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastvvenc: Bosphorus 1080p - Fasterhpcg: 104 104 104 - 60hpcg: 144 144 144 - 60tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 256 - ResNet-50cryptopp: Keyed Algorithmscryptopp: Unkeyed Algorithmscompress-7zip: Compression Ratingcompress-7zip: Decompression Ratinghadoop: Open - 50 - 100000hadoop: Open - 100 - 100000hadoop: Open - 500 - 100000hadoop: Delete - 50 - 100000hadoop: Open - 1000 - 100000hadoop: Create - 50 - 1000000memtier-benchmark: Redis - 50 - 1:5memtier-benchmark: Redis - 100 - 1:10apache-iotdb: 100 - 100 - 500 - 100apache-iotdb: 100 - 100 - 800 - 100apache-iotdb: 200 - 100 - 200 - 100apache-iotdb: 200 - 100 - 500 - 100apache-iotdb: 200 - 100 - 800 - 100apache-iotdb: 500 - 100 - 200 - 100apache-iotdb: 500 - 100 - 200 - 400apache-iotdb: 500 - 100 - 500 - 100apache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 500 - 100 - 800 - 100apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 200 - 100apache-iotdb: 800 - 100 - 200 - 400apache-iotdb: 800 - 100 - 500 - 100apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 800 - 100npb: BT.Cnpb: CG.Cnpb: EP.Cnpb: FT.Cnpb: LU.Cnpb: MG.Cnpb: SP.Bnpb: SP.Cpgbench: 100 - 1000 - Read Onlypgbench: 100 - 800 - Read Writepgbench: 1000 - 800 - Read Onlypgbench: 100 - 1000 - Read Writepgbench: 1000 - 1000 - Read Onlypgbench: 1000 - 800 - Read Writepgbench: 1000 - 1000 - Read Writeapache-iotdb: 100 - 100 - 800 - 100apache-iotdb: 200 - 100 - 200 - 100apache-iotdb: 200 - 100 - 500 - 100apache-iotdb: 200 - 100 - 800 - 100apache-iotdb: 500 - 100 - 200 - 100apache-iotdb: 500 - 100 - 200 - 400apache-iotdb: 500 - 100 - 500 - 100apache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 500 - 100 - 800 - 100apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 200 - 100apache-iotdb: 800 - 100 - 200 - 400apache-iotdb: 800 - 100 - 500 - 100apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 800 - 100apache-iotdb: 100 - 100 - 500 - 100pgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 800 - Read Write - Average Latencypgbench: 1000 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Write - Average Latencypgbench: 1000 - 1000 - Read Only - Average Latencypgbench: 1000 - 800 - Read Write - Average Latencypgbench: 1000 - 1000 - Read Write - Average Latencyopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUrodinia: OpenMP LavaMDrodinia: OpenMP HotSpot3Drodinia: OpenMP Leukocyterodinia: OpenMP CFD Solverrodinia: OpenMP Streamclusteropenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Bumper Beamopenradioss: Chrysler Neon 1Mopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containeravifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessavifenc: 10, Losslessbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-llvm: Ninjabuild-llvm: Unix Makefilesblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyv6.4v6.5v6.6 6 Oct17389901.327996.78514.0931203885.988220.8323140484.14217211109.0336288.24790.232619140.96938764.06200494.80177471711.51396715.18381412.8211752668.1863249.99637179.5231253.9328901.0225816.50551599.325961543.12253366692.27244931.4181547074.591875.8318811154.4058659833334098953333125.69474.05475.662572.63331.2011342.541112.465018.0316690.3616182.551503.54667.6425464.626316.443597.6574954.032452.14112475.340.397.0741.5114.3041.6747.5444.2349.094.132133.926145.91511.589426.842518.7695.0758.45016.33628.270104.67776.578536.8545.2053.0465.22604.541642441.19698928355640037029415026903426565260316274610372542331936.552262895.8630189985391220532458294143036898525140084167526540520901593769565809660067045377660989425124829950423542662879066578447872605513322119.9951894.8510844.90103248.13269542.21239408.11176009.15193221.9564023545581701213429477100792041619884155.2270.7797.16125.9542.68163.3677.00265.99111.75370.8235.31140.4069.88277.40104.931.57017.5561.14123.2961.41139.24550.358293.677.9777.7014.35337.229.8533.2122.286.606.8974.4055.314.2317.7031.100.5745.630.3435.24380.64434.1738.71342.60539.35959437.840712175.9258195.8876495.17128.5032.37159.21116.35138.9770.73539.3713.7286.8925.07537.316288.412187.322275.08521.4853.1440.12315.0274.8816889506.128195.87575.3738337996.378330.2225266270.16219735444.0538759.74794.302557131.35827481.85198750.35154525821.93349646.89359634.3511016794.4161230.89648063.9129342.6732314.9325493.26549410.105808342.74243730838.96240694.1677642781.171916.2019106643.9958092200004101490000159.00553.15551.662896.61327.6811013.291155.645018.0717909.2816152.101498.56639.0829736.316234.833572.8994168.282445.54111886.460.397.7242.4214.0942.3845.1451.6045.454.016114.318112.25811.102406.640459.2925.1758.50016.28228.717102.19473.732738.2246.4151.4265.91604.262966440.62284627913538673126981026296925464056625238253376172128295.602068343.1030632905385398492482527242147671525198984215036842201696596798785955284767023750673943235118839851104786665589066607883570592527306002.2052032.1010479.79112362.39268492.02234268.14178582.58190905.8270083643765729184423407144842136719709156.0669.6599.71127.6742.19152.9576.54266.74111.14368.1534.49139.8270.09273.92108.51127.921.45418.2821.09823.6391.40337.45150.785232.3366.8367.0112.74341.0610.1531.9822.256.216.8974.6557.843.7017.9331.320.5645.760.3435.28280.78231.4868.88645.67238.49455736.766298174.04396197.949296.05130.4333.81159.91119.47141.8570.88138.6353.6816.7665.05838.190289.545192.791274.64921.9654.0141.62336.4273.8718109792.858382.54474.3927024816.268374.5827388113.63222268148.7635491.62816.163424829.35709241.85203979.83180684828.43370932.98384963.6411946993.7065566.39642917.3031541.6630007.3325800.06562355.246205140.99261241623.38248017.7883443787.581931.8317488847.8358170966674272803333159.56564.91565.022911.44327.6111190.461159.205053.2518105.6316160.291508.77652.7729779.386265.863587.6793693.642457.57117557.360.377.1345.2712.3841.9546.0847.1848.214.120122.116116.73511.563431.133468.5685.0768.32616.40327.331101.73874.265438.0146.6351.4065.97604.369921440.91040727373140158928310427252326729958051253036359352188365.952231964.3529931254391421342483900141245153527000214256002641638681601798525683944866764218663728005070192551764919672636066599846873920159312977.3053274.7910840.56114793.58273013.53239660.40180233.00191378.8269710344504710389419616854222051019714156.1069.84102.21126.5141.71153.4975.47279.15111.92374.6035.64134.5769.65277.50102.90132.611.44617.9831.12823.8601.46039.03650.791231.4565.4365.4212.67341.199.9831.8822.106.166.8874.1356.603.6717.8331.190.5345.530.3335.06283.82832.1788.16447.37037.3535337.023041175.38684206.4271595.08129.7933.34161.95116.46138.7869.59038.6703.7566.8445.06437.808289.507191.766275.54521.1253.1140.42385.3575.58OpenBenchmarking.org

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hashv6.4v6.5v6.6 6 Oct4M8M12M16M20MSE +/- 343354.96, N = 15SE +/- 109703.46, N = 3SE +/- 232420.75, N = 317389901.3216889506.1218109792.851. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPv6.4v6.5v6.6 6 Oct2K4K6K8K10KSE +/- 47.78, N = 3SE +/- 60.98, N = 3SE +/- 76.34, N = 37996.788195.878382.541. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMAv6.4v6.5v6.6 6 Oct120240360480600SE +/- 7.82, N = 15SE +/- 2.88, N = 3SE +/- 1.03, N = 3514.09575.37474.391. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipev6.4v6.5v6.6 6 Oct8M16M24M32M40MSE +/- 487787.75, N = 15SE +/- 1055793.62, N = 15SE +/- 581009.73, N = 1531203885.9838337996.3727024816.261. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlibv6.4v6.5v6.6 6 Oct2K4K6K8K10KSE +/- 22.76, N = 3SE +/- 29.13, N = 3SE +/- 11.00, N = 38220.838330.228374.581. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutexv6.4v6.5v6.6 6 Oct6M12M18M24M30MSE +/- 381162.66, N = 15SE +/- 376350.69, N = 15SE +/- 709062.89, N = 1523140484.1425266270.1627388113.631. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mallocv6.4v6.5v6.6 6 Oct50M100M150M200M250MSE +/- 129847.43, N = 3SE +/- 655876.42, N = 3SE +/- 619909.09, N = 3217211109.03219735444.05222268148.761. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthreadv6.4v6.5v6.6 6 Oct8K16K24K32K40KSE +/- 43.26, N = 3SE +/- 820.44, N = 15SE +/- 106.91, N = 336288.2438759.7435491.621. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Treev6.4v6.5v6.6 6 Oct2004006008001000SE +/- 1.81, N = 3SE +/- 2.77, N = 3SE +/- 1.34, N = 3790.23794.30816.161. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringv6.4v6.5v6.6 6 Oct700K1400K2100K2800K3500KSE +/- 33896.79, N = 15SE +/- 24671.90, N = 15SE +/- 44896.75, N = 32619140.962557131.353424829.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cachev6.4v6.5v6.6 6 Oct200K400K600K800K1000KSE +/- 7749.59, N = 3SE +/- 4820.43, N = 3SE +/- 1835.02, N = 3938764.06827481.85709241.851. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stressv6.4v6.5v6.6 6 Oct40K80K120K160K200KSE +/- 341.26, N = 3SE +/- 1870.15, N = 13SE +/- 692.17, N = 3200494.80198750.35203979.831. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphoresv6.4v6.5v6.6 6 Oct40M80M120M160M200MSE +/- 1308655.40, N = 3SE +/- 1418717.66, N = 3SE +/- 1941141.12, N = 5177471711.51154525821.93180684828.431. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Mathv6.4v6.5v6.6 6 Oct80K160K240K320K400KSE +/- 15424.87, N = 12SE +/- 5325.22, N = 12SE +/- 6612.89, N = 15396715.18349646.89370932.981. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Mathv6.4v6.5v6.6 6 Oct80K160K240K320K400KSE +/- 3943.55, N = 5SE +/- 3836.13, N = 3SE +/- 522.79, N = 3381412.82359634.35384963.641. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: AVX-512 VNNI

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNIv6.4v6.5v6.6 6 Oct3M6M9M12M15MSE +/- 48287.23, N = 3SE +/- 137441.83, N = 3SE +/- 45820.46, N = 311752668.1811016794.4111946993.701. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Callv6.4v6.5v6.6 6 Oct14K28K42K56K70KSE +/- 811.29, N = 15SE +/- 545.69, N = 15SE +/- 112.81, N = 363249.9961230.8965566.391. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRandv6.4v6.5v6.6 6 Oct140K280K420K560K700KSE +/- 674.33, N = 3SE +/- 196.88, N = 3SE +/- 280.73, N = 3637179.52648063.91642917.301. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Pointv6.4v6.5v6.6 6 Oct7K14K21K28K35KSE +/- 348.48, N = 15SE +/- 305.43, N = 3SE +/- 238.47, N = 1031253.9329342.6731541.661. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Mathv6.4v6.5v6.6 6 Oct7K14K21K28K35KSE +/- 329.39, N = 3SE +/- 2392.89, N = 14SE +/- 48.00, N = 328901.0232314.9330007.331. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copyingv6.4v6.5v6.6 6 Oct6K12K18K24K30KSE +/- 629.40, N = 15SE +/- 228.57, N = 3SE +/- 224.34, N = 725816.5025493.2625800.061. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shufflev6.4v6.5v6.6 6 Oct120K240K360K480K600KSE +/- 1079.72, N = 3SE +/- 652.21, N = 3SE +/- 838.85, N = 3551599.32549410.10562355.241. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Mathv6.4v6.5v6.6 6 Oct1.3M2.6M3.9M5.2M6.5MSE +/- 72348.80, N = 3SE +/- 142745.75, N = 12SE +/- 3935.20, N = 35961543.125808342.746205140.991. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Addv6.4v6.5v6.6 6 Oct60M120M180M240M300MSE +/- 2984105.55, N = 15SE +/- 3180404.53, N = 3SE +/- 480576.96, N = 3253366692.27243730838.96261241623.381. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Pointv6.4v6.5v6.6 6 Oct50K100K150K200K250KSE +/- 620.60, N = 3SE +/- 1308.77, N = 3SE +/- 1538.11, N = 3244931.41240694.16248017.781. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functionsv6.4v6.5v6.6 6 Oct20M40M60M80M100MSE +/- 906580.48, N = 15SE +/- 1000931.10, N = 15SE +/- 772766.53, N = 1581547074.5977642781.1783443787.581. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sortingv6.4v6.5v6.6 6 Oct400800120016002000SE +/- 0.72, N = 3SE +/- 3.46, N = 3SE +/- 5.70, N = 31875.831916.201931.831. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passingv6.4v6.5v6.6 6 Oct4M8M12M16M20MSE +/- 54732.60, N = 3SE +/- 57359.04, N = 3SE +/- 6699.83, N = 318811154.4019106643.9917488847.831. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawv6.4v6.5v6.6 6 Oct1300M2600M3900M5200M6500MSE +/- 38898803.89, N = 3SE +/- 56766399.45, N = 6SE +/- 77700626.41, N = 35865983333580922000058170966671. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicv6.4v6.5v6.6 6 Oct900M1800M2700M3600M4500MSE +/- 40424400.36, N = 3SE +/- 30449494.25, N = 3SE +/- 4200842.51, N = 34098953333410149000042728033331. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct4080120160200SE +/- 0.59, N = 3SE +/- 0.26, N = 3SE +/- 0.46, N = 3125.69159.00159.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct120240360480600SE +/- 5.93, N = 3SE +/- 0.50, N = 3SE +/- 0.67, N = 3474.05553.15564.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUv6.4v6.5v6.6 6 Oct120240360480600SE +/- 5.84, N = 3SE +/- 0.11, N = 3SE +/- 0.92, N = 3475.66551.66565.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct6001200180024003000SE +/- 24.17, N = 6SE +/- 8.62, N = 3SE +/- 0.78, N = 32572.632896.612911.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct70140210280350SE +/- 0.28, N = 3SE +/- 0.51, N = 3SE +/- 0.63, N = 3331.20327.68327.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUv6.4v6.5v6.6 6 Oct2K4K6K8K10KSE +/- 16.48, N = 3SE +/- 10.14, N = 3SE +/- 21.17, N = 311342.5411013.2911190.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUv6.4v6.5v6.6 6 Oct2004006008001000SE +/- 13.29, N = 3SE +/- 1.10, N = 3SE +/- 1.66, N = 31112.461155.641159.201. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct11002200330044005500SE +/- 20.34, N = 3SE +/- 3.85, N = 3SE +/- 8.34, N = 35018.035018.075053.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct4K8K12K16K20KSE +/- 240.02, N = 3SE +/- 92.46, N = 3SE +/- 116.21, N = 316690.3617909.2818105.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct3K6K9K12K15KSE +/- 27.81, N = 3SE +/- 32.50, N = 3SE +/- 14.33, N = 316182.5516152.1016160.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct30060090012001500SE +/- 2.60, N = 3SE +/- 3.25, N = 3SE +/- 2.05, N = 31503.541498.561508.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUv6.4v6.5v6.6 6 Oct140280420560700SE +/- 5.12, N = 3SE +/- 7.36, N = 15SE +/- 6.10, N = 6667.64639.08652.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct6K12K18K24K30KSE +/- 231.74, N = 15SE +/- 236.24, N = 3SE +/- 186.80, N = 325464.6229736.3129779.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct14002800420056007000SE +/- 8.07, N = 3SE +/- 8.34, N = 3SE +/- 6.56, N = 36316.446234.836265.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUv6.4v6.5v6.6 6 Oct8001600240032004000SE +/- 9.62, N = 3SE +/- 8.61, N = 3SE +/- 7.83, N = 33597.653572.893587.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUv6.4v6.5v6.6 6 Oct20K40K60K80K100KSE +/- 1782.53, N = 15SE +/- 544.05, N = 3SE +/- 537.27, N = 374954.0394168.2893693.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct5001000150020002500SE +/- 5.85, N = 3SE +/- 2.61, N = 3SE +/- 3.57, N = 32452.142445.542457.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct30K60K90K120K150KSE +/- 1041.05, N = 15SE +/- 1061.43, N = 15SE +/- 837.50, N = 15112475.34111886.46117557.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

AOM AV1

Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct0.08780.17560.26340.35120.439SE +/- 0.00, N = 15SE +/- 0.00, N = 15SE +/- 0.01, N = 150.390.390.371. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct246810SE +/- 0.10, N = 15SE +/- 0.24, N = 12SE +/- 0.16, N = 157.077.727.131. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct1020304050SE +/- 0.79, N = 15SE +/- 1.36, N = 12SE +/- 2.39, N = 1241.5142.4245.271. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct48121620SE +/- 0.38, N = 15SE +/- 0.42, N = 15SE +/- 0.56, N = 1514.3014.0912.381. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct1020304050SE +/- 1.53, N = 15SE +/- 1.26, N = 12SE +/- 1.29, N = 1241.6742.3841.951. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct1122334455SE +/- 1.51, N = 15SE +/- 0.88, N = 15SE +/- 1.27, N = 1547.5445.1446.081. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct1224364860SE +/- 1.50, N = 12SE +/- 2.34, N = 15SE +/- 1.97, N = 1544.2351.6047.181. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 11 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 11 Realtime - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct1122334455SE +/- 1.22, N = 15SE +/- 1.08, N = 15SE +/- 2.00, N = 1249.0945.4548.211. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct0.92971.85942.78913.71884.6485SE +/- 0.031, N = 15SE +/- 0.040, N = 6SE +/- 0.030, N = 114.1324.0164.1201. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct306090120150SE +/- 8.17, N = 15SE +/- 4.93, N = 15SE +/- 6.81, N = 15133.93114.32122.121. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct306090120150SE +/- 9.48, N = 12SE +/- 5.99, N = 15SE +/- 1.29, N = 3145.92112.26116.741. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080pv6.4v6.5v6.6 6 Oct3691215SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 311.5911.1011.561. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080pv6.4v6.5v6.6 6 Oct90180270360450SE +/- 29.20, N = 15SE +/- 28.60, N = 15SE +/- 23.45, N = 15426.84406.64431.131. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080pv6.4v6.5v6.6 6 Oct110220330440550SE +/- 28.12, N = 15SE +/- 27.06, N = 15SE +/- 29.52, N = 15518.77459.29468.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fastv6.4v6.5v6.6 6 Oct1.16442.32883.49324.65765.822SE +/- 0.058, N = 3SE +/- 0.066, N = 3SE +/- 0.064, N = 125.0755.1755.0761. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fasterv6.4v6.5v6.6 6 Oct246810SE +/- 0.097, N = 15SE +/- 0.137, N = 15SE +/- 0.103, N = 158.4508.5008.3261. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fastv6.4v6.5v6.6 6 Oct48121620SE +/- 0.19, N = 3SE +/- 0.19, N = 3SE +/- 0.04, N = 316.3416.2816.401. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fasterv6.4v6.5v6.6 6 Oct714212835SE +/- 0.34, N = 4SE +/- 0.08, N = 3SE +/- 0.48, N = 1228.2728.7227.331. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

High Performance Conjugate Gradient

X Y Z: 104 104 104 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 104 104 104 - RT: 60v6.4v6.5v6.6 6 Oct20406080100SE +/- 0.65, N = 3SE +/- 0.94, N = 3SE +/- 0.92, N = 3104.68102.19101.741. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

High Performance Conjugate Gradient

X Y Z: 144 144 144 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60v6.4v6.5v6.6 6 Oct20406080100SE +/- 0.76, N = 6SE +/- 0.98, N = 9SE +/- 0.42, N = 376.5873.7374.271. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50v6.4v6.5v6.6 6 Oct918273645SE +/- 0.35, N = 3SE +/- 0.31, N = 9SE +/- 0.38, N = 1536.8538.2238.01

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50v6.4v6.5v6.6 6 Oct1122334455SE +/- 0.54, N = 3SE +/- 0.58, N = 12SE +/- 0.66, N = 345.2046.4146.63

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50v6.4v6.5v6.6 6 Oct1224364860SE +/- 0.72, N = 3SE +/- 0.49, N = 12SE +/- 0.57, N = 353.0451.4251.40

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50v6.4v6.5v6.6 6 Oct1530456075SE +/- 0.29, N = 3SE +/- 0.76, N = 3SE +/- 0.66, N = 965.2265.9165.97

Crypto++

Test: Keyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.8Test: Keyed Algorithmsv6.4v6.5v6.6 6 Oct130260390520650SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3604.54604.26604.371. (CXX) g++ options: -g2 -O3 -fPIC -fno-devirtualize -pthread -pipe

Crypto++

Test: Unkeyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.8Test: Unkeyed Algorithmsv6.4v6.5v6.6 6 Oct100200300400500SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 0.16, N = 3441.20440.62440.911. (CXX) g++ options: -g2 -O3 -fPIC -fno-devirtualize -pthread -pipe

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingv6.4v6.5v6.6 6 Oct60K120K180K240K300KSE +/- 2800.68, N = 3SE +/- 1889.96, N = 3SE +/- 2866.87, N = 32835562791352737311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingv6.4v6.5v6.6 6 Oct90K180K270K360K450KSE +/- 822.46, N = 3SE +/- 3147.07, N = 3SE +/- 4588.21, N = 34003703867314015891. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Apache Hadoop

Operation: Open - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 100000v6.4v6.5v6.6 6 Oct60K120K180K240K300KSE +/- 9603.74, N = 15SE +/- 8309.89, N = 15SE +/- 11689.78, N = 15294150269810283104

Apache Hadoop

Operation: Open - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 100000v6.4v6.5v6.6 6 Oct60K120K180K240K300KSE +/- 6349.18, N = 12SE +/- 14950.62, N = 12SE +/- 7173.98, N = 15269034262969272523

Apache Hadoop

Operation: Open - Threads: 500 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 500 - Files: 100000v6.4v6.5v6.6 6 Oct60K120K180K240K300KSE +/- 9141.48, N = 12SE +/- 20767.40, N = 15SE +/- 8486.55, N = 15265652254640267299

Apache Hadoop

Operation: Delete - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 100000v6.4v6.5v6.6 6 Oct13K26K39K52K65KSE +/- 1094.57, N = 15SE +/- 835.38, N = 13SE +/- 925.50, N = 15603165662558051

Apache Hadoop

Operation: Open - Threads: 1000 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 1000 - Files: 100000v6.4v6.5v6.6 6 Oct60K120K180K240K300KSE +/- 5523.57, N = 15SE +/- 19650.01, N = 15SE +/- 15981.48, N = 12274610238253253036

Apache Hadoop

Operation: Create - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 1000000v6.4v6.5v6.6 6 Oct8K16K24K32K40KSE +/- 371.08, N = 3SE +/- 274.20, N = 11SE +/- 145.62, N = 3372543761735935

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5v6.4v6.5v6.6 6 Oct500K1000K1500K2000K2500KSE +/- 57616.61, N = 12SE +/- 31237.79, N = 15SE +/- 21494.50, N = 32331936.552128295.602188365.951. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10v6.4v6.5v6.6 6 Oct500K1000K1500K2000K2500KSE +/- 23334.59, N = 3SE +/- 37051.26, N = 12SE +/- 26927.97, N = 32262895.862068343.102231964.351. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct7M14M21M28M35MSE +/- 332901.55, N = 15SE +/- 232925.17, N = 15SE +/- 327309.26, N = 5301899853063290529931254

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct8M16M24M32M40MSE +/- 432863.04, N = 15SE +/- 443563.55, N = 15SE +/- 369838.39, N = 15391220533853984939142134

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.4v6.5v6.6 6 Oct5M10M15M20M25MSE +/- 171233.24, N = 12SE +/- 188478.96, N = 15SE +/- 173884.88, N = 12245829412482527224839001

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct9M18M27M36M45MSE +/- 358083.32, N = 15SE +/- 472609.51, N = 15SE +/- 465340.61, N = 3430368984214767141245153

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct11M22M33M44M55MSE +/- 506247.74, N = 13SE +/- 410488.78, N = 15SE +/- 547035.26, N = 12525140085251989852700021

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.4v6.5v6.6 6 Oct9M18M27M36M45MSE +/- 387575.50, N = 15SE +/- 308400.53, N = 15SE +/- 384183.23, N = 15416752654215036842560026

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.4v6.5v6.6 6 Oct9M18M27M36M45MSE +/- 245644.87, N = 3SE +/- 373729.23, N = 15SE +/- 344346.26, N = 15405209014220169641638681

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct13M26M39M52M65MSE +/- 581785.82, N = 15SE +/- 676191.00, N = 15SE +/- 697211.54, N = 13593769565967987860179852

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.4v6.5v6.6 6 Oct13M26M39M52M65MSE +/- 450916.16, N = 10SE +/- 654921.10, N = 12SE +/- 455210.13, N = 3580966005955284756839448

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct14M28M42M56M70MSE +/- 46596.93, N = 3SE +/- 691489.65, N = 3SE +/- 494444.55, N = 3670453776702375066764218

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400v6.4v6.5v6.6 6 Oct14M28M42M56M70MSE +/- 525580.37, N = 3SE +/- 800541.34, N = 4SE +/- 791635.87, N = 3660989426739432366372800

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.4v6.5v6.6 6 Oct11M22M33M44M55MSE +/- 482700.73, N = 15SE +/- 518637.11, N = 15SE +/- 501437.42, N = 14512482995118839850701925

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.4v6.5v6.6 6 Oct11M22M33M44M55MSE +/- 396843.42, N = 15SE +/- 453048.86, N = 15SE +/- 462612.67, N = 15504235425110478651764919

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct14M28M42M56M70MSE +/- 690519.22, N = 3SE +/- 929043.22, N = 3SE +/- 407522.59, N = 3662879066655890667263606

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.4v6.5v6.6 6 Oct14M28M42M56M70MSE +/- 524197.72, N = 12SE +/- 628672.36, N = 12SE +/- 718005.55, N = 3657844786607883565998468

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct16M32M48M64M80MSE +/- 265706.48, N = 3SE +/- 551372.39, N = 3SE +/- 658836.89, N = 3726055137059252773920159

NAS Parallel Benchmarks

Test / Class: BT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.Cv6.4v6.5v6.6 6 Oct70K140K210K280K350KSE +/- 2411.99, N = 11SE +/- 3511.64, N = 3SE +/- 958.09, N = 3322119.99306002.20312977.301. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: CG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.Cv6.4v6.5v6.6 6 Oct11K22K33K44K55KSE +/- 525.17, N = 6SE +/- 486.03, N = 15SE +/- 305.31, N = 351894.8552032.1053274.791. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.Cv6.4v6.5v6.6 6 Oct2K4K6K8K10KSE +/- 222.04, N = 12SE +/- 266.91, N = 15SE +/- 228.39, N = 1210844.9010479.7910840.561. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: FT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.Cv6.4v6.5v6.6 6 Oct20K40K60K80K100KSE +/- 1023.16, N = 15SE +/- 2189.90, N = 15SE +/- 2154.10, N = 12103248.13112362.39114793.581. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.Cv6.4v6.5v6.6 6 Oct60K120K180K240K300KSE +/- 2141.41, N = 3SE +/- 3576.66, N = 3SE +/- 946.75, N = 3269542.21268492.02273013.531. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: MG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.Cv6.4v6.5v6.6 6 Oct50K100K150K200K250KSE +/- 2713.74, N = 15SE +/- 2603.01, N = 3SE +/- 2417.02, N = 15239408.11234268.14239660.401. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: SP.B

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Bv6.4v6.5v6.6 6 Oct40K80K120K160K200KSE +/- 1564.28, N = 13SE +/- 1289.87, N = 15SE +/- 1609.35, N = 15176009.15178582.58180233.001. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: SP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Cv6.4v6.5v6.6 6 Oct40K80K120K160K200KSE +/- 1944.01, N = 5SE +/- 2009.88, N = 3SE +/- 2038.85, N = 3193221.95190905.82191378.821. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyv6.4v6.5v6.6 6 Oct150K300K450K600K750KSE +/- 15922.26, N = 9SE +/- 30469.92, N = 12SE +/- 23263.68, N = 96402357008366971031. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Writev6.4v6.5v6.6 6 Oct10K20K30K40K50KSE +/- 557.77, N = 3SE +/- 370.85, N = 3SE +/- 508.74, N = 44558143765445041. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Onlyv6.4v6.5v6.6 6 Oct160K320K480K640K800KSE +/- 9464.82, N = 3SE +/- 10180.90, N = 3SE +/- 9607.07, N = 127012137291847103891. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Writev6.4v6.5v6.6 6 Oct9K18K27K36K45KSE +/- 535.00, N = 4SE +/- 379.56, N = 12SE +/- 434.91, N = 124294742340419611. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Onlyv6.4v6.5v6.6 6 Oct150K300K450K600K750KSE +/- 8915.31, N = 12SE +/- 10655.35, N = 12SE +/- 8415.01, N = 37100797144846854221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Writev6.4v6.5v6.6 6 Oct5K10K15K20K25KSE +/- 240.76, N = 12SE +/- 236.09, N = 3SE +/- 172.49, N = 122041621367205101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Writev6.4v6.5v6.6 6 Oct4K8K12K16K20KSE +/- 218.15, N = 12SE +/- 180.45, N = 12SE +/- 216.13, N = 121988419709197141. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct306090120150SE +/- 1.48, N = 15SE +/- 1.82, N = 15SE +/- 1.48, N = 15155.22156.06156.10MAX: 27068.23MAX: 26765.03MAX: 27008.49

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.4v6.5v6.6 6 Oct1632486480SE +/- 0.55, N = 12SE +/- 0.56, N = 15SE +/- 0.49, N = 1270.7769.6569.84MAX: 23941.04MAX: 23930.93MAX: 23963.52

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct20406080100SE +/- 0.96, N = 15SE +/- 1.35, N = 15SE +/- 1.57, N = 397.1699.71102.21MAX: 24088.47MAX: 24866.21MAX: 23899.32

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct306090120150SE +/- 1.53, N = 13SE +/- 1.56, N = 15SE +/- 2.12, N = 12125.95127.67126.51MAX: 23943.82MAX: 23994.5MAX: 23988.02

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.4v6.5v6.6 6 Oct1020304050SE +/- 0.46, N = 15SE +/- 0.39, N = 15SE +/- 0.42, N = 1542.6842.1941.71MAX: 15117.6MAX: 16359.93MAX: 18608.41

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.4v6.5v6.6 6 Oct4080120160200SE +/- 2.09, N = 3SE +/- 1.65, N = 15SE +/- 1.95, N = 15163.36152.95153.49MAX: 27171.99MAX: 28282.63MAX: 27353.32

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct20406080100SE +/- 0.85, N = 15SE +/- 0.97, N = 15SE +/- 1.09, N = 1377.0076.5475.47MAX: 12622.02MAX: 12675.23MAX: 13909.62

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.4v6.5v6.6 6 Oct60120180240300SE +/- 3.08, N = 10SE +/- 3.68, N = 12SE +/- 0.59, N = 3265.99266.74279.15MAX: 30115.56MAX: 27647.27MAX: 29007.59

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct306090120150SE +/- 0.10, N = 3SE +/- 1.29, N = 3SE +/- 1.13, N = 3111.75111.14111.92MAX: 10157.01MAX: 11352.98MAX: 10281.65

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400v6.4v6.5v6.6 6 Oct80160240320400SE +/- 4.26, N = 3SE +/- 5.94, N = 4SE +/- 4.55, N = 3370.82368.15374.60MAX: 30958.08MAX: 30924.16MAX: 29403.16

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.4v6.5v6.6 6 Oct816243240SE +/- 0.38, N = 15SE +/- 0.74, N = 15SE +/- 0.42, N = 1435.3134.4935.64MAX: 23938.81MAX: 23957.29MAX: 23906.01

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.4v6.5v6.6 6 Oct306090120150SE +/- 1.11, N = 15SE +/- 1.66, N = 15SE +/- 2.18, N = 15140.40139.82134.57MAX: 27765.12MAX: 27644.97MAX: 27260.07

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct1632486480SE +/- 0.22, N = 3SE +/- 1.10, N = 3SE +/- 0.62, N = 369.8870.0969.65MAX: 23895.2MAX: 23936.83MAX: 23900.31

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.4v6.5v6.6 6 Oct60120180240300SE +/- 2.23, N = 12SE +/- 2.65, N = 12SE +/- 4.51, N = 3277.40273.92277.50MAX: 30379.43MAX: 28783.48MAX: 28355.83

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct20406080100SE +/- 0.13, N = 3SE +/- 1.12, N = 3SE +/- 1.01, N = 3104.93108.51102.90MAX: 23900.89MAX: 23916.24MAX: 23899.89

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.5v6.6 6 Oct306090120150SE +/- 1.28, N = 15SE +/- 1.88, N = 5127.92132.61MAX: 26759.03MAX: 25773.81

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyv6.4v6.5v6.6 6 Oct0.35330.70661.05991.41321.7665SE +/- 0.042, N = 9SE +/- 0.056, N = 12SE +/- 0.044, N = 91.5701.4541.4461. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyv6.4v6.5v6.6 6 Oct48121620SE +/- 0.22, N = 3SE +/- 0.15, N = 3SE +/- 0.21, N = 417.5618.2817.981. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latencyv6.4v6.5v6.6 6 Oct0.25670.51340.77011.02681.2835SE +/- 0.016, N = 3SE +/- 0.015, N = 3SE +/- 0.015, N = 121.1411.0981.1281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyv6.4v6.5v6.6 6 Oct612182430SE +/- 0.29, N = 4SE +/- 0.21, N = 12SE +/- 0.25, N = 1223.3023.6423.861. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latencyv6.4v6.5v6.6 6 Oct0.32850.6570.98551.3141.6425SE +/- 0.018, N = 12SE +/- 0.021, N = 12SE +/- 0.018, N = 31.4111.4031.4601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latencyv6.4v6.5v6.6 6 Oct918273645SE +/- 0.47, N = 12SE +/- 0.42, N = 3SE +/- 0.33, N = 1239.2537.4539.041. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latencyv6.4v6.5v6.6 6 Oct1122334455SE +/- 0.55, N = 12SE +/- 0.46, N = 12SE +/- 0.55, N = 1250.3650.7950.791. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct60120180240300SE +/- 1.25, N = 3SE +/- 0.39, N = 3SE +/- 0.68, N = 3293.60232.33231.45MIN: 175.19 / MAX: 761.95MIN: 171.26 / MAX: 448.32MIN: 167.08 / MAX: 4291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct20406080100SE +/- 0.97, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 377.9766.8365.43MIN: 47.82 / MAX: 365.81MIN: 47.69 / MAX: 144.02MIN: 52.22 / MAX: 151.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUv6.4v6.5v6.6 6 Oct20406080100SE +/- 0.95, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 377.7067.0165.42MIN: 49.99 / MAX: 537.56MIN: 47.99 / MAX: 141.48MIN: 51.27 / MAX: 181.21. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct48121620SE +/- 0.13, N = 6SE +/- 0.04, N = 3SE +/- 0.01, N = 314.3512.7412.67MIN: 9.07 / MAX: 112.91MIN: 8.82 / MAX: 56.2MIN: 8.91 / MAX: 252.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct70140210280350SE +/- 0.31, N = 3SE +/- 0.56, N = 3SE +/- 0.67, N = 3337.22341.06341.19MIN: 252.67 / MAX: 470.11MIN: 238.2 / MAX: 437.74MIN: 242.27 / MAX: 401.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUv6.4v6.5v6.6 6 Oct3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 39.8510.159.98MIN: 7.51 / MAX: 55.05MIN: 7.22 / MAX: 47.29MIN: 7.7 / MAX: 41.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUv6.4v6.5v6.6 6 Oct816243240SE +/- 0.39, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 333.2131.9831.88MIN: 23.34 / MAX: 169.71MIN: 23.5 / MAX: 154.49MIN: 23.76 / MAX: 159.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct510152025SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 322.2822.2522.10MIN: 14.79 / MAX: 71.65MIN: 15.09 / MAX: 75.35MIN: 16.11 / MAX: 811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct246810SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 36.606.216.16MIN: 4.28 / MAX: 87.64MIN: 4.25 / MAX: 71.23MIN: 4.39 / MAX: 72.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct246810SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.896.896.88MIN: 5.52 / MAX: 36.52MIN: 5.7 / MAX: 43.92MIN: 5.82 / MAX: 40.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct20406080100SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.11, N = 374.4074.6574.13MIN: 53.51 / MAX: 281.3MIN: 56.35 / MAX: 221.5MIN: 53.68 / MAX: 267.91. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUv6.4v6.5v6.6 6 Oct1326395265SE +/- 0.43, N = 3SE +/- 0.65, N = 15SE +/- 0.54, N = 655.3157.8456.60MIN: 38.54 / MAX: 312.66MIN: 34.52 / MAX: 409.65MIN: 39.06 / MAX: 243.121. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct0.95181.90362.85543.80724.759SE +/- 0.03, N = 15SE +/- 0.03, N = 3SE +/- 0.03, N = 34.233.703.67MIN: 2.61 / MAX: 111.71MIN: 2.57 / MAX: 108.71MIN: 2.51 / MAX: 63.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUv6.4v6.5v6.6 6 Oct48121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 317.7017.9317.83MIN: 12.28 / MAX: 42.46MIN: 12.49 / MAX: 40.07MIN: 12.43 / MAX: 36.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUv6.4v6.5v6.6 6 Oct714212835SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 331.1031.3231.19MIN: 24.91 / MAX: 99.63MIN: 25.09 / MAX: 91.66MIN: 24.8 / MAX: 100.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUv6.4v6.5v6.6 6 Oct0.12830.25660.38490.51320.6415SE +/- 0.01, N = 15SE +/- 0.01, N = 3SE +/- 0.02, N = 30.570.560.53MIN: 0.29 / MAX: 74.65MIN: 0.36 / MAX: 51.75MIN: 0.37 / MAX: 56.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct1020304050SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 345.6345.7645.53MIN: 38.64 / MAX: 91.4MIN: 38.33 / MAX: 110.96MIN: 40.67 / MAX: 112.31. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct0.07650.1530.22950.3060.3825SE +/- 0.00, N = 15SE +/- 0.00, N = 15SE +/- 0.00, N = 150.340.340.33MIN: 0.25 / MAX: 36.53MIN: 0.24 / MAX: 33.93MIN: 0.24 / MAX: 31.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDv6.4v6.5v6.6 6 Oct816243240SE +/- 0.23, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 335.2435.2835.061. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP HotSpot3D

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP HotSpot3Dv6.4v6.5v6.6 6 Oct20406080100SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 1.06, N = 1580.6480.7883.831. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP Leukocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Leukocytev6.4v6.5v6.6 6 Oct816243240SE +/- 0.52, N = 15SE +/- 0.08, N = 3SE +/- 0.40, N = 334.1731.4932.181. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP CFD Solverv6.4v6.5v6.6 6 Oct246810SE +/- 0.058, N = 3SE +/- 0.093, N = 3SE +/- 0.076, N = 38.7138.8868.1641. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Streamclusterv6.4v6.5v6.6 6 Oct1122334455SE +/- 2.00, N = 15SE +/- 0.58, N = 3SE +/- 2.47, N = 1542.6145.6747.371. (CXX) g++ options: -O2 -lOpenCL

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh Timev6.4v6.5v6.6 6 Oct91827364539.3638.4937.351. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution Timev6.4v6.5v6.6 6 Oct91827364537.8436.7737.021. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh Timev6.4v6.5v6.6 6 Oct4080120160200175.93174.04175.391. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution Timev6.4v6.5v6.6 6 Oct50100150200250195.89197.95206.431. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper Beamv6.4v6.5v6.6 6 Oct20406080100SE +/- 0.64, N = 3SE +/- 0.23, N = 3SE +/- 0.37, N = 395.1796.0595.08

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1Mv6.4v6.5v6.6 6 Oct306090120150SE +/- 0.01, N = 3SE +/- 1.07, N = 3SE +/- 0.37, N = 3128.50130.43129.79

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop Testv6.4v6.5v6.6 6 Oct816243240SE +/- 0.01, N = 3SE +/- 0.17, N = 3SE +/- 0.25, N = 332.3733.8133.34

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on Windshieldv6.4v6.5v6.6 6 Oct4080120160200SE +/- 0.82, N = 3SE +/- 0.28, N = 3SE +/- 0.50, N = 3159.21159.91161.95

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal Installationv6.4v6.5v6.6 6 Oct306090120150SE +/- 0.71, N = 3SE +/- 0.71, N = 3SE +/- 0.19, N = 3116.35119.47116.46

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop Containerv6.4v6.5v6.6 6 Oct306090120150SE +/- 0.42, N = 3SE +/- 0.29, N = 3SE +/- 0.74, N = 3138.97141.85138.78

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0v6.4v6.5v6.6 6 Oct1632486480SE +/- 0.04, N = 3SE +/- 0.81, N = 3SE +/- 0.55, N = 370.7470.8869.591. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2v6.4v6.5v6.6 6 Oct918273645SE +/- 0.32, N = 3SE +/- 0.53, N = 3SE +/- 0.17, N = 339.3738.6438.671. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6v6.4v6.5v6.6 6 Oct0.84511.69022.53533.38044.2255SE +/- 0.005, N = 3SE +/- 0.024, N = 15SE +/- 0.040, N = 43.7283.6813.7561. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslessv6.4v6.5v6.6 6 Oct246810SE +/- 0.054, N = 3SE +/- 0.032, N = 3SE +/- 0.016, N = 36.8926.7666.8441. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, Losslessv6.4v6.5v6.6 6 Oct1.14192.28383.42574.56765.7095SE +/- 0.005, N = 3SE +/- 0.009, N = 3SE +/- 0.029, N = 35.0755.0585.0641. (CXX) g++ options: -O3 -fPIC -lm

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigv6.4v6.5v6.6 6 Oct918273645SE +/- 0.29, N = 10SE +/- 0.37, N = 6SE +/- 0.47, N = 437.3238.1937.81

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigv6.4v6.5v6.6 6 Oct60120180240300SE +/- 1.69, N = 3SE +/- 0.37, N = 3SE +/- 0.32, N = 3288.41289.55289.51

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Ninjav6.4v6.5v6.6 6 Oct4080120160200SE +/- 3.13, N = 12SE +/- 1.10, N = 3SE +/- 1.03, N = 3187.32192.79191.77

Timed LLVM Compilation

Build System: Unix Makefiles

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix Makefilesv6.4v6.5v6.6 6 Oct60120180240300SE +/- 2.50, N = 3SE +/- 3.67, N = 3SE +/- 2.96, N = 9275.09274.65275.55

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlyv6.4v6.5v6.6 6 Oct510152025SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 321.4821.9621.12

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlyv6.4v6.5v6.6 6 Oct1224364860SE +/- 0.28, N = 3SE +/- 0.26, N = 3SE +/- 0.24, N = 353.1454.0153.11

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlyv6.4v6.5v6.6 6 Oct918273645SE +/- 0.15, N = 3SE +/- 0.41, N = 15SE +/- 0.10, N = 340.1241.6240.42

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlyv6.4v6.5v6.6 6 Oct80160240320400SE +/- 4.74, N = 9SE +/- 14.36, N = 9SE +/- 11.89, N = 9315.02336.42385.35

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlyv6.4v6.5v6.6 6 Oct20406080100SE +/- 0.36, N = 3SE +/- 0.56, N = 3SE +/- 0.83, N = 474.8873.8775.58

Phoronix Test Suite v10.8.5