Intel Xeon Max Linux Kernels

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2310079-NE-XEONMAXLI86&sor&gru.

Intel Xeon Max Linux KernelsProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolutionv6.4v6.5v6.6 6 Oct2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)Supermicro X13DEM v1.10 (1.3 BIOS)Intel Device 1bce512GB2 x 7682GB INTEL SSDPF2KX076TZASPEEDVE2282 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200GbUbuntu 23.046.4.0-060400-generic (x86_64)GNOME Shell 44.0X Server 1.21.1.7GCC 12.2.0ext41920x10806.5.0-060500-generic (x86_64)1024x7686.6.0-060600rc4daily20231006-generic (x86_64)1920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c0001d1Java Details- OpenJDK Runtime Environment (build 17.0.6+10-Ubuntu-1ubuntu2)Python Details- Python 3.11.2Security Details- v6.4: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - v6.5: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - v6.6 6 Oct: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Intel Xeon Max Linux Kernelsstress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pipestress-ng: Zlibstress-ng: Mutexstress-ng: Mallocstress-ng: Pthreadstress-ng: AVL Treestress-ng: IO_uringstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: AVX-512 VNNIstress-ng: Function Callstress-ng: x86_64 RdRandstress-ng: Floating Pointstress-ng: Matrix 3D Mathstress-ng: Memory Copyingstress-ng: Vector Shufflestress-ng: Wide Vector Mathstress-ng: Fused Multiply-Addstress-ng: Vector Floating Pointstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingnekrs: Kershawnekrs: TurboPipe Periodicopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUaom-av1: Speed 0 Two-Pass - Bosphorus 4Kaom-av1: Speed 4 Two-Pass - Bosphorus 4Kaom-av1: Speed 6 Realtime - Bosphorus 4Kaom-av1: Speed 6 Two-Pass - Bosphorus 4Kaom-av1: Speed 8 Realtime - Bosphorus 4Kaom-av1: Speed 9 Realtime - Bosphorus 4Kaom-av1: Speed 10 Realtime - Bosphorus 4Kaom-av1: Speed 11 Realtime - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastvvenc: Bosphorus 1080p - Fasterhpcg: 104 104 104 - 60hpcg: 144 144 144 - 60tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 256 - ResNet-50cryptopp: Keyed Algorithmscryptopp: Unkeyed Algorithmscompress-7zip: Compression Ratingcompress-7zip: Decompression Ratinghadoop: Open - 50 - 100000hadoop: Open - 100 - 100000hadoop: Open - 500 - 100000hadoop: Delete - 50 - 100000hadoop: Open - 1000 - 100000hadoop: Create - 50 - 1000000memtier-benchmark: Redis - 50 - 1:5memtier-benchmark: Redis - 100 - 1:10apache-iotdb: 100 - 100 - 500 - 100apache-iotdb: 100 - 100 - 800 - 100apache-iotdb: 200 - 100 - 200 - 100apache-iotdb: 200 - 100 - 500 - 100apache-iotdb: 200 - 100 - 800 - 100apache-iotdb: 500 - 100 - 200 - 100apache-iotdb: 500 - 100 - 200 - 400apache-iotdb: 500 - 100 - 500 - 100apache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 500 - 100 - 800 - 100apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 200 - 100apache-iotdb: 800 - 100 - 200 - 400apache-iotdb: 800 - 100 - 500 - 100apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 800 - 100npb: BT.Cnpb: CG.Cnpb: EP.Cnpb: FT.Cnpb: LU.Cnpb: MG.Cnpb: SP.Bnpb: SP.Cpgbench: 100 - 1000 - Read Onlypgbench: 100 - 800 - Read Writepgbench: 1000 - 800 - Read Onlypgbench: 100 - 1000 - Read Writepgbench: 1000 - 1000 - Read Onlypgbench: 1000 - 800 - Read Writepgbench: 1000 - 1000 - Read Writeapache-iotdb: 100 - 100 - 800 - 100apache-iotdb: 200 - 100 - 200 - 100apache-iotdb: 200 - 100 - 500 - 100apache-iotdb: 200 - 100 - 800 - 100apache-iotdb: 500 - 100 - 200 - 100apache-iotdb: 500 - 100 - 200 - 400apache-iotdb: 500 - 100 - 500 - 100apache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 500 - 100 - 800 - 100apache-iotdb: 500 - 100 - 800 - 400apache-iotdb: 800 - 100 - 200 - 100apache-iotdb: 800 - 100 - 200 - 400apache-iotdb: 800 - 100 - 500 - 100apache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 800 - 100 - 800 - 100apache-iotdb: 100 - 100 - 500 - 100pgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 800 - Read Write - Average Latencypgbench: 1000 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Write - Average Latencypgbench: 1000 - 1000 - Read Only - Average Latencypgbench: 1000 - 800 - Read Write - Average Latencypgbench: 1000 - 1000 - Read Write - Average Latencyopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUrodinia: OpenMP LavaMDrodinia: OpenMP HotSpot3Drodinia: OpenMP Leukocyterodinia: OpenMP CFD Solverrodinia: OpenMP Streamclusteropenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Bumper Beamopenradioss: Chrysler Neon 1Mopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containeravifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessavifenc: 10, Losslessbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-llvm: Ninjabuild-llvm: Unix Makefilesblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyv6.4v6.5v6.6 6 Oct17389901.327996.78514.0931203885.988220.8323140484.14217211109.0336288.24790.232619140.96938764.06200494.80177471711.51396715.18381412.8211752668.1863249.99637179.5231253.9328901.0225816.50551599.325961543.12253366692.27244931.4181547074.591875.8318811154.4058659833334098953333125.69474.05475.662572.63331.2011342.541112.465018.0316690.3616182.551503.54667.6425464.626316.443597.6574954.032452.14112475.340.397.0741.5114.3041.6747.5444.2349.094.132133.926145.91511.589426.842518.7695.0758.45016.33628.270104.67776.578536.8545.2053.0465.22604.541642441.19698928355640037029415026903426565260316274610372542331936.552262895.8630189985391220532458294143036898525140084167526540520901593769565809660067045377660989425124829950423542662879066578447872605513322119.9951894.8510844.90103248.13269542.21239408.11176009.15193221.9564023545581701213429477100792041619884155.2270.7797.16125.9542.68163.3677.00265.99111.75370.8235.31140.4069.88277.40104.931.57017.5561.14123.2961.41139.24550.358293.677.9777.7014.35337.229.8533.2122.286.606.8974.4055.314.2317.7031.100.5745.630.3435.24380.64434.1738.71342.60539.35959437.840712175.9258195.8876495.17128.5032.37159.21116.35138.9770.73539.3713.7286.8925.07537.316288.412187.322275.08521.4853.1440.12315.0274.8816889506.128195.87575.3738337996.378330.2225266270.16219735444.0538759.74794.302557131.35827481.85198750.35154525821.93349646.89359634.3511016794.4161230.89648063.9129342.6732314.9325493.26549410.105808342.74243730838.96240694.1677642781.171916.2019106643.9958092200004101490000159.00553.15551.662896.61327.6811013.291155.645018.0717909.2816152.101498.56639.0829736.316234.833572.8994168.282445.54111886.460.397.7242.4214.0942.3845.1451.6045.454.016114.318112.25811.102406.640459.2925.1758.50016.28228.717102.19473.732738.2246.4151.4265.91604.262966440.62284627913538673126981026296925464056625238253376172128295.602068343.1030632905385398492482527242147671525198984215036842201696596798785955284767023750673943235118839851104786665589066607883570592527306002.2052032.1010479.79112362.39268492.02234268.14178582.58190905.8270083643765729184423407144842136719709156.0669.6599.71127.6742.19152.9576.54266.74111.14368.1534.49139.8270.09273.92108.51127.921.45418.2821.09823.6391.40337.45150.785232.3366.8367.0112.74341.0610.1531.9822.256.216.8974.6557.843.7017.9331.320.5645.760.3435.28280.78231.4868.88645.67238.49455736.766298174.04396197.949296.05130.4333.81159.91119.47141.8570.88138.6353.6816.7665.05838.190289.545192.791274.64921.9654.0141.62336.4273.8718109792.858382.54474.3927024816.268374.5827388113.63222268148.7635491.62816.163424829.35709241.85203979.83180684828.43370932.98384963.6411946993.7065566.39642917.3031541.6630007.3325800.06562355.246205140.99261241623.38248017.7883443787.581931.8317488847.8358170966674272803333159.56564.91565.022911.44327.6111190.461159.205053.2518105.6316160.291508.77652.7729779.386265.863587.6793693.642457.57117557.360.377.1345.2712.3841.9546.0847.1848.214.120122.116116.73511.563431.133468.5685.0768.32616.40327.331101.73874.265438.0146.6351.4065.97604.369921440.91040727373140158928310427252326729958051253036359352188365.952231964.3529931254391421342483900141245153527000214256002641638681601798525683944866764218663728005070192551764919672636066599846873920159312977.3053274.7910840.56114793.58273013.53239660.40180233.00191378.8269710344504710389419616854222051019714156.1069.84102.21126.5141.71153.4975.47279.15111.92374.6035.64134.5769.65277.50102.90132.611.44617.9831.12823.8601.46039.03650.791231.4565.4365.4212.67341.199.9831.8822.106.166.8874.1356.603.6717.8331.190.5345.530.3335.06283.82832.1788.16447.37037.3535337.023041175.38684206.4271595.08129.7933.34161.95116.46138.7869.59038.6703.7566.8445.06437.808289.507191.766275.54521.1253.1140.42385.3575.58OpenBenchmarking.org

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hashv6.6 6 Octv6.4v6.54M8M12M16M20MSE +/- 232420.75, N = 3SE +/- 343354.96, N = 15SE +/- 109703.46, N = 318109792.8517389901.3216889506.121. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPv6.6 6 Octv6.5v6.42K4K6K8K10KSE +/- 76.34, N = 3SE +/- 60.98, N = 3SE +/- 47.78, N = 38382.548195.877996.781. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMAv6.5v6.4v6.6 6 Oct120240360480600SE +/- 2.88, N = 3SE +/- 7.82, N = 15SE +/- 1.03, N = 3575.37514.09474.391. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipev6.5v6.4v6.6 6 Oct8M16M24M32M40MSE +/- 1055793.62, N = 15SE +/- 487787.75, N = 15SE +/- 581009.73, N = 1538337996.3731203885.9827024816.261. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlibv6.6 6 Octv6.5v6.42K4K6K8K10KSE +/- 11.00, N = 3SE +/- 29.13, N = 3SE +/- 22.76, N = 38374.588330.228220.831. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutexv6.6 6 Octv6.5v6.46M12M18M24M30MSE +/- 709062.89, N = 15SE +/- 376350.69, N = 15SE +/- 381162.66, N = 1527388113.6325266270.1623140484.141. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mallocv6.6 6 Octv6.5v6.450M100M150M200M250MSE +/- 619909.09, N = 3SE +/- 655876.42, N = 3SE +/- 129847.43, N = 3222268148.76219735444.05217211109.031. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthreadv6.5v6.4v6.6 6 Oct8K16K24K32K40KSE +/- 820.44, N = 15SE +/- 43.26, N = 3SE +/- 106.91, N = 338759.7436288.2435491.621. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Treev6.6 6 Octv6.5v6.42004006008001000SE +/- 1.34, N = 3SE +/- 2.77, N = 3SE +/- 1.81, N = 3816.16794.30790.231. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringv6.6 6 Octv6.4v6.5700K1400K2100K2800K3500KSE +/- 44896.75, N = 3SE +/- 33896.79, N = 15SE +/- 24671.90, N = 153424829.352619140.962557131.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cachev6.4v6.5v6.6 6 Oct200K400K600K800K1000KSE +/- 7749.59, N = 3SE +/- 4820.43, N = 3SE +/- 1835.02, N = 3938764.06827481.85709241.851. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stressv6.6 6 Octv6.4v6.540K80K120K160K200KSE +/- 692.17, N = 3SE +/- 341.26, N = 3SE +/- 1870.15, N = 13203979.83200494.80198750.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphoresv6.6 6 Octv6.4v6.540M80M120M160M200MSE +/- 1941141.12, N = 5SE +/- 1308655.40, N = 3SE +/- 1418717.66, N = 3180684828.43177471711.51154525821.931. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Mathv6.4v6.6 6 Octv6.580K160K240K320K400KSE +/- 15424.87, N = 12SE +/- 6612.89, N = 15SE +/- 5325.22, N = 12396715.18370932.98349646.891. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Mathv6.6 6 Octv6.4v6.580K160K240K320K400KSE +/- 522.79, N = 3SE +/- 3943.55, N = 5SE +/- 3836.13, N = 3384963.64381412.82359634.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: AVX-512 VNNI

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNIv6.6 6 Octv6.4v6.53M6M9M12M15MSE +/- 45820.46, N = 3SE +/- 48287.23, N = 3SE +/- 137441.83, N = 311946993.7011752668.1811016794.411. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Callv6.6 6 Octv6.4v6.514K28K42K56K70KSE +/- 112.81, N = 3SE +/- 811.29, N = 15SE +/- 545.69, N = 1565566.3963249.9961230.891. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRandv6.5v6.6 6 Octv6.4140K280K420K560K700KSE +/- 196.88, N = 3SE +/- 280.73, N = 3SE +/- 674.33, N = 3648063.91642917.30637179.521. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Pointv6.6 6 Octv6.4v6.57K14K21K28K35KSE +/- 238.47, N = 10SE +/- 348.48, N = 15SE +/- 305.43, N = 331541.6631253.9329342.671. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Mathv6.5v6.6 6 Octv6.47K14K21K28K35KSE +/- 2392.89, N = 14SE +/- 48.00, N = 3SE +/- 329.39, N = 332314.9330007.3328901.021. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copyingv6.4v6.6 6 Octv6.56K12K18K24K30KSE +/- 629.40, N = 15SE +/- 224.34, N = 7SE +/- 228.57, N = 325816.5025800.0625493.261. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shufflev6.6 6 Octv6.4v6.5120K240K360K480K600KSE +/- 838.85, N = 3SE +/- 1079.72, N = 3SE +/- 652.21, N = 3562355.24551599.32549410.101. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Mathv6.6 6 Octv6.4v6.51.3M2.6M3.9M5.2M6.5MSE +/- 3935.20, N = 3SE +/- 72348.80, N = 3SE +/- 142745.75, N = 126205140.995961543.125808342.741. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Addv6.6 6 Octv6.4v6.560M120M180M240M300MSE +/- 480576.96, N = 3SE +/- 2984105.55, N = 15SE +/- 3180404.53, N = 3261241623.38253366692.27243730838.961. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Pointv6.6 6 Octv6.4v6.550K100K150K200K250KSE +/- 1538.11, N = 3SE +/- 620.60, N = 3SE +/- 1308.77, N = 3248017.78244931.41240694.161. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functionsv6.6 6 Octv6.4v6.520M40M60M80M100MSE +/- 772766.53, N = 15SE +/- 906580.48, N = 15SE +/- 1000931.10, N = 1583443787.5881547074.5977642781.171. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sortingv6.6 6 Octv6.5v6.4400800120016002000SE +/- 5.70, N = 3SE +/- 3.46, N = 3SE +/- 0.72, N = 31931.831916.201875.831. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passingv6.5v6.4v6.6 6 Oct4M8M12M16M20MSE +/- 57359.04, N = 3SE +/- 54732.60, N = 3SE +/- 6699.83, N = 319106643.9918811154.4017488847.831. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawv6.4v6.6 6 Octv6.51300M2600M3900M5200M6500MSE +/- 38898803.89, N = 3SE +/- 77700626.41, N = 3SE +/- 56766399.45, N = 65865983333581709666758092200001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicv6.6 6 Octv6.5v6.4900M1800M2700M3600M4500MSE +/- 4200842.51, N = 3SE +/- 30449494.25, N = 3SE +/- 40424400.36, N = 34272803333410149000040989533331. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.44080120160200SE +/- 0.46, N = 3SE +/- 0.26, N = 3SE +/- 0.59, N = 3159.56159.00125.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.4120240360480600SE +/- 0.67, N = 3SE +/- 0.50, N = 3SE +/- 5.93, N = 3564.91553.15474.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUv6.6 6 Octv6.5v6.4120240360480600SE +/- 0.92, N = 3SE +/- 0.11, N = 3SE +/- 5.84, N = 3565.02551.66475.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.46001200180024003000SE +/- 0.78, N = 3SE +/- 8.62, N = 3SE +/- 24.17, N = 62911.442896.612572.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct70140210280350SE +/- 0.28, N = 3SE +/- 0.51, N = 3SE +/- 0.63, N = 3331.20327.68327.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUv6.4v6.6 6 Octv6.52K4K6K8K10KSE +/- 16.48, N = 3SE +/- 21.17, N = 3SE +/- 10.14, N = 311342.5411190.4611013.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUv6.6 6 Octv6.5v6.42004006008001000SE +/- 1.66, N = 3SE +/- 1.10, N = 3SE +/- 13.29, N = 31159.201155.641112.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUv6.6 6 Octv6.5v6.411002200330044005500SE +/- 8.34, N = 3SE +/- 3.85, N = 3SE +/- 20.34, N = 35053.255018.075018.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.44K8K12K16K20KSE +/- 116.21, N = 3SE +/- 92.46, N = 3SE +/- 240.02, N = 318105.6317909.2816690.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUv6.4v6.6 6 Octv6.53K6K9K12K15KSE +/- 27.81, N = 3SE +/- 14.33, N = 3SE +/- 32.50, N = 316182.5516160.2916152.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.530060090012001500SE +/- 2.05, N = 3SE +/- 2.60, N = 3SE +/- 3.25, N = 31508.771503.541498.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUv6.4v6.6 6 Octv6.5140280420560700SE +/- 5.12, N = 3SE +/- 6.10, N = 6SE +/- 7.36, N = 15667.64652.77639.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUv6.6 6 Octv6.5v6.46K12K18K24K30KSE +/- 186.80, N = 3SE +/- 236.24, N = 3SE +/- 231.74, N = 1529779.3829736.3125464.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUv6.4v6.6 6 Octv6.514002800420056007000SE +/- 8.07, N = 3SE +/- 6.56, N = 3SE +/- 8.34, N = 36316.446265.866234.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUv6.4v6.6 6 Octv6.58001600240032004000SE +/- 9.62, N = 3SE +/- 7.83, N = 3SE +/- 8.61, N = 33597.653587.673572.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUv6.5v6.6 6 Octv6.420K40K60K80K100KSE +/- 544.05, N = 3SE +/- 537.27, N = 3SE +/- 1782.53, N = 1594168.2893693.6474954.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.55001000150020002500SE +/- 3.57, N = 3SE +/- 5.85, N = 3SE +/- 2.61, N = 32457.572452.142445.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.530K60K90K120K150KSE +/- 837.50, N = 15SE +/- 1041.05, N = 15SE +/- 1061.43, N = 15117557.36112475.34111886.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

AOM AV1

Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4Kv6.5v6.4v6.6 6 Oct0.08780.17560.26340.35120.439SE +/- 0.00, N = 15SE +/- 0.00, N = 15SE +/- 0.01, N = 150.390.390.371. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4Kv6.5v6.6 6 Octv6.4246810SE +/- 0.24, N = 12SE +/- 0.16, N = 15SE +/- 0.10, N = 157.727.137.071. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4Kv6.6 6 Octv6.5v6.41020304050SE +/- 2.39, N = 12SE +/- 1.36, N = 12SE +/- 0.79, N = 1545.2742.4241.511. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct48121620SE +/- 0.38, N = 15SE +/- 0.42, N = 15SE +/- 0.56, N = 1514.3014.0912.381. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4Kv6.5v6.6 6 Octv6.41020304050SE +/- 1.26, N = 12SE +/- 1.29, N = 12SE +/- 1.53, N = 1542.3841.9541.671. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.51122334455SE +/- 1.51, N = 15SE +/- 1.27, N = 15SE +/- 0.88, N = 1547.5446.0845.141. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4Kv6.5v6.6 6 Octv6.41224364860SE +/- 2.34, N = 15SE +/- 1.97, N = 15SE +/- 1.50, N = 1251.6047.1844.231. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 11 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 11 Realtime - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.51122334455SE +/- 1.22, N = 15SE +/- 2.00, N = 12SE +/- 1.08, N = 1549.0948.2145.451. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.50.92971.85942.78913.71884.6485SE +/- 0.031, N = 15SE +/- 0.030, N = 11SE +/- 0.040, N = 64.1324.1204.0161. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.5306090120150SE +/- 8.17, N = 15SE +/- 6.81, N = 15SE +/- 4.93, N = 15133.93122.12114.321. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.5306090120150SE +/- 9.48, N = 12SE +/- 1.29, N = 3SE +/- 5.99, N = 15145.92116.74112.261. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080pv6.4v6.6 6 Octv6.53691215SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 311.5911.5611.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080pv6.6 6 Octv6.4v6.590180270360450SE +/- 23.45, N = 15SE +/- 29.20, N = 15SE +/- 28.60, N = 15431.13426.84406.641. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080pv6.4v6.6 6 Octv6.5110220330440550SE +/- 28.12, N = 15SE +/- 29.52, N = 15SE +/- 27.06, N = 15518.77468.57459.291. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fastv6.5v6.6 6 Octv6.41.16442.32883.49324.65765.822SE +/- 0.066, N = 3SE +/- 0.064, N = 12SE +/- 0.058, N = 35.1755.0765.0751. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fasterv6.5v6.4v6.6 6 Oct246810SE +/- 0.137, N = 15SE +/- 0.097, N = 15SE +/- 0.103, N = 158.5008.4508.3261. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fastv6.6 6 Octv6.4v6.548121620SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 316.4016.3416.281. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fasterv6.5v6.4v6.6 6 Oct714212835SE +/- 0.08, N = 3SE +/- 0.34, N = 4SE +/- 0.48, N = 1228.7228.2727.331. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

High Performance Conjugate Gradient

X Y Z: 104 104 104 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 104 104 104 - RT: 60v6.4v6.5v6.6 6 Oct20406080100SE +/- 0.65, N = 3SE +/- 0.94, N = 3SE +/- 0.92, N = 3104.68102.19101.741. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

High Performance Conjugate Gradient

X Y Z: 144 144 144 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60v6.4v6.6 6 Octv6.520406080100SE +/- 0.76, N = 6SE +/- 0.42, N = 3SE +/- 0.98, N = 976.5874.2773.731. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50v6.5v6.6 6 Octv6.4918273645SE +/- 0.31, N = 9SE +/- 0.38, N = 15SE +/- 0.35, N = 338.2238.0136.85

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50v6.6 6 Octv6.5v6.41122334455SE +/- 0.66, N = 3SE +/- 0.58, N = 12SE +/- 0.54, N = 346.6346.4145.20

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50v6.4v6.5v6.6 6 Oct1224364860SE +/- 0.72, N = 3SE +/- 0.49, N = 12SE +/- 0.57, N = 353.0451.4251.40

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50v6.6 6 Octv6.5v6.41530456075SE +/- 0.66, N = 9SE +/- 0.76, N = 3SE +/- 0.29, N = 365.9765.9165.22

Crypto++

Test: Keyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.8Test: Keyed Algorithmsv6.4v6.6 6 Octv6.5130260390520650SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3604.54604.37604.261. (CXX) g++ options: -g2 -O3 -fPIC -fno-devirtualize -pthread -pipe

Crypto++

Test: Unkeyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.8Test: Unkeyed Algorithmsv6.4v6.6 6 Octv6.5100200300400500SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3441.20440.91440.621. (CXX) g++ options: -g2 -O3 -fPIC -fno-devirtualize -pthread -pipe

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingv6.4v6.5v6.6 6 Oct60K120K180K240K300KSE +/- 2800.68, N = 3SE +/- 1889.96, N = 3SE +/- 2866.87, N = 32835562791352737311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingv6.6 6 Octv6.4v6.590K180K270K360K450KSE +/- 4588.21, N = 3SE +/- 822.46, N = 3SE +/- 3147.07, N = 34015894003703867311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Apache Hadoop

Operation: Open - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 100000v6.4v6.6 6 Octv6.560K120K180K240K300KSE +/- 9603.74, N = 15SE +/- 11689.78, N = 15SE +/- 8309.89, N = 15294150283104269810

Apache Hadoop

Operation: Open - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 100000v6.6 6 Octv6.4v6.560K120K180K240K300KSE +/- 7173.98, N = 15SE +/- 6349.18, N = 12SE +/- 14950.62, N = 12272523269034262969

Apache Hadoop

Operation: Open - Threads: 500 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 500 - Files: 100000v6.6 6 Octv6.4v6.560K120K180K240K300KSE +/- 8486.55, N = 15SE +/- 9141.48, N = 12SE +/- 20767.40, N = 15267299265652254640

Apache Hadoop

Operation: Delete - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 100000v6.4v6.6 6 Octv6.513K26K39K52K65KSE +/- 1094.57, N = 15SE +/- 925.50, N = 15SE +/- 835.38, N = 13603165805156625

Apache Hadoop

Operation: Open - Threads: 1000 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 1000 - Files: 100000v6.4v6.6 6 Octv6.560K120K180K240K300KSE +/- 5523.57, N = 15SE +/- 15981.48, N = 12SE +/- 19650.01, N = 15274610253036238253

Apache Hadoop

Operation: Create - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 1000000v6.5v6.4v6.6 6 Oct8K16K24K32K40KSE +/- 274.20, N = 11SE +/- 371.08, N = 3SE +/- 145.62, N = 3376173725435935

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5v6.4v6.6 6 Octv6.5500K1000K1500K2000K2500KSE +/- 57616.61, N = 12SE +/- 21494.50, N = 3SE +/- 31237.79, N = 152331936.552188365.952128295.601. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10v6.4v6.6 6 Octv6.5500K1000K1500K2000K2500KSE +/- 23334.59, N = 3SE +/- 26927.97, N = 3SE +/- 37051.26, N = 122262895.862231964.352068343.101. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.5v6.4v6.6 6 Oct7M14M21M28M35MSE +/- 232925.17, N = 15SE +/- 332901.55, N = 15SE +/- 327309.26, N = 5306329053018998529931254

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.6 6 Octv6.4v6.58M16M24M32M40MSE +/- 369838.39, N = 15SE +/- 432863.04, N = 15SE +/- 443563.55, N = 15391421343912205338539849

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.6 6 Octv6.5v6.45M10M15M20M25MSE +/- 173884.88, N = 12SE +/- 188478.96, N = 15SE +/- 171233.24, N = 12248390012482527224582941

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct9M18M27M36M45MSE +/- 358083.32, N = 15SE +/- 472609.51, N = 15SE +/- 465340.61, N = 3430368984214767141245153

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.6 6 Octv6.5v6.411M22M33M44M55MSE +/- 547035.26, N = 12SE +/- 410488.78, N = 15SE +/- 506247.74, N = 13527000215251989852514008

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.6 6 Octv6.5v6.49M18M27M36M45MSE +/- 384183.23, N = 15SE +/- 308400.53, N = 15SE +/- 387575.50, N = 15425600264215036841675265

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.5v6.6 6 Octv6.49M18M27M36M45MSE +/- 373729.23, N = 15SE +/- 344346.26, N = 15SE +/- 245644.87, N = 3422016964163868140520901

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.6 6 Octv6.5v6.413M26M39M52M65MSE +/- 697211.54, N = 13SE +/- 676191.00, N = 15SE +/- 581785.82, N = 15601798525967987859376956

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.5v6.4v6.6 6 Oct13M26M39M52M65MSE +/- 654921.10, N = 12SE +/- 450916.16, N = 10SE +/- 455210.13, N = 3595528475809660056839448

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct14M28M42M56M70MSE +/- 46596.93, N = 3SE +/- 691489.65, N = 3SE +/- 494444.55, N = 3670453776702375066764218

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400v6.5v6.6 6 Octv6.414M28M42M56M70MSE +/- 800541.34, N = 4SE +/- 791635.87, N = 3SE +/- 525580.37, N = 3673943236637280066098942

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.4v6.5v6.6 6 Oct11M22M33M44M55MSE +/- 482700.73, N = 15SE +/- 518637.11, N = 15SE +/- 501437.42, N = 14512482995118839850701925

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.6 6 Octv6.5v6.411M22M33M44M55MSE +/- 462612.67, N = 15SE +/- 453048.86, N = 15SE +/- 396843.42, N = 15517649195110478650423542

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.6 6 Octv6.5v6.414M28M42M56M70MSE +/- 407522.59, N = 3SE +/- 929043.22, N = 3SE +/- 690519.22, N = 3672636066655890666287906

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.5v6.6 6 Octv6.414M28M42M56M70MSE +/- 628672.36, N = 12SE +/- 718005.55, N = 3SE +/- 524197.72, N = 12660788356599846865784478

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.6 6 Octv6.4v6.516M32M48M64M80MSE +/- 658836.89, N = 3SE +/- 265706.48, N = 3SE +/- 551372.39, N = 3739201597260551370592527

NAS Parallel Benchmarks

Test / Class: BT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.Cv6.4v6.6 6 Octv6.570K140K210K280K350KSE +/- 2411.99, N = 11SE +/- 958.09, N = 3SE +/- 3511.64, N = 3322119.99312977.30306002.201. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: CG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.Cv6.6 6 Octv6.5v6.411K22K33K44K55KSE +/- 305.31, N = 3SE +/- 486.03, N = 15SE +/- 525.17, N = 653274.7952032.1051894.851. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.Cv6.4v6.6 6 Octv6.52K4K6K8K10KSE +/- 222.04, N = 12SE +/- 228.39, N = 12SE +/- 266.91, N = 1510844.9010840.5610479.791. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: FT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.Cv6.6 6 Octv6.5v6.420K40K60K80K100KSE +/- 2154.10, N = 12SE +/- 2189.90, N = 15SE +/- 1023.16, N = 15114793.58112362.39103248.131. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.Cv6.6 6 Octv6.4v6.560K120K180K240K300KSE +/- 946.75, N = 3SE +/- 2141.41, N = 3SE +/- 3576.66, N = 3273013.53269542.21268492.021. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: MG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.Cv6.6 6 Octv6.4v6.550K100K150K200K250KSE +/- 2417.02, N = 15SE +/- 2713.74, N = 15SE +/- 2603.01, N = 3239660.40239408.11234268.141. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: SP.B

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Bv6.6 6 Octv6.5v6.440K80K120K160K200KSE +/- 1609.35, N = 15SE +/- 1289.87, N = 15SE +/- 1564.28, N = 13180233.00178582.58176009.151. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: SP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Cv6.4v6.6 6 Octv6.540K80K120K160K200KSE +/- 1944.01, N = 5SE +/- 2038.85, N = 3SE +/- 2009.88, N = 3193221.95191378.82190905.821. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyv6.5v6.6 6 Octv6.4150K300K450K600K750KSE +/- 30469.92, N = 12SE +/- 23263.68, N = 9SE +/- 15922.26, N = 97008366971036402351. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Writev6.4v6.6 6 Octv6.510K20K30K40K50KSE +/- 557.77, N = 3SE +/- 508.74, N = 4SE +/- 370.85, N = 34558144504437651. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Onlyv6.5v6.6 6 Octv6.4160K320K480K640K800KSE +/- 10180.90, N = 3SE +/- 9607.07, N = 12SE +/- 9464.82, N = 37291847103897012131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Writev6.4v6.5v6.6 6 Oct9K18K27K36K45KSE +/- 535.00, N = 4SE +/- 379.56, N = 12SE +/- 434.91, N = 124294742340419611. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Onlyv6.5v6.4v6.6 6 Oct150K300K450K600K750KSE +/- 10655.35, N = 12SE +/- 8915.31, N = 12SE +/- 8415.01, N = 37144847100796854221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Writev6.5v6.6 6 Octv6.45K10K15K20K25KSE +/- 236.09, N = 3SE +/- 172.49, N = 12SE +/- 240.76, N = 122136720510204161. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Writev6.4v6.6 6 Octv6.54K8K12K16K20KSE +/- 218.15, N = 12SE +/- 216.13, N = 12SE +/- 180.45, N = 121988419714197091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct306090120150SE +/- 1.48, N = 15SE +/- 1.82, N = 15SE +/- 1.48, N = 15155.22156.06156.10MAX: 27068.23MAX: 26765.03MAX: 27008.49

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.5v6.6 6 Octv6.41632486480SE +/- 0.56, N = 15SE +/- 0.49, N = 12SE +/- 0.55, N = 1269.6569.8470.77MAX: 23930.93MAX: 23963.52MAX: 23941.04

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct20406080100SE +/- 0.96, N = 15SE +/- 1.35, N = 15SE +/- 1.57, N = 397.1699.71102.21MAX: 24088.47MAX: 24866.21MAX: 23899.32

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.6 6 Octv6.5306090120150SE +/- 1.53, N = 13SE +/- 2.12, N = 12SE +/- 1.56, N = 15125.95126.51127.67MAX: 23943.82MAX: 23988.02MAX: 23994.5

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.6 6 Octv6.5v6.41020304050SE +/- 0.42, N = 15SE +/- 0.39, N = 15SE +/- 0.46, N = 1541.7142.1942.68MAX: 18608.41MAX: 16359.93MAX: 15117.6

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.5v6.6 6 Octv6.44080120160200SE +/- 1.65, N = 15SE +/- 1.95, N = 15SE +/- 2.09, N = 3152.95153.49163.36MAX: 28282.63MAX: 27353.32MAX: 27171.99

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.6 6 Octv6.5v6.420406080100SE +/- 1.09, N = 13SE +/- 0.97, N = 15SE +/- 0.85, N = 1575.4776.5477.00MAX: 13909.62MAX: 12675.23MAX: 12622.02

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.4v6.5v6.6 6 Oct60120180240300SE +/- 3.08, N = 10SE +/- 3.68, N = 12SE +/- 0.59, N = 3265.99266.74279.15MAX: 30115.56MAX: 27647.27MAX: 29007.59

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.5v6.4v6.6 6 Oct306090120150SE +/- 1.29, N = 3SE +/- 0.10, N = 3SE +/- 1.13, N = 3111.14111.75111.92MAX: 11352.98MAX: 10157.01MAX: 10281.65

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400v6.5v6.4v6.6 6 Oct80160240320400SE +/- 5.94, N = 4SE +/- 4.26, N = 3SE +/- 4.55, N = 3368.15370.82374.60MAX: 30924.16MAX: 30958.08MAX: 29403.16

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.5v6.4v6.6 6 Oct816243240SE +/- 0.74, N = 15SE +/- 0.38, N = 15SE +/- 0.42, N = 1434.4935.3135.64MAX: 23957.29MAX: 23938.81MAX: 23906.01

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.6 6 Octv6.5v6.4306090120150SE +/- 2.18, N = 15SE +/- 1.66, N = 15SE +/- 1.11, N = 15134.57139.82140.40MAX: 27260.07MAX: 27644.97MAX: 27765.12

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.6 6 Octv6.4v6.51632486480SE +/- 0.62, N = 3SE +/- 0.22, N = 3SE +/- 1.10, N = 369.6569.8870.09MAX: 23900.31MAX: 23895.2MAX: 23936.83

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.5v6.4v6.6 6 Oct60120180240300SE +/- 2.65, N = 12SE +/- 2.23, N = 12SE +/- 4.51, N = 3273.92277.40277.50MAX: 28783.48MAX: 30379.43MAX: 28355.83

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.6 6 Octv6.4v6.520406080100SE +/- 1.01, N = 3SE +/- 0.13, N = 3SE +/- 1.12, N = 3102.90104.93108.51MAX: 23899.89MAX: 23900.89MAX: 23916.24

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.5v6.6 6 Oct306090120150SE +/- 1.28, N = 15SE +/- 1.88, N = 5127.92132.61MAX: 26759.03MAX: 25773.81

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyv6.6 6 Octv6.5v6.40.35330.70661.05991.41321.7665SE +/- 0.044, N = 9SE +/- 0.056, N = 12SE +/- 0.042, N = 91.4461.4541.5701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyv6.4v6.6 6 Octv6.548121620SE +/- 0.22, N = 3SE +/- 0.21, N = 4SE +/- 0.15, N = 317.5617.9818.281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latencyv6.5v6.6 6 Octv6.40.25670.51340.77011.02681.2835SE +/- 0.015, N = 3SE +/- 0.015, N = 12SE +/- 0.016, N = 31.0981.1281.1411. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyv6.4v6.5v6.6 6 Oct612182430SE +/- 0.29, N = 4SE +/- 0.21, N = 12SE +/- 0.25, N = 1223.3023.6423.861. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latencyv6.5v6.4v6.6 6 Oct0.32850.6570.98551.3141.6425SE +/- 0.021, N = 12SE +/- 0.018, N = 12SE +/- 0.018, N = 31.4031.4111.4601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latencyv6.5v6.6 6 Octv6.4918273645SE +/- 0.42, N = 3SE +/- 0.33, N = 12SE +/- 0.47, N = 1237.4539.0439.251. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latencyv6.4v6.5v6.6 6 Oct1122334455SE +/- 0.55, N = 12SE +/- 0.46, N = 12SE +/- 0.55, N = 1250.3650.7950.791. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.460120180240300SE +/- 0.68, N = 3SE +/- 0.39, N = 3SE +/- 1.25, N = 3231.45232.33293.60MIN: 167.08 / MAX: 429MIN: 171.26 / MAX: 448.32MIN: 175.19 / MAX: 761.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.420406080100SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.97, N = 365.4366.8377.97MIN: 52.22 / MAX: 151.59MIN: 47.69 / MAX: 144.02MIN: 47.82 / MAX: 365.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUv6.6 6 Octv6.5v6.420406080100SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.95, N = 365.4267.0177.70MIN: 51.27 / MAX: 181.2MIN: 47.99 / MAX: 141.48MIN: 49.99 / MAX: 537.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.448121620SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 612.6712.7414.35MIN: 8.91 / MAX: 252.77MIN: 8.82 / MAX: 56.2MIN: 9.07 / MAX: 112.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct70140210280350SE +/- 0.31, N = 3SE +/- 0.56, N = 3SE +/- 0.67, N = 3337.22341.06341.19MIN: 252.67 / MAX: 470.11MIN: 238.2 / MAX: 437.74MIN: 242.27 / MAX: 401.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUv6.4v6.6 6 Octv6.53691215SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 39.859.9810.15MIN: 7.51 / MAX: 55.05MIN: 7.7 / MAX: 41.05MIN: 7.22 / MAX: 47.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUv6.6 6 Octv6.5v6.4816243240SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.39, N = 331.8831.9833.21MIN: 23.76 / MAX: 159.97MIN: 23.5 / MAX: 154.49MIN: 23.34 / MAX: 169.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUv6.6 6 Octv6.5v6.4510152025SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 322.1022.2522.28MIN: 16.11 / MAX: 81MIN: 15.09 / MAX: 75.35MIN: 14.79 / MAX: 71.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.4246810SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 36.166.216.60MIN: 4.39 / MAX: 72.48MIN: 4.25 / MAX: 71.23MIN: 4.28 / MAX: 87.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.5246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 36.886.896.89MIN: 5.82 / MAX: 40.08MIN: 5.52 / MAX: 36.52MIN: 5.7 / MAX: 43.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.520406080100SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 374.1374.4074.65MIN: 53.68 / MAX: 267.9MIN: 53.51 / MAX: 281.3MIN: 56.35 / MAX: 221.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUv6.4v6.6 6 Octv6.51326395265SE +/- 0.43, N = 3SE +/- 0.54, N = 6SE +/- 0.65, N = 1555.3156.6057.84MIN: 38.54 / MAX: 312.66MIN: 39.06 / MAX: 243.12MIN: 34.52 / MAX: 409.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUv6.6 6 Octv6.5v6.40.95181.90362.85543.80724.759SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 153.673.704.23MIN: 2.51 / MAX: 63.65MIN: 2.57 / MAX: 108.71MIN: 2.61 / MAX: 111.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUv6.4v6.6 6 Octv6.548121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 317.7017.8317.93MIN: 12.28 / MAX: 42.46MIN: 12.43 / MAX: 36.82MIN: 12.49 / MAX: 40.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUv6.4v6.6 6 Octv6.5714212835SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 331.1031.1931.32MIN: 24.91 / MAX: 99.63MIN: 24.8 / MAX: 100.26MIN: 25.09 / MAX: 91.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUv6.6 6 Octv6.5v6.40.12830.25660.38490.51320.6415SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 150.530.560.57MIN: 0.37 / MAX: 56.75MIN: 0.36 / MAX: 51.75MIN: 0.29 / MAX: 74.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.51020304050SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 345.5345.6345.76MIN: 40.67 / MAX: 112.3MIN: 38.64 / MAX: 91.4MIN: 38.33 / MAX: 110.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.50.07650.1530.22950.3060.3825SE +/- 0.00, N = 15SE +/- 0.00, N = 15SE +/- 0.00, N = 150.330.340.34MIN: 0.24 / MAX: 31.45MIN: 0.25 / MAX: 36.53MIN: 0.24 / MAX: 33.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDv6.6 6 Octv6.4v6.5816243240SE +/- 0.14, N = 3SE +/- 0.23, N = 3SE +/- 0.14, N = 335.0635.2435.281. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP HotSpot3D

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP HotSpot3Dv6.4v6.5v6.6 6 Oct20406080100SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 1.06, N = 1580.6480.7883.831. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP Leukocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Leukocytev6.5v6.6 6 Octv6.4816243240SE +/- 0.08, N = 3SE +/- 0.40, N = 3SE +/- 0.52, N = 1531.4932.1834.171. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP CFD Solverv6.6 6 Octv6.4v6.5246810SE +/- 0.076, N = 3SE +/- 0.058, N = 3SE +/- 0.093, N = 38.1648.7138.8861. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Streamclusterv6.4v6.5v6.6 6 Oct1122334455SE +/- 2.00, N = 15SE +/- 0.58, N = 3SE +/- 2.47, N = 1542.6145.6747.371. (CXX) g++ options: -O2 -lOpenCL

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh Timev6.6 6 Octv6.5v6.491827364537.3538.4939.361. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution Timev6.5v6.6 6 Octv6.491827364536.7737.0237.841. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh Timev6.5v6.6 6 Octv6.44080120160200174.04175.39175.931. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution Timev6.4v6.5v6.6 6 Oct50100150200250195.89197.95206.431. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper Beamv6.6 6 Octv6.4v6.520406080100SE +/- 0.37, N = 3SE +/- 0.64, N = 3SE +/- 0.23, N = 395.0895.1796.05

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1Mv6.4v6.6 6 Octv6.5306090120150SE +/- 0.01, N = 3SE +/- 0.37, N = 3SE +/- 1.07, N = 3128.50129.79130.43

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop Testv6.4v6.6 6 Octv6.5816243240SE +/- 0.01, N = 3SE +/- 0.25, N = 3SE +/- 0.17, N = 332.3733.3433.81

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on Windshieldv6.4v6.5v6.6 6 Oct4080120160200SE +/- 0.82, N = 3SE +/- 0.28, N = 3SE +/- 0.50, N = 3159.21159.91161.95

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal Installationv6.4v6.6 6 Octv6.5306090120150SE +/- 0.71, N = 3SE +/- 0.19, N = 3SE +/- 0.71, N = 3116.35116.46119.47

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop Containerv6.6 6 Octv6.4v6.5306090120150SE +/- 0.74, N = 3SE +/- 0.42, N = 3SE +/- 0.29, N = 3138.78138.97141.85

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0v6.6 6 Octv6.4v6.51632486480SE +/- 0.55, N = 3SE +/- 0.04, N = 3SE +/- 0.81, N = 369.5970.7470.881. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2v6.5v6.6 6 Octv6.4918273645SE +/- 0.53, N = 3SE +/- 0.17, N = 3SE +/- 0.32, N = 338.6438.6739.371. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6v6.5v6.4v6.6 6 Oct0.84511.69022.53533.38044.2255SE +/- 0.024, N = 15SE +/- 0.005, N = 3SE +/- 0.040, N = 43.6813.7283.7561. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslessv6.5v6.6 6 Octv6.4246810SE +/- 0.032, N = 3SE +/- 0.016, N = 3SE +/- 0.054, N = 36.7666.8446.8921. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, Losslessv6.5v6.6 6 Octv6.41.14192.28383.42574.56765.7095SE +/- 0.009, N = 3SE +/- 0.029, N = 3SE +/- 0.005, N = 35.0585.0645.0751. (CXX) g++ options: -O3 -fPIC -lm

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigv6.4v6.6 6 Octv6.5918273645SE +/- 0.29, N = 10SE +/- 0.47, N = 4SE +/- 0.37, N = 637.3237.8138.19

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigv6.4v6.6 6 Octv6.560120180240300SE +/- 1.69, N = 3SE +/- 0.32, N = 3SE +/- 0.37, N = 3288.41289.51289.55

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Ninjav6.4v6.6 6 Octv6.54080120160200SE +/- 3.13, N = 12SE +/- 1.03, N = 3SE +/- 1.10, N = 3187.32191.77192.79

Timed LLVM Compilation

Build System: Unix Makefiles

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix Makefilesv6.5v6.4v6.6 6 Oct60120180240300SE +/- 3.67, N = 3SE +/- 2.50, N = 3SE +/- 2.96, N = 9274.65275.09275.55

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlyv6.6 6 Octv6.4v6.5510152025SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 321.1221.4821.96

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlyv6.6 6 Octv6.4v6.51224364860SE +/- 0.24, N = 3SE +/- 0.28, N = 3SE +/- 0.26, N = 353.1153.1454.01

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlyv6.4v6.6 6 Octv6.5918273645SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.41, N = 1540.1240.4241.62

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlyv6.4v6.5v6.6 6 Oct80160240320400SE +/- 4.74, N = 9SE +/- 14.36, N = 9SE +/- 11.89, N = 9315.02336.42385.35

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlyv6.5v6.4v6.6 6 Oct20406080100SE +/- 0.56, N = 3SE +/- 0.36, N = 3SE +/- 0.83, N = 473.8774.8875.58

Phoronix Test Suite v10.8.5