Intel Xeon Max Linux Kernels

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2310079-NE-XEONMAXLI86&sor&grs.

Intel Xeon Max Linux KernelsProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolutionv6.4v6.5v6.6 6 Oct2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads)Supermicro X13DEM v1.10 (1.3 BIOS)Intel Device 1bce512GB2 x 7682GB INTEL SSDPF2KX076TZASPEEDVE2282 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200GbUbuntu 23.046.4.0-060400-generic (x86_64)GNOME Shell 44.0X Server 1.21.1.7GCC 12.2.0ext41920x10806.5.0-060500-generic (x86_64)1024x7686.6.0-060600rc4daily20231006-generic (x86_64)1920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Pa930Z/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c0001d1Java Details- OpenJDK Runtime Environment (build 17.0.6+10-Ubuntu-1ubuntu2)Python Details- Python 3.11.2Security Details- v6.4: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - v6.5: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - v6.6 6 Oct: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Intel Xeon Max Linux Kernelsstress-ng: IO_uringstress-ng: CPU Cacheopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUstress-ng: NUMAopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUstress-ng: Semaphoresopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUstress-ng: System V Message Passingrodinia: OpenMP CFD Solverrodinia: OpenMP Leukocyteopenvino: Weld Porosity Detection FP16 - CPUstress-ng: AVX-512 VNNIstress-ng: Floating Pointstress-ng: Glibc C String Functionsstress-ng: Fused Multiply-Addopenvino: Weld Porosity Detection FP16 - CPUstress-ng: Function Callstress-ng: Vector Mathapache-iotdb: 500 - 100 - 200 - 400apache-iotdb: 800 - 100 - 800 - 100aom-av1: Speed 0 Two-Pass - Bosphorus 4Kopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenfoam: drivaerFastback, Small Mesh Size - Mesh Timenpb: BT.Capache-iotdb: 200 - 100 - 500 - 100openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUapache-iotdb: 500 - 100 - 500 - 400stress-ng: MMAPpgbench: 1000 - 800 - Read Write - Average Latencyapache-iotdb: 500 - 100 - 500 - 400apache-iotdb: 800 - 100 - 800 - 100hadoop: Create - 50 - 1000000pgbench: 1000 - 800 - Read Writeopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenradioss: Cell Phone Drop Testsvt-av1: Preset 4 - Bosphorus 1080papache-iotdb: 200 - 100 - 500 - 100nekrs: TurboPipe Periodicpgbench: 1000 - 1000 - Read Onlyopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUpgbench: 100 - 800 - Read Writeapache-iotdb: 500 - 100 - 200 - 400pgbench: 100 - 800 - Read Write - Average Latencypgbench: 1000 - 1000 - Read Only - Average Latencypgbench: 1000 - 800 - Read Onlyblender: BMW27 - CPU-Onlyrodinia: OpenMP HotSpot3Dpgbench: 1000 - 800 - Read Only - Average Latencyhpcg: 144 144 144 - 60compress-7zip: Decompression Ratingblender: Fishy Cat - CPU-Onlytensorflow: CPU - 16 - ResNet-50apache-iotdb: 100 - 100 - 500 - 100compress-7zip: Compression Ratingstress-ng: AVL Treetensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 32 - ResNet-50openvino: Face Detection Retail FP16 - CPUstress-ng: Vector Floating Pointopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUstress-ng: Glibc Qsort Data Sortingopenfoam: drivaerFastback, Small Mesh Size - Execution Timebuild-llvm: Ninjahpcg: 104 104 104 - 60svt-av1: Preset 4 - Bosphorus 4Kopenradioss: Rubber O-Ring Seal Installationapache-iotdb: 800 - 100 - 200 - 400npb: CG.Cstress-ng: CPU Stresspgbench: 100 - 1000 - Read Write - Average Latencynpb: SP.Bstress-ng: Vector Shufflepgbench: 100 - 1000 - Read Writeapache-iotdb: 100 - 100 - 500 - 100build-linux-kernel: defconfigstress-ng: Mallocapache-iotdb: 500 - 100 - 200 - 100blender: Pabellon Barcelona - CPU-Onlynpb: MG.Copenradioss: INIVOL and Fluid Structure Interaction Drop Containerapache-iotdb: 500 - 100 - 200 - 100avifenc: 6apache-iotdb: 500 - 100 - 500 - 100vvenc: Bosphorus 4K - Fastapache-iotdb: 500 - 100 - 800 - 400avifenc: 2stress-ng: Zlibavifenc: 6, Losslessavifenc: 0apache-iotdb: 500 - 100 - 800 - 400openradioss: Bird Strike on Windshieldstress-ng: x86_64 RdRandblender: Classroom - CPU-Onlynpb: LU.Capache-iotdb: 200 - 100 - 200 - 100apache-iotdb: 100 - 100 - 800 - 100openradioss: Chrysler Neon 1Mapache-iotdb: 800 - 100 - 500 - 100apache-iotdb: 200 - 100 - 800 - 100apache-iotdb: 500 - 100 - 500 - 100openvino: Person Vehicle Bike Detection FP16 - CPUapache-iotdb: 800 - 100 - 500 - 400openvino: Person Vehicle Bike Detection FP16 - CPUnpb: SP.Copenvino: Face Detection FP16-INT8 - CPUtensorflow: CPU - 256 - ResNet-50openvino: Face Detection FP16-INT8 - CPUopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeapache-iotdb: 800 - 100 - 200 - 100apache-iotdb: 200 - 100 - 200 - 100openradioss: Bumper Beamnekrs: Kershawpgbench: 1000 - 1000 - Read Writepgbench: 1000 - 1000 - Read Write - Average Latencyopenvino: Vehicle Detection FP16-INT8 - CPUvvenc: Bosphorus 1080p - Fastopenvino: Handwritten English Recognition FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUapache-iotdb: 500 - 100 - 800 - 100openvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUapache-iotdb: 800 - 100 - 500 - 100rodinia: OpenMP LavaMDapache-iotdb: 100 - 100 - 800 - 100openvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUapache-iotdb: 800 - 100 - 500 - 400apache-iotdb: 500 - 100 - 800 - 100build-linux-kernel: allmodconfigapache-iotdb: 200 - 100 - 800 - 100avifenc: 10, Losslessbuild-llvm: Unix Makefilesopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUcryptopp: Unkeyed Algorithmscryptopp: Keyed Algorithmshadoop: Open - 1000 - 100000hadoop: Delete - 50 - 100000hadoop: Open - 500 - 100000hadoop: Open - 100 - 100000hadoop: Open - 50 - 100000openvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUblender: Barbershop - CPU-Onlystress-ng: Wide Vector Mathstress-ng: Memory Copyingstress-ng: Matrix 3D Mathstress-ng: Matrix Mathstress-ng: Pthreadstress-ng: Mutexstress-ng: Pipestress-ng: Hashmemtier-benchmark: Redis - 100 - 1:10memtier-benchmark: Redis - 50 - 1:5pgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlyapache-iotdb: 800 - 100 - 200 - 400apache-iotdb: 800 - 100 - 200 - 100vvenc: Bosphorus 1080p - Fastervvenc: Bosphorus 4K - Fastersvt-av1: Preset 13 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Kaom-av1: Speed 11 Realtime - Bosphorus 4Kaom-av1: Speed 10 Realtime - Bosphorus 4Kaom-av1: Speed 9 Realtime - Bosphorus 4Kaom-av1: Speed 8 Realtime - Bosphorus 4Kaom-av1: Speed 6 Two-Pass - Bosphorus 4Kaom-av1: Speed 6 Realtime - Bosphorus 4Kaom-av1: Speed 4 Two-Pass - Bosphorus 4Krodinia: OpenMP Streamclusternpb: FT.Cnpb: EP.Cv6.4v6.5v6.6 6 Oct2619140.96938764.06125.69293.6514.09474.0577.97475.6677.7025464.62177471711.514.2314.352572.6318811154.408.71334.17316690.3611752668.1831253.9381547074.59253366692.276.6063249.99381412.82163.36104.930.39195.8876439.359594322119.9997.16112475.34265.997996.7839.2455809660072605513372542041655.31667.6432.3711.5894303689840989533337100791112.4633.21455814052090117.5561.41170121321.4880.6441.14176.578540037040.1236.85283556790.2353.0445.209.85244931.410.3411342.541875.8337.840712187.322104.6774.132116.355042354251894.85200494.8023.296176009.15551599.32429473018998537.316217211109.0342.6874.88239408.11138.97416752653.72877.005.0756609894239.3718220.836.89270.735370.82159.21637179.5253.14269542.2170.7739122053128.5066287906125.95593769566316.44277.4017.70193221.95337.2265.22331.20175.9258512482992458294195.1758659833331988450.35822.2816.33631.105018.03111.7574.403597.651503.5469.8835.243155.2245.632452.146578447867045377288.412525140085.075275.08516182.556.89441.196989604.541642274610603162656522690342941500.5774954.03315.025961543.1225816.5028901.02396715.1836288.2423140484.1431203885.9817389901.322262895.862331936.551.570640235140.4035.3128.2708.450518.769426.842145.915133.92649.0944.2347.5441.6714.3041.517.0742.605103248.1310844.902557131.35827481.85159.00232.33575.37553.1566.83551.6667.0129736.31154525821.933.7012.742896.6119106643.998.88631.48617909.2811016794.4129342.6777642781.17243730838.966.2161230.89359634.35152.95108.510.39197.949238.494557306002.2099.71111886.46266.748195.8737.4515955284770592527376172136757.84639.0833.8111.1024214767141014900007144841155.6431.98437654220169618.2821.40372918421.9680.7821.09873.732738673141.6238.22127.92279135794.3051.4246.4110.15240694.160.3411013.291916.2036.766298192.791102.1944.016119.475110478652032.10198750.3523.639178582.58549410.10423403063290538.190219735444.0542.1973.87234268.14141.85421503683.68176.545.1756739432338.6358330.226.76670.881368.15159.91648063.9154.01268492.0269.6538539849130.4366558906127.67596798786234.83273.9217.93190905.82341.0665.91327.68174.04396511883982482527296.0558092200001970950.78522.2516.28231.325018.07111.1474.653572.891498.5670.0935.282156.0645.762445.546607883567023750289.545525198985.058274.64916152.106.89440.622846604.262966238253566252546402629692698100.5694168.28336.425808342.7425493.2632314.93349646.8938759.7425266270.1638337996.3716889506.122068343.102128295.601.454700836139.8234.4928.7178.500459.292406.640112.258114.31845.4551.6045.1442.3814.0942.427.7245.672112362.3910479.793424829.35709241.85159.56231.45474.39564.9165.43565.0265.4229779.38180684828.433.6712.672911.4417488847.838.16432.17818105.6311946993.7031541.6683443787.58261241623.386.1665566.39384963.64153.49102.900.37206.4271537.35353312977.30102.21117557.36279.158382.5439.0365683944873920159359352051056.60652.7733.3411.5634124515342728033336854221159.2031.88445044163868117.9831.46071038921.1283.8281.12874.265440158940.4238.01132.61273731816.1651.4046.639.98248017.780.3311190.461931.8337.023041191.766101.7384.120116.465176491953274.79203979.8323.860180233.00562355.24419612993125437.808222268148.7641.7175.58239660.40138.78425600263.75675.475.0766637280038.6708374.586.84469.590374.60161.95642917.3053.11273013.5369.8439142134129.7967263606126.51601798526265.86277.5017.83191378.82341.1965.97327.61175.38684507019252483900195.0858170966671971450.79122.1016.40331.195053.25111.9274.133587.671508.7769.6535.062156.1045.532457.576599846866764218289.507527000215.064275.54516160.296.88440.910407604.369921253036580512672992725232831040.5393693.64385.356205140.9925800.0630007.33370932.9835491.6227388113.6327024816.2618109792.852231964.352188365.951.446697103134.5735.6427.3318.326468.568431.133116.735122.11648.2147.1846.0841.9512.3845.277.1347.370114793.5810840.56OpenBenchmarking.org

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringv6.6 6 Octv6.4v6.5700K1400K2100K2800K3500KSE +/- 44896.75, N = 3SE +/- 33896.79, N = 15SE +/- 24671.90, N = 153424829.352619140.962557131.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cachev6.4v6.5v6.6 6 Oct200K400K600K800K1000KSE +/- 7749.59, N = 3SE +/- 4820.43, N = 3SE +/- 1835.02, N = 3938764.06827481.85709241.851. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.44080120160200SE +/- 0.46, N = 3SE +/- 0.26, N = 3SE +/- 0.59, N = 3159.56159.00125.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.460120180240300SE +/- 0.68, N = 3SE +/- 0.39, N = 3SE +/- 1.25, N = 3231.45232.33293.60MIN: 167.08 / MAX: 429MIN: 171.26 / MAX: 448.32MIN: 175.19 / MAX: 761.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMAv6.5v6.4v6.6 6 Oct120240360480600SE +/- 2.88, N = 3SE +/- 7.82, N = 15SE +/- 1.03, N = 3575.37514.09474.391. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.4120240360480600SE +/- 0.67, N = 3SE +/- 0.50, N = 3SE +/- 5.93, N = 3564.91553.15474.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.420406080100SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.97, N = 365.4366.8377.97MIN: 52.22 / MAX: 151.59MIN: 47.69 / MAX: 144.02MIN: 47.82 / MAX: 365.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUv6.6 6 Octv6.5v6.4120240360480600SE +/- 0.92, N = 3SE +/- 0.11, N = 3SE +/- 5.84, N = 3565.02551.66475.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUv6.6 6 Octv6.5v6.420406080100SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.95, N = 365.4267.0177.70MIN: 51.27 / MAX: 181.2MIN: 47.99 / MAX: 141.48MIN: 49.99 / MAX: 537.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUv6.6 6 Octv6.5v6.46K12K18K24K30KSE +/- 186.80, N = 3SE +/- 236.24, N = 3SE +/- 231.74, N = 1529779.3829736.3125464.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphoresv6.6 6 Octv6.4v6.540M80M120M160M200MSE +/- 1941141.12, N = 5SE +/- 1308655.40, N = 3SE +/- 1418717.66, N = 3180684828.43177471711.51154525821.931. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUv6.6 6 Octv6.5v6.40.95181.90362.85543.80724.759SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 153.673.704.23MIN: 2.51 / MAX: 63.65MIN: 2.57 / MAX: 108.71MIN: 2.61 / MAX: 111.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.448121620SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 612.6712.7414.35MIN: 8.91 / MAX: 252.77MIN: 8.82 / MAX: 56.2MIN: 9.07 / MAX: 112.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.46001200180024003000SE +/- 0.78, N = 3SE +/- 8.62, N = 3SE +/- 24.17, N = 62911.442896.612572.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passingv6.5v6.4v6.6 6 Oct4M8M12M16M20MSE +/- 57359.04, N = 3SE +/- 54732.60, N = 3SE +/- 6699.83, N = 319106643.9918811154.4017488847.831. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP CFD Solverv6.6 6 Octv6.4v6.5246810SE +/- 0.076, N = 3SE +/- 0.058, N = 3SE +/- 0.093, N = 38.1648.7138.8861. (CXX) g++ options: -O2 -lOpenCL

Rodinia

Test: OpenMP Leukocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Leukocytev6.5v6.6 6 Octv6.4816243240SE +/- 0.08, N = 3SE +/- 0.40, N = 3SE +/- 0.52, N = 1531.4932.1834.171. (CXX) g++ options: -O2 -lOpenCL

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.44K8K12K16K20KSE +/- 116.21, N = 3SE +/- 92.46, N = 3SE +/- 240.02, N = 318105.6317909.2816690.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: AVX-512 VNNI

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNIv6.6 6 Octv6.4v6.53M6M9M12M15MSE +/- 45820.46, N = 3SE +/- 48287.23, N = 3SE +/- 137441.83, N = 311946993.7011752668.1811016794.411. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Pointv6.6 6 Octv6.4v6.57K14K21K28K35KSE +/- 238.47, N = 10SE +/- 348.48, N = 15SE +/- 305.43, N = 331541.6631253.9329342.671. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functionsv6.6 6 Octv6.4v6.520M40M60M80M100MSE +/- 772766.53, N = 15SE +/- 906580.48, N = 15SE +/- 1000931.10, N = 1583443787.5881547074.5977642781.171. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Addv6.6 6 Octv6.4v6.560M120M180M240M300MSE +/- 480576.96, N = 3SE +/- 2984105.55, N = 15SE +/- 3180404.53, N = 3261241623.38253366692.27243730838.961. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUv6.6 6 Octv6.5v6.4246810SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 36.166.216.60MIN: 4.39 / MAX: 72.48MIN: 4.25 / MAX: 71.23MIN: 4.28 / MAX: 87.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Callv6.6 6 Octv6.4v6.514K28K42K56K70KSE +/- 112.81, N = 3SE +/- 811.29, N = 15SE +/- 545.69, N = 1565566.3963249.9961230.891. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Mathv6.6 6 Octv6.4v6.580K160K240K320K400KSE +/- 522.79, N = 3SE +/- 3943.55, N = 5SE +/- 3836.13, N = 3384963.64381412.82359634.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.5v6.6 6 Octv6.44080120160200SE +/- 1.65, N = 15SE +/- 1.95, N = 15SE +/- 2.09, N = 3152.95153.49163.36MAX: 28282.63MAX: 27353.32MAX: 27171.99

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.6 6 Octv6.4v6.520406080100SE +/- 1.01, N = 3SE +/- 0.13, N = 3SE +/- 1.12, N = 3102.90104.93108.51MAX: 23899.89MAX: 23900.89MAX: 23916.24

AOM AV1

Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4Kv6.5v6.4v6.6 6 Oct0.08780.17560.26340.35120.439SE +/- 0.00, N = 15SE +/- 0.00, N = 15SE +/- 0.01, N = 150.390.390.371. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution Timev6.4v6.5v6.6 6 Oct50100150200250195.89197.95206.431. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh Timev6.6 6 Octv6.5v6.491827364537.3538.4939.361. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

NAS Parallel Benchmarks

Test / Class: BT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.Cv6.4v6.6 6 Octv6.570K140K210K280K350KSE +/- 2411.99, N = 11SE +/- 958.09, N = 3SE +/- 3511.64, N = 3322119.99312977.30306002.201. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct20406080100SE +/- 0.96, N = 15SE +/- 1.35, N = 15SE +/- 1.57, N = 397.1699.71102.21MAX: 24088.47MAX: 24866.21MAX: 23899.32

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.530K60K90K120K150KSE +/- 837.50, N = 15SE +/- 1041.05, N = 15SE +/- 1061.43, N = 15117557.36112475.34111886.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.4v6.5v6.6 6 Oct60120180240300SE +/- 3.08, N = 10SE +/- 3.68, N = 12SE +/- 0.59, N = 3265.99266.74279.15MAX: 30115.56MAX: 27647.27MAX: 29007.59

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPv6.6 6 Octv6.5v6.42K4K6K8K10KSE +/- 76.34, N = 3SE +/- 60.98, N = 3SE +/- 47.78, N = 38382.548195.877996.781. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Write - Average Latencyv6.5v6.6 6 Octv6.4918273645SE +/- 0.42, N = 3SE +/- 0.33, N = 12SE +/- 0.47, N = 1237.4539.0439.251. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.5v6.4v6.6 6 Oct13M26M39M52M65MSE +/- 654921.10, N = 12SE +/- 450916.16, N = 10SE +/- 455210.13, N = 3595528475809660056839448

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.6 6 Octv6.4v6.516M32M48M64M80MSE +/- 658836.89, N = 3SE +/- 265706.48, N = 3SE +/- 551372.39, N = 3739201597260551370592527

Apache Hadoop

Operation: Create - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 1000000v6.5v6.4v6.6 6 Oct8K16K24K32K40KSE +/- 274.20, N = 11SE +/- 371.08, N = 3SE +/- 145.62, N = 3376173725435935

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Writev6.5v6.6 6 Octv6.45K10K15K20K25KSE +/- 236.09, N = 3SE +/- 172.49, N = 12SE +/- 240.76, N = 122136720510204161. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUv6.4v6.6 6 Octv6.51326395265SE +/- 0.43, N = 3SE +/- 0.54, N = 6SE +/- 0.65, N = 1555.3156.6057.84MIN: 38.54 / MAX: 312.66MIN: 39.06 / MAX: 243.12MIN: 34.52 / MAX: 409.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUv6.4v6.6 6 Octv6.5140280420560700SE +/- 5.12, N = 3SE +/- 6.10, N = 6SE +/- 7.36, N = 15667.64652.77639.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop Testv6.4v6.6 6 Octv6.5816243240SE +/- 0.01, N = 3SE +/- 0.25, N = 3SE +/- 0.17, N = 332.3733.3433.81

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080pv6.4v6.6 6 Octv6.53691215SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 311.5911.5611.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.4v6.5v6.6 6 Oct9M18M27M36M45MSE +/- 358083.32, N = 15SE +/- 472609.51, N = 15SE +/- 465340.61, N = 3430368984214767141245153

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicv6.6 6 Octv6.5v6.4900M1800M2700M3600M4500MSE +/- 4200842.51, N = 3SE +/- 30449494.25, N = 3SE +/- 40424400.36, N = 34272803333410149000040989533331. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Onlyv6.5v6.4v6.6 6 Oct150K300K450K600K750KSE +/- 10655.35, N = 12SE +/- 8915.31, N = 12SE +/- 8415.01, N = 37144847100796854221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUv6.6 6 Octv6.5v6.42004006008001000SE +/- 1.66, N = 3SE +/- 1.10, N = 3SE +/- 13.29, N = 31159.201155.641112.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUv6.6 6 Octv6.5v6.4816243240SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.39, N = 331.8831.9833.21MIN: 23.76 / MAX: 159.97MIN: 23.5 / MAX: 154.49MIN: 23.34 / MAX: 169.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Writev6.4v6.6 6 Octv6.510K20K30K40K50KSE +/- 557.77, N = 3SE +/- 508.74, N = 4SE +/- 370.85, N = 34558144504437651. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.5v6.6 6 Octv6.49M18M27M36M45MSE +/- 373729.23, N = 15SE +/- 344346.26, N = 15SE +/- 245644.87, N = 3422016964163868140520901

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyv6.4v6.6 6 Octv6.548121620SE +/- 0.22, N = 3SE +/- 0.21, N = 4SE +/- 0.15, N = 317.5617.9818.281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Only - Average Latencyv6.5v6.4v6.6 6 Oct0.32850.6570.98551.3141.6425SE +/- 0.021, N = 12SE +/- 0.018, N = 12SE +/- 0.018, N = 31.4031.4111.4601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Onlyv6.5v6.6 6 Octv6.4160K320K480K640K800KSE +/- 10180.90, N = 3SE +/- 9607.07, N = 12SE +/- 9464.82, N = 37291847103897012131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlyv6.6 6 Octv6.4v6.5510152025SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.18, N = 321.1221.4821.96

Rodinia

Test: OpenMP HotSpot3D

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP HotSpot3Dv6.4v6.5v6.6 6 Oct20406080100SE +/- 0.21, N = 3SE +/- 0.17, N = 3SE +/- 1.06, N = 1580.6480.7883.831. (CXX) g++ options: -O2 -lOpenCL

PostgreSQL

Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 800 - Mode: Read Only - Average Latencyv6.5v6.6 6 Octv6.40.25670.51340.77011.02681.2835SE +/- 0.015, N = 3SE +/- 0.015, N = 12SE +/- 0.016, N = 31.0981.1281.1411. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

High Performance Conjugate Gradient

X Y Z: 144 144 144 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60v6.4v6.6 6 Octv6.520406080100SE +/- 0.76, N = 6SE +/- 0.42, N = 3SE +/- 0.98, N = 976.5874.2773.731. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingv6.6 6 Octv6.4v6.590K180K270K360K450KSE +/- 4588.21, N = 3SE +/- 822.46, N = 3SE +/- 3147.07, N = 34015894003703867311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlyv6.4v6.6 6 Octv6.5918273645SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.41, N = 1540.1240.4241.62

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50v6.5v6.6 6 Octv6.4918273645SE +/- 0.31, N = 9SE +/- 0.38, N = 15SE +/- 0.35, N = 338.2238.0136.85

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.5v6.6 6 Oct306090120150SE +/- 1.28, N = 15SE +/- 1.88, N = 5127.92132.61MAX: 26759.03MAX: 25773.81

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingv6.4v6.5v6.6 6 Oct60K120K180K240K300KSE +/- 2800.68, N = 3SE +/- 1889.96, N = 3SE +/- 2866.87, N = 32835562791352737311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Treev6.6 6 Octv6.5v6.42004006008001000SE +/- 1.34, N = 3SE +/- 2.77, N = 3SE +/- 1.81, N = 3816.16794.30790.231. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50v6.4v6.5v6.6 6 Oct1224364860SE +/- 0.72, N = 3SE +/- 0.49, N = 12SE +/- 0.57, N = 353.0451.4251.40

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50v6.6 6 Octv6.5v6.41122334455SE +/- 0.66, N = 3SE +/- 0.58, N = 12SE +/- 0.54, N = 346.6346.4145.20

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUv6.4v6.6 6 Octv6.53691215SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 39.859.9810.15MIN: 7.51 / MAX: 55.05MIN: 7.7 / MAX: 41.05MIN: 7.22 / MAX: 47.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Pointv6.6 6 Octv6.4v6.550K100K150K200K250KSE +/- 1538.11, N = 3SE +/- 620.60, N = 3SE +/- 1308.77, N = 3248017.78244931.41240694.161. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.50.07650.1530.22950.3060.3825SE +/- 0.00, N = 15SE +/- 0.00, N = 15SE +/- 0.00, N = 150.330.340.34MIN: 0.24 / MAX: 31.45MIN: 0.25 / MAX: 36.53MIN: 0.24 / MAX: 33.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUv6.4v6.6 6 Octv6.52K4K6K8K10KSE +/- 16.48, N = 3SE +/- 21.17, N = 3SE +/- 10.14, N = 311342.5411190.4611013.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sortingv6.6 6 Octv6.5v6.4400800120016002000SE +/- 5.70, N = 3SE +/- 3.46, N = 3SE +/- 0.72, N = 31931.831916.201875.831. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution Timev6.5v6.6 6 Octv6.491827364536.7737.0237.841. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Ninjav6.4v6.6 6 Octv6.54080120160200SE +/- 3.13, N = 12SE +/- 1.03, N = 3SE +/- 1.10, N = 3187.32191.77192.79

High Performance Conjugate Gradient

X Y Z: 104 104 104 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 104 104 104 - RT: 60v6.4v6.5v6.6 6 Oct20406080100SE +/- 0.65, N = 3SE +/- 0.94, N = 3SE +/- 0.92, N = 3104.68102.19101.741. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.50.92971.85942.78913.71884.6485SE +/- 0.031, N = 15SE +/- 0.030, N = 11SE +/- 0.040, N = 64.1324.1204.0161. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal Installationv6.4v6.6 6 Octv6.5306090120150SE +/- 0.71, N = 3SE +/- 0.19, N = 3SE +/- 0.71, N = 3116.35116.46119.47

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.6 6 Octv6.5v6.411M22M33M44M55MSE +/- 462612.67, N = 15SE +/- 453048.86, N = 15SE +/- 396843.42, N = 15517649195110478650423542

NAS Parallel Benchmarks

Test / Class: CG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.Cv6.6 6 Octv6.5v6.411K22K33K44K55KSE +/- 305.31, N = 3SE +/- 486.03, N = 15SE +/- 525.17, N = 653274.7952032.1051894.851. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stressv6.6 6 Octv6.4v6.540K80K120K160K200KSE +/- 692.17, N = 3SE +/- 341.26, N = 3SE +/- 1870.15, N = 13203979.83200494.80198750.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyv6.4v6.5v6.6 6 Oct612182430SE +/- 0.29, N = 4SE +/- 0.21, N = 12SE +/- 0.25, N = 1223.3023.6423.861. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

NAS Parallel Benchmarks

Test / Class: SP.B

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Bv6.6 6 Octv6.5v6.440K80K120K160K200KSE +/- 1609.35, N = 15SE +/- 1289.87, N = 15SE +/- 1564.28, N = 13180233.00178582.58176009.151. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shufflev6.6 6 Octv6.4v6.5120K240K360K480K600KSE +/- 838.85, N = 3SE +/- 1079.72, N = 3SE +/- 652.21, N = 3562355.24551599.32549410.101. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Writev6.4v6.5v6.6 6 Oct9K18K27K36K45KSE +/- 535.00, N = 4SE +/- 379.56, N = 12SE +/- 434.91, N = 124294742340419611. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.5v6.4v6.6 6 Oct7M14M21M28M35MSE +/- 232925.17, N = 15SE +/- 332901.55, N = 15SE +/- 327309.26, N = 5306329053018998529931254

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigv6.4v6.6 6 Octv6.5918273645SE +/- 0.29, N = 10SE +/- 0.47, N = 4SE +/- 0.37, N = 637.3237.8138.19

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mallocv6.6 6 Octv6.5v6.450M100M150M200M250MSE +/- 619909.09, N = 3SE +/- 655876.42, N = 3SE +/- 129847.43, N = 3222268148.76219735444.05217211109.031. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.6 6 Octv6.5v6.41020304050SE +/- 0.42, N = 15SE +/- 0.39, N = 15SE +/- 0.46, N = 1541.7142.1942.68MAX: 18608.41MAX: 16359.93MAX: 15117.6

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlyv6.5v6.4v6.6 6 Oct20406080100SE +/- 0.56, N = 3SE +/- 0.36, N = 3SE +/- 0.83, N = 473.8774.8875.58

NAS Parallel Benchmarks

Test / Class: MG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.Cv6.6 6 Octv6.4v6.550K100K150K200K250KSE +/- 2417.02, N = 15SE +/- 2713.74, N = 15SE +/- 2603.01, N = 3239660.40239408.11234268.141. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop Containerv6.6 6 Octv6.4v6.5306090120150SE +/- 0.74, N = 3SE +/- 0.42, N = 3SE +/- 0.29, N = 3138.78138.97141.85

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.6 6 Octv6.5v6.49M18M27M36M45MSE +/- 384183.23, N = 15SE +/- 308400.53, N = 15SE +/- 387575.50, N = 15425600264215036841675265

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6v6.5v6.4v6.6 6 Oct0.84511.69022.53533.38044.2255SE +/- 0.024, N = 15SE +/- 0.005, N = 3SE +/- 0.040, N = 43.6813.7283.7561. (CXX) g++ options: -O3 -fPIC -lm

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.6 6 Octv6.5v6.420406080100SE +/- 1.09, N = 13SE +/- 0.97, N = 15SE +/- 0.85, N = 1575.4776.5477.00MAX: 13909.62MAX: 12675.23MAX: 12622.02

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fastv6.5v6.6 6 Octv6.41.16442.32883.49324.65765.822SE +/- 0.066, N = 3SE +/- 0.064, N = 12SE +/- 0.058, N = 35.1755.0765.0751. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400v6.5v6.6 6 Octv6.414M28M42M56M70MSE +/- 800541.34, N = 4SE +/- 791635.87, N = 3SE +/- 525580.37, N = 3673943236637280066098942

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2v6.5v6.6 6 Octv6.4918273645SE +/- 0.53, N = 3SE +/- 0.17, N = 3SE +/- 0.32, N = 338.6438.6739.371. (CXX) g++ options: -O3 -fPIC -lm

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlibv6.6 6 Octv6.5v6.42K4K6K8K10KSE +/- 11.00, N = 3SE +/- 29.13, N = 3SE +/- 22.76, N = 38374.588330.228220.831. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslessv6.5v6.6 6 Octv6.4246810SE +/- 0.032, N = 3SE +/- 0.016, N = 3SE +/- 0.054, N = 36.7666.8446.8921. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0v6.6 6 Octv6.4v6.51632486480SE +/- 0.55, N = 3SE +/- 0.04, N = 3SE +/- 0.81, N = 369.5970.7470.881. (CXX) g++ options: -O3 -fPIC -lm

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400v6.5v6.4v6.6 6 Oct80160240320400SE +/- 5.94, N = 4SE +/- 4.26, N = 3SE +/- 4.55, N = 3368.15370.82374.60MAX: 30924.16MAX: 30958.08MAX: 29403.16

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on Windshieldv6.4v6.5v6.6 6 Oct4080120160200SE +/- 0.82, N = 3SE +/- 0.28, N = 3SE +/- 0.50, N = 3159.21159.91161.95

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRandv6.5v6.6 6 Octv6.4140K280K420K560K700KSE +/- 196.88, N = 3SE +/- 280.73, N = 3SE +/- 674.33, N = 3648063.91642917.30637179.521. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlyv6.6 6 Octv6.4v6.51224364860SE +/- 0.24, N = 3SE +/- 0.28, N = 3SE +/- 0.26, N = 353.1153.1454.01

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.Cv6.6 6 Octv6.4v6.560K120K180K240K300KSE +/- 946.75, N = 3SE +/- 2141.41, N = 3SE +/- 3576.66, N = 3273013.53269542.21268492.021. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.5v6.6 6 Octv6.41632486480SE +/- 0.56, N = 15SE +/- 0.49, N = 12SE +/- 0.55, N = 1269.6569.8470.77MAX: 23930.93MAX: 23963.52MAX: 23941.04

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.6 6 Octv6.4v6.58M16M24M32M40MSE +/- 369838.39, N = 15SE +/- 432863.04, N = 15SE +/- 443563.55, N = 15391421343912205338539849

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1Mv6.4v6.6 6 Octv6.5306090120150SE +/- 0.01, N = 3SE +/- 0.37, N = 3SE +/- 1.07, N = 3128.50129.79130.43

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.6 6 Octv6.5v6.414M28M42M56M70MSE +/- 407522.59, N = 3SE +/- 929043.22, N = 3SE +/- 690519.22, N = 3672636066655890666287906

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.6 6 Octv6.5306090120150SE +/- 1.53, N = 13SE +/- 2.12, N = 12SE +/- 1.56, N = 15125.95126.51127.67MAX: 23943.82MAX: 23988.02MAX: 23994.5

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.6 6 Octv6.5v6.413M26M39M52M65MSE +/- 697211.54, N = 13SE +/- 676191.00, N = 15SE +/- 581785.82, N = 15601798525967987859376956

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUv6.4v6.6 6 Octv6.514002800420056007000SE +/- 8.07, N = 3SE +/- 6.56, N = 3SE +/- 8.34, N = 36316.446265.866234.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.5v6.4v6.6 6 Oct60120180240300SE +/- 2.65, N = 12SE +/- 2.23, N = 12SE +/- 4.51, N = 3273.92277.40277.50MAX: 28783.48MAX: 30379.43MAX: 28355.83

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUv6.4v6.6 6 Octv6.548121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 317.7017.8317.93MIN: 12.28 / MAX: 42.46MIN: 12.43 / MAX: 36.82MIN: 12.49 / MAX: 40.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NAS Parallel Benchmarks

Test / Class: SP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Cv6.4v6.6 6 Octv6.540K80K120K160K200KSE +/- 1944.01, N = 5SE +/- 2038.85, N = 3SE +/- 2009.88, N = 3193221.95191378.82190905.821. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct70140210280350SE +/- 0.31, N = 3SE +/- 0.56, N = 3SE +/- 0.67, N = 3337.22341.06341.19MIN: 252.67 / MAX: 470.11MIN: 238.2 / MAX: 437.74MIN: 242.27 / MAX: 401.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50v6.6 6 Octv6.5v6.41530456075SE +/- 0.66, N = 9SE +/- 0.76, N = 3SE +/- 0.29, N = 365.9765.9165.22

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUv6.4v6.5v6.6 6 Oct70140210280350SE +/- 0.28, N = 3SE +/- 0.51, N = 3SE +/- 0.63, N = 3331.20327.68327.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh Timev6.5v6.6 6 Octv6.44080120160200174.04175.39175.931. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.4v6.5v6.6 6 Oct11M22M33M44M55MSE +/- 482700.73, N = 15SE +/- 518637.11, N = 15SE +/- 501437.42, N = 14512482995118839850701925

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.6 6 Octv6.5v6.45M10M15M20M25MSE +/- 173884.88, N = 12SE +/- 188478.96, N = 15SE +/- 171233.24, N = 12248390012482527224582941

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper Beamv6.6 6 Octv6.4v6.520406080100SE +/- 0.37, N = 3SE +/- 0.64, N = 3SE +/- 0.23, N = 395.0895.1796.05

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawv6.4v6.6 6 Octv6.51300M2600M3900M5200M6500MSE +/- 38898803.89, N = 3SE +/- 77700626.41, N = 3SE +/- 56766399.45, N = 65865983333581709666758092200001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Writev6.4v6.6 6 Octv6.54K8K12K16K20KSE +/- 218.15, N = 12SE +/- 216.13, N = 12SE +/- 180.45, N = 121988419714197091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 1000 - Clients: 1000 - Mode: Read Write - Average Latencyv6.4v6.5v6.6 6 Oct1122334455SE +/- 0.55, N = 12SE +/- 0.46, N = 12SE +/- 0.55, N = 1250.3650.7950.791. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUv6.6 6 Octv6.5v6.4510152025SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 322.1022.2522.28MIN: 16.11 / MAX: 81MIN: 15.09 / MAX: 75.35MIN: 14.79 / MAX: 71.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fastv6.6 6 Octv6.4v6.548121620SE +/- 0.04, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 316.4016.3416.281. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUv6.4v6.6 6 Octv6.5714212835SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 331.1031.1931.32MIN: 24.91 / MAX: 99.63MIN: 24.8 / MAX: 100.26MIN: 25.09 / MAX: 91.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUv6.6 6 Octv6.5v6.411002200330044005500SE +/- 8.34, N = 3SE +/- 3.85, N = 3SE +/- 20.34, N = 35053.255018.075018.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.5v6.4v6.6 6 Oct306090120150SE +/- 1.29, N = 3SE +/- 0.10, N = 3SE +/- 1.13, N = 3111.14111.75111.92MAX: 11352.98MAX: 10157.01MAX: 10281.65

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.520406080100SE +/- 0.11, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 374.1374.4074.65MIN: 53.68 / MAX: 267.9MIN: 53.51 / MAX: 281.3MIN: 56.35 / MAX: 221.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUv6.4v6.6 6 Octv6.58001600240032004000SE +/- 9.62, N = 3SE +/- 7.83, N = 3SE +/- 8.61, N = 33597.653587.673572.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.530060090012001500SE +/- 2.05, N = 3SE +/- 2.60, N = 3SE +/- 3.25, N = 31508.771503.541498.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 100v6.6 6 Octv6.4v6.51632486480SE +/- 0.62, N = 3SE +/- 0.22, N = 3SE +/- 1.10, N = 369.6569.8870.09MAX: 23900.31MAX: 23895.2MAX: 23936.83

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDv6.6 6 Octv6.4v6.5816243240SE +/- 0.14, N = 3SE +/- 0.23, N = 3SE +/- 0.14, N = 335.0635.2435.281. (CXX) g++ options: -O2 -lOpenCL

Apache IoTDB

Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct306090120150SE +/- 1.48, N = 15SE +/- 1.82, N = 15SE +/- 1.48, N = 15155.22156.06156.10MAX: 27068.23MAX: 26765.03MAX: 27008.49

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.51020304050SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 345.5345.6345.76MIN: 40.67 / MAX: 112.3MIN: 38.64 / MAX: 91.4MIN: 38.33 / MAX: 110.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.55001000150020002500SE +/- 3.57, N = 3SE +/- 5.85, N = 3SE +/- 2.61, N = 32457.572452.142445.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 500 - Client Number: 400v6.5v6.6 6 Octv6.414M28M42M56M70MSE +/- 628672.36, N = 12SE +/- 718005.55, N = 3SE +/- 524197.72, N = 12660788356599846865784478

Apache IoTDB

Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.4v6.5v6.6 6 Oct14M28M42M56M70MSE +/- 46596.93, N = 3SE +/- 691489.65, N = 3SE +/- 494444.55, N = 3670453776702375066764218

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigv6.4v6.6 6 Octv6.560120180240300SE +/- 1.69, N = 3SE +/- 0.32, N = 3SE +/- 0.37, N = 3288.41289.51289.55

Apache IoTDB

Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100v6.6 6 Octv6.5v6.411M22M33M44M55MSE +/- 547035.26, N = 12SE +/- 410488.78, N = 15SE +/- 506247.74, N = 13527000215251989852514008

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, Losslessv6.5v6.6 6 Octv6.41.14192.28383.42574.56765.7095SE +/- 0.009, N = 3SE +/- 0.029, N = 3SE +/- 0.005, N = 35.0585.0645.0751. (CXX) g++ options: -O3 -fPIC -lm

Timed LLVM Compilation

Build System: Unix Makefiles

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix Makefilesv6.5v6.4v6.6 6 Oct60120180240300SE +/- 3.67, N = 3SE +/- 2.50, N = 3SE +/- 2.96, N = 9274.65275.09275.55

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUv6.4v6.6 6 Octv6.53K6K9K12K15KSE +/- 27.81, N = 3SE +/- 14.33, N = 3SE +/- 32.50, N = 316182.5516160.2916152.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUv6.6 6 Octv6.4v6.5246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 36.886.896.89MIN: 5.82 / MAX: 40.08MIN: 5.52 / MAX: 36.52MIN: 5.7 / MAX: 43.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Crypto++

Test: Unkeyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.8Test: Unkeyed Algorithmsv6.4v6.6 6 Octv6.5100200300400500SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3441.20440.91440.621. (CXX) g++ options: -g2 -O3 -fPIC -fno-devirtualize -pthread -pipe

Crypto++

Test: Keyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.8Test: Keyed Algorithmsv6.4v6.6 6 Octv6.5130260390520650SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3604.54604.37604.261. (CXX) g++ options: -g2 -O3 -fPIC -fno-devirtualize -pthread -pipe

Apache Hadoop

Operation: Open - Threads: 1000 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 1000 - Files: 100000v6.4v6.6 6 Octv6.560K120K180K240K300KSE +/- 5523.57, N = 15SE +/- 15981.48, N = 12SE +/- 19650.01, N = 15274610253036238253

Apache Hadoop

Operation: Delete - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 100000v6.4v6.6 6 Octv6.513K26K39K52K65KSE +/- 1094.57, N = 15SE +/- 925.50, N = 15SE +/- 835.38, N = 13603165805156625

Apache Hadoop

Operation: Open - Threads: 500 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 500 - Files: 100000v6.6 6 Octv6.4v6.560K120K180K240K300KSE +/- 8486.55, N = 15SE +/- 9141.48, N = 12SE +/- 20767.40, N = 15267299265652254640

Apache Hadoop

Operation: Open - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 100000v6.6 6 Octv6.4v6.560K120K180K240K300KSE +/- 7173.98, N = 15SE +/- 6349.18, N = 12SE +/- 14950.62, N = 12272523269034262969

Apache Hadoop

Operation: Open - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 100000v6.4v6.6 6 Octv6.560K120K180K240K300KSE +/- 9603.74, N = 15SE +/- 11689.78, N = 15SE +/- 8309.89, N = 15294150283104269810

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUv6.6 6 Octv6.5v6.40.12830.25660.38490.51320.6415SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 150.530.560.57MIN: 0.37 / MAX: 56.75MIN: 0.36 / MAX: 51.75MIN: 0.29 / MAX: 74.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUv6.5v6.6 6 Octv6.420K40K60K80K100KSE +/- 544.05, N = 3SE +/- 537.27, N = 3SE +/- 1782.53, N = 1594168.2893693.6474954.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlyv6.4v6.5v6.6 6 Oct80160240320400SE +/- 4.74, N = 9SE +/- 14.36, N = 9SE +/- 11.89, N = 9315.02336.42385.35

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Mathv6.6 6 Octv6.4v6.51.3M2.6M3.9M5.2M6.5MSE +/- 3935.20, N = 3SE +/- 72348.80, N = 3SE +/- 142745.75, N = 126205140.995961543.125808342.741. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copyingv6.4v6.6 6 Octv6.56K12K18K24K30KSE +/- 629.40, N = 15SE +/- 224.34, N = 7SE +/- 228.57, N = 325816.5025800.0625493.261. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Mathv6.5v6.6 6 Octv6.47K14K21K28K35KSE +/- 2392.89, N = 14SE +/- 48.00, N = 3SE +/- 329.39, N = 332314.9330007.3328901.021. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Mathv6.4v6.6 6 Octv6.580K160K240K320K400KSE +/- 15424.87, N = 12SE +/- 6612.89, N = 15SE +/- 5325.22, N = 12396715.18370932.98349646.891. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthreadv6.5v6.4v6.6 6 Oct8K16K24K32K40KSE +/- 820.44, N = 15SE +/- 43.26, N = 3SE +/- 106.91, N = 338759.7436288.2435491.621. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutexv6.6 6 Octv6.5v6.46M12M18M24M30MSE +/- 709062.89, N = 15SE +/- 376350.69, N = 15SE +/- 381162.66, N = 1527388113.6325266270.1623140484.141. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipev6.5v6.4v6.6 6 Oct8M16M24M32M40MSE +/- 1055793.62, N = 15SE +/- 487787.75, N = 15SE +/- 581009.73, N = 1538337996.3731203885.9827024816.261. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hashv6.6 6 Octv6.4v6.54M8M12M16M20MSE +/- 232420.75, N = 3SE +/- 343354.96, N = 15SE +/- 109703.46, N = 318109792.8517389901.3216889506.121. (CXX) g++ options: -lm -laio -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lmpfr -lpthread -lrt -lsctp -lz

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10v6.4v6.6 6 Octv6.5500K1000K1500K2000K2500KSE +/- 23334.59, N = 3SE +/- 26927.97, N = 3SE +/- 37051.26, N = 122262895.862231964.352068343.101. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5v6.4v6.6 6 Octv6.5500K1000K1500K2000K2500KSE +/- 57616.61, N = 12SE +/- 21494.50, N = 3SE +/- 31237.79, N = 152331936.552188365.952128295.601. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyv6.6 6 Octv6.5v6.40.35330.70661.05991.41321.7665SE +/- 0.044, N = 9SE +/- 0.056, N = 12SE +/- 0.042, N = 91.4461.4541.5701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyv6.5v6.6 6 Octv6.4150K300K450K600K750KSE +/- 30469.92, N = 12SE +/- 23263.68, N = 9SE +/- 15922.26, N = 97008366971036402351. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 400v6.6 6 Octv6.5v6.4306090120150SE +/- 2.18, N = 15SE +/- 1.66, N = 15SE +/- 1.11, N = 15134.57139.82140.40MAX: 27260.07MAX: 27644.97MAX: 27765.12

Apache IoTDB

Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.2Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 200 - Client Number: 100v6.5v6.4v6.6 6 Oct816243240SE +/- 0.74, N = 15SE +/- 0.38, N = 15SE +/- 0.42, N = 1434.4935.3135.64MAX: 23957.29MAX: 23938.81MAX: 23906.01

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fasterv6.5v6.4v6.6 6 Oct714212835SE +/- 0.08, N = 3SE +/- 0.34, N = 4SE +/- 0.48, N = 1228.7228.2727.331. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fasterv6.5v6.4v6.6 6 Oct246810SE +/- 0.137, N = 15SE +/- 0.097, N = 15SE +/- 0.103, N = 158.5008.4508.3261. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080pv6.4v6.6 6 Octv6.5110220330440550SE +/- 28.12, N = 15SE +/- 29.52, N = 15SE +/- 27.06, N = 15518.77468.57459.291. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080pv6.6 6 Octv6.4v6.590180270360450SE +/- 23.45, N = 15SE +/- 29.20, N = 15SE +/- 28.60, N = 15431.13426.84406.641. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.5306090120150SE +/- 9.48, N = 12SE +/- 1.29, N = 3SE +/- 5.99, N = 15145.92116.74112.261. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.5306090120150SE +/- 8.17, N = 15SE +/- 6.81, N = 15SE +/- 4.93, N = 15133.93122.12114.321. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

AOM AV1

Encoder Mode: Speed 11 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 11 Realtime - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.51122334455SE +/- 1.22, N = 15SE +/- 2.00, N = 12SE +/- 1.08, N = 1549.0948.2145.451. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4Kv6.5v6.6 6 Octv6.41224364860SE +/- 2.34, N = 15SE +/- 1.97, N = 15SE +/- 1.50, N = 1251.6047.1844.231. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4Kv6.4v6.6 6 Octv6.51122334455SE +/- 1.51, N = 15SE +/- 1.27, N = 15SE +/- 0.88, N = 1547.5446.0845.141. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4Kv6.5v6.6 6 Octv6.41020304050SE +/- 1.26, N = 12SE +/- 1.29, N = 12SE +/- 1.53, N = 1542.3841.9541.671. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4Kv6.4v6.5v6.6 6 Oct48121620SE +/- 0.38, N = 15SE +/- 0.42, N = 15SE +/- 0.56, N = 1514.3014.0912.381. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4Kv6.6 6 Octv6.5v6.41020304050SE +/- 2.39, N = 12SE +/- 1.36, N = 12SE +/- 0.79, N = 1545.2742.4241.511. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

AOM AV1

Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.7Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4Kv6.5v6.6 6 Octv6.4246810SE +/- 0.24, N = 12SE +/- 0.16, N = 15SE +/- 0.10, N = 157.727.137.071. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Streamclusterv6.4v6.5v6.6 6 Oct1122334455SE +/- 2.00, N = 15SE +/- 0.58, N = 3SE +/- 2.47, N = 1542.6145.6747.371. (CXX) g++ options: -O2 -lOpenCL

NAS Parallel Benchmarks

Test / Class: FT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.Cv6.6 6 Octv6.5v6.420K40K60K80K100KSE +/- 2154.10, N = 12SE +/- 2189.90, N = 15SE +/- 1023.16, N = 15114793.58112362.39103248.131. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.Cv6.4v6.6 6 Octv6.52K4K6K8K10KSE +/- 222.04, N = 12SE +/- 228.39, N = 12SE +/- 266.91, N = 1510844.9010840.5610479.791. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4


Phoronix Test Suite v10.8.5