Linux Kernel Benchmarks Threadripper 7980X

AMD Ryzen Threadripper 7980X Linux 6.7 kernel benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2311225-NE-LINUXKERN42&export=txt&grs&rdt&rro.

Linux Kernel Benchmarks Threadripper 7980XProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionLinux 6.5.11Linux 6.6.1Linux 6.7-rc2AMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads)ASUS Pro WS TRX50-SAGE WIFI (0217 BIOS)AMD Device 14a4128GB1000GB Western Digital WDS100T1X0E-00AFY0AMD Radeon RX 7900 XT 20GB (2025/1249MHz)Realtek ALC1220ASUS MG28UAquantia Device 04c0 + Intel I226-LM + MEDIATEK MT7922 802.11ax PCIUbuntu 23.106.5.11-060511-generic (x86_64)GNOME Shell 45.0X Server 1.21.1.7 + Wayland4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.54)GCC 13.2.0ext43840x21606.6.1-060601-generic (x86_64)6.7.0-060700rc2-generic (x86_64)4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.56)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: amd-pstate-epp performance (EPP: performance) - CPU Microcode: 0xa108105Python Details- Python 3.11.6Security Details- Linux 6.5.11: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Linux 6.6.1: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Linux 6.7-rc2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Linux Kernel Benchmarks Threadripper 7980Xnginx: 1000nginx: 500openvino: Face Detection Retail FP16 - CPUrocksdb: Read While Writingopenvino: Face Detection Retail FP16-INT8 - CPUtidb: oltp_update_index - 128openvino: Face Detection Retail FP16 - CPUrodinia: OpenMP CFD Solveropenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUtidb: oltp_update_non_index - 128openvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUpgbench: 100 - 1000 - Read Only - Average Latencymemtier-benchmark: Redis - 50 - 1:5pgbench: 100 - 1000 - Read Onlyopenvino: Person Vehicle Bike Detection FP16 - CPUsvt-av1: Preset 12 - Bosphorus 4Kopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUmemtier-benchmark: Redis - 100 - 1:5openvino: Handwritten English Recognition FP16 - CPUsvt-av1: Preset 13 - Bosphorus 4Kopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUmemtier-benchmark: Redis - 50 - 1:10openvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Vehicle Detection FP16 - CPUcompress-7zip: Compression Ratingmemcached: 1:100openvino: Weld Porosity Detection FP16-INT8 - CPUredis: SET - 500memtier-benchmark: Redis - 100 - 1:10tidb: oltp_read_write - 128openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenfoam: drivaerFastback, Small Mesh Size - Execution Timenpb: EP.Dopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenvino: Vehicle Detection FP16-INT8 - CPUrodinia: OpenMP HotSpot3Drocksdb: Read Rand Write Randnpb: CG.Credis: GET - 50rodinia: OpenMP Leukocyteopenvino: Weld Porosity Detection FP16 - CPUrocksdb: Update Randclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runopenvino: Age Gender Recognition Retail 0013 FP16 - CPUnpb: IS.Duvg266: Bosphorus 4K - Super Fastrodinia: OpenMP LavaMDtidb: oltp_point_select - 128npb: SP.Buvg266: Bosphorus 4K - Ultra Fastopenvino: Road Segmentation ADAS FP16-INT8 - CPUnpb: MG.Cnpb: LU.Crocksdb: Rand Readopenvino: Handwritten English Recognition FP16-INT8 - CPUclickhouse: 100M Rows Hits Dataset, Third Runopenvino: Person Detection FP32 - CPUredis: SET - 50openradioss: Chrysler Neon 1Mopenvino: Road Segmentation ADAS FP16-INT8 - CPUv-ray: CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16 - CPUblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlytensorflow: CPU - 16 - ResNet-50compress-7zip: Decompression Ratingkvazaar: Bosphorus 4K - Mediummemcached: 1:10svt-av1: Preset 8 - Bosphorus 4Kopenvino: Person Detection FP16 - CPUtensorflow: CPU - 32 - ResNet-50uvg266: Bosphorus 4K - Very Fasttensorflow: CPU - 256 - ResNet-50namd: ATPase Simulation - 327,506 Atomsindigobench: CPU - Supercaropenvino: Machine Translation EN To DE FP16 - CPUopenvino: Person Detection FP16 - CPUkvazaar: Bosphorus 4K - Very Fastopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Face Detection FP16 - CPUvvenc: Bosphorus 4K - Fastnpb: BT.Csvt-av1: Preset 4 - Bosphorus 4Knpb: SP.Cblender: Classroom - CPU-Onlyrodinia: OpenMP Streamclustervvenc: Bosphorus 4K - Fasteruvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumopenvino: Face Detection FP16-INT8 - CPUindigobench: CPU - Bedroomkvazaar: Bosphorus 4K - Slowopenvino: Face Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUblender: BMW27 - CPU-Onlyopenvino: Face Detection FP16 - CPUtensorflow: CPU - 64 - ResNet-50npb: FT.Cblender: Barbershop - CPU-Onlypgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writeredis: GET - 500npb: EP.CLinux 6.5.11Linux 6.6.1Linux 6.7-rc2221239.83229239.0911188.08875372215872.74271922.855.59034.06939.354.02427538722.194598.840.2474148754.0540469166.95213.245122162.204146060.912161.01215.5915150.271953.424087083.9529.590.5116.344000968871179.667.333574783.924230138.291181780.3638.8719039743.3521.5292856.2055.513322987125219.215070994.526.1164403.55624284372.58393.0993058.272454.8176.3429.81417536996376.5577.991557.6551405.13151244.694536331341867.69392.24216.184051356.25302.6920.5194204147.8514.5121.9553.2356.0657284836.726893541.04123.385215.6171.0773.8893.220.2652236.364387.01148.2581.8134.2443.489.384127752.087.35045105.9242.894.14216.54626.1629.5685.2916.46535.65374.0782.5816.91733.5781.4454457.04158.1234.509290224630742.77413.46329453.23334338.049432.47739014313698.55250123.195.06536.01887.274.41402108087.384266.060.2633966972.3238065427.35225.110116287.564004316.562062.99225.1914931.281872.393920454.9330.810.516.984131659107304.977.573536084.024123682.241157010.3638.6697579991.9021.0192816.3555.079315802125780.315172665.626.6374319.39629847369.10387.0491411.882488.0275.1529.47717749297720.7176.951544.8952021.31152852.834586203971848.90391.96214.454020968.92305.5220.6093398148.8414.6322.0852.8056.1657005736.976873621.13124.135214.3171.3973.4592.760.2659936.316385.09148.9282.1534.3843.319.352127915.767.32345157.0143.034.13116.49526.2429.6485.2016.42635.72374.4982.7416.94734.5081.4054460.14158.1033.299301344512541.77943.36324027.29336249.739455.84756766513769.22241893.185.03232.54980.324.39392718103.014272.340.2643885914.0537970567.33221.024116528.913956813.572070.32219.9264940.961878.743922843.5530.690.4916.924155399189255.397.563463325.484103259.741147850.3537.8324839878.8621.1913046.3456.359319322125725.115138387.826.5614333.43618065375.97394.1492003.352494.3375.5229.92117789496716.4277.311537.0552076.68153052.364587473501852.81388.37214.094012674.00303.4220.6993647149.0814.5921.9052.9056.4657407836.906920394.51123.674214.3870.9673.6192.730.2646036.499385.26148.8882.0834.3043.399.349128229.447.33245258.9342.944.12916.51926.2429.5885.4216.45635.73373.7082.7216.94734.0181.3454409.48158.0333.845296394365520.628184.38OpenBenchmarking.org

nginx

Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000Linux 6.7-rc2Linux 6.6.1Linux 6.5.1170K140K210K280K350KSE +/- 899.56, N = 3SE +/- 825.27, N = 3SE +/- 539.33, N = 3324027.29329453.23221239.831. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500Linux 6.7-rc2Linux 6.6.1Linux 6.5.1170K140K210K280K350KSE +/- 428.33, N = 3SE +/- 526.30, N = 3SE +/- 556.54, N = 3336249.73334338.04229239.091. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.112K4K6K8K10KSE +/- 8.58, N = 3SE +/- 15.45, N = 3SE +/- 3.77, N = 39455.849432.4711188.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read While WritingLinux 6.7-rc2Linux 6.6.1Linux 6.5.112M4M6M8M10MSE +/- 16177.71, N = 3SE +/- 64030.94, N = 3SE +/- 91949.49, N = 37567665739014387537221. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.113K6K9K12K15KSE +/- 1.97, N = 3SE +/- 8.32, N = 3SE +/- 3.73, N = 313769.2213698.5515872.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TiDB Community Server

Test: oltp_update_index - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 128Linux 6.7-rc2Linux 6.6.1Linux 6.5.116K12K18K24K30KSE +/- 109.56, N = 3SE +/- 223.13, N = 3SE +/- 237.29, N = 2241892501227192

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.110.71781.43562.15342.87123.589SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 33.183.192.85MIN: 1.51 / MAX: 14.15MIN: 1.44 / MAX: 29.95MIN: 1.75 / MAX: 27.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP CFD SolverLinux 6.7-rc2Linux 6.6.1Linux 6.5.111.25782.51563.77345.03126.289SE +/- 0.003, N = 3SE +/- 0.014, N = 3SE +/- 0.020, N = 35.0325.0655.5901. (CXX) g++ options: -O2 -lOpenCL

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11816243240SE +/- 0.15, N = 3SE +/- 0.38, N = 15SE +/- 0.32, N = 1532.5436.0134.06MIN: 11.68 / MAX: 59.75MIN: 12.12 / MAX: 84.75MIN: 11.93 / MAX: 84.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.112004006008001000SE +/- 4.43, N = 3SE +/- 9.53, N = 15SE +/- 8.78, N = 15980.32887.27939.351. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.110.99231.98462.97693.96924.9615SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34.394.414.02MIN: 2.04 / MAX: 27.1MIN: 1.98 / MAX: 29.22MIN: 2.54 / MAX: 31.41. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TiDB Community Server

Test: oltp_update_non_index - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 128Linux 6.7-rc2Linux 6.6.1Linux 6.5.119K18K27K36K45KSE +/- 226.51, N = 3SE +/- 213.78, N = 3SE +/- 52.75, N = 3392714021042753

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.112K4K6K8K10KSE +/- 15.93, N = 3SE +/- 3.26, N = 3SE +/- 5.16, N = 38103.018087.388722.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1110002000300040005000SE +/- 12.73, N = 3SE +/- 7.67, N = 3SE +/- 17.78, N = 34272.344266.064598.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyLinux 6.7-rc2Linux 6.6.1Linux 6.5.110.05940.11880.17820.23760.297SE +/- 0.001, N = 3SE +/- 0.001, N = 3SE +/- 0.000, N = 30.2640.2630.2471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5Linux 6.7-rc2Linux 6.6.1Linux 6.5.11900K1800K2700K3600K4500KSE +/- 6652.29, N = 3SE +/- 24135.06, N = 3SE +/- 7565.44, N = 33885914.053966972.324148754.051. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyLinux 6.7-rc2Linux 6.6.1Linux 6.5.11900K1800K2700K3600K4500KSE +/- 20992.25, N = 3SE +/- 12301.49, N = 3SE +/- 4031.22, N = 33797056380654240469161. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11246810SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 37.337.356.95MIN: 3.98 / MAX: 21.28MIN: 4 / MAX: 35.87MIN: 4.18 / MAX: 29.41. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 6.7-rc2Linux 6.6.1Linux 6.5.1150100150200250SE +/- 2.94, N = 3SE +/- 1.85, N = 15SE +/- 1.78, N = 3221.02225.11213.251. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1130K60K90K120K150KSE +/- 132.21, N = 3SE +/- 109.24, N = 3SE +/- 155.08, N = 3116528.91116287.56122162.201. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5Linux 6.7-rc2Linux 6.6.1Linux 6.5.11900K1800K2700K3600K4500KSE +/- 45289.48, N = 4SE +/- 41902.97, N = 5SE +/- 26907.29, N = 153956813.574004316.564146060.911. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.115001000150020002500SE +/- 3.18, N = 3SE +/- 1.43, N = 3SE +/- 4.40, N = 32070.322062.992161.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 6.7-rc2Linux 6.6.1Linux 6.5.1150100150200250SE +/- 1.26, N = 3SE +/- 2.69, N = 4SE +/- 1.58, N = 3219.93225.19215.591. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1111002200330044005500SE +/- 7.69, N = 3SE +/- 5.69, N = 3SE +/- 5.22, N = 34940.964931.285150.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11400800120016002000SE +/- 1.81, N = 3SE +/- 0.22, N = 3SE +/- 3.90, N = 31878.741872.391953.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10Linux 6.7-rc2Linux 6.6.1Linux 6.5.11900K1800K2700K3600K4500KSE +/- 25156.00, N = 15SE +/- 25818.24, N = 3SE +/- 18637.96, N = 33922843.553920454.934087083.951. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11714212835SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 330.6930.8129.59MIN: 16.95 / MAX: 58.56MIN: 15.67 / MAX: 63.09MIN: 16.75 / MAX: 55.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.110.11480.22960.34440.45920.574SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.490.500.51MIN: 0.24 / MAX: 17.36MIN: 0.22 / MAX: 27.24MIN: 0.23 / MAX: 27.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1148121620SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 316.9216.9816.34MIN: 7.29 / MAX: 43.78MIN: 6.27 / MAX: 51.33MIN: 5.97 / MAX: 43.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingLinux 6.7-rc2Linux 6.6.1Linux 6.5.1190K180K270K360K450KSE +/- 778.60, N = 3SE +/- 762.34, N = 3SE +/- 452.87, N = 34155394131654000961. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Memcached

Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Linux 6.7-rc2Linux 6.6.1Linux 6.5.112M4M6M8M10MSE +/- 40104.39, N = 3SE +/- 114832.50, N = 3SE +/- 47055.37, N = 39189255.399107304.978871179.661. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 37.567.577.33MIN: 3.19 / MAX: 30.86MIN: 3.26 / MAX: 27.31MIN: 3.73 / MAX: 26.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Redis

Test: SET - Parallel Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500Linux 6.7-rc2Linux 6.6.1Linux 6.5.11800K1600K2400K3200K4000KSE +/- 36901.42, N = 15SE +/- 30923.24, N = 15SE +/- 15919.08, N = 33463325.483536084.023574783.921. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10Linux 6.7-rc2Linux 6.6.1Linux 6.5.11900K1800K2700K3600K4500KSE +/- 14092.08, N = 3SE +/- 35671.91, N = 8SE +/- 14487.30, N = 34103259.744123682.244230138.291. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

TiDB Community Server

Test: oltp_read_write - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 128Linux 6.7-rc2Linux 6.6.1Linux 6.5.1130K60K90K120K150KSE +/- 740.28, N = 3SE +/- 235.02, N = 3SE +/- 239.85, N = 3114785115701118178

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.110.0810.1620.2430.3240.405SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.350.360.36MIN: 0.18 / MAX: 27.89MIN: 0.18 / MAX: 28.03MIN: 0.17 / MAX: 26.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeLinux 6.7-rc2Linux 6.6.1Linux 6.5.1191827364537.8338.6738.871. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

NAS Parallel Benchmarks

Test / Class: EP.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DLinux 6.7-rc2Linux 6.6.1Linux 6.5.112K4K6K8K10KSE +/- 86.11, N = 7SE +/- 30.12, N = 3SE +/- 95.70, N = 69878.869991.909743.351. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeLinux 6.7-rc2Linux 6.6.1Linux 6.5.1151015202521.1921.0221.531. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.346.356.20MIN: 3.11 / MAX: 29.59MIN: 2.95 / MAX: 34.47MIN: 3.23 / MAX: 29.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Rodinia

Test: OpenMP HotSpot3D

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP HotSpot3DLinux 6.7-rc2Linux 6.6.1Linux 6.5.111326395265SE +/- 0.48, N = 15SE +/- 0.51, N = 15SE +/- 0.62, N = 1556.3655.0855.511. (CXX) g++ options: -O2 -lOpenCL

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read Random Write RandomLinux 6.7-rc2Linux 6.6.1Linux 6.5.11700K1400K2100K2800K3500KSE +/- 37694.22, N = 3SE +/- 29011.34, N = 15SE +/- 23967.09, N = 113193221315802132298711. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

NAS Parallel Benchmarks

Test / Class: CG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CLinux 6.7-rc2Linux 6.6.1Linux 6.5.116K12K18K24K30KSE +/- 151.65, N = 3SE +/- 167.56, N = 3SE +/- 75.97, N = 325725.1125780.3125219.211. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

Redis

Test: GET - Parallel Connections: 50

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 50Linux 6.7-rc2Linux 6.6.1Linux 6.5.111.1M2.2M3.3M4.4M5.5MSE +/- 51320.51, N = 15SE +/- 44427.20, N = 8SE +/- 44939.55, N = 155138387.85172665.65070994.51. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Rodinia

Test: OpenMP Leukocyte

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LeukocyteLinux 6.7-rc2Linux 6.6.1Linux 6.5.11612182430SE +/- 0.22, N = 3SE +/- 0.21, N = 15SE +/- 0.24, N = 326.5626.6426.121. (CXX) g++ options: -O2 -lOpenCL

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.119001800270036004500SE +/- 2.27, N = 3SE +/- 1.21, N = 3SE +/- 2.47, N = 34333.434319.394403.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Update RandomLinux 6.7-rc2Linux 6.6.1Linux 6.5.11130K260K390K520K650KSE +/- 1256.87, N = 3SE +/- 630.57, N = 3SE +/- 717.21, N = 36180656298476242841. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheLinux 6.7-rc2Linux 6.6.1Linux 6.5.1180160240320400SE +/- 3.37, N = 3SE +/- 2.14, N = 3SE +/- 4.31, N = 3375.97369.10372.58MIN: 23.45 / MAX: 5454.55MIN: 25.21 / MAX: 5454.55MIN: 25.49 / MAX: 5454.55

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunLinux 6.7-rc2Linux 6.6.1Linux 6.5.1190180270360450SE +/- 5.10, N = 3SE +/- 6.54, N = 3SE +/- 2.05, N = 3394.14387.04393.09MIN: 35.57 / MAX: 6666.67MIN: 37.43 / MAX: 5454.55MIN: 37.45 / MAX: 5454.55

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1120K40K60K80K100KSE +/- 26.82, N = 3SE +/- 81.02, N = 3SE +/- 54.79, N = 392003.3591411.8893058.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NAS Parallel Benchmarks

Test / Class: IS.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DLinux 6.7-rc2Linux 6.6.1Linux 6.5.115001000150020002500SE +/- 9.95, N = 3SE +/- 1.31, N = 3SE +/- 21.68, N = 32494.332488.022454.811. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastLinux 6.7-rc2Linux 6.6.1Linux 6.5.1120406080100SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 375.5275.1576.34

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDLinux 6.7-rc2Linux 6.6.1Linux 6.5.11714212835SE +/- 0.35, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 329.9229.4829.811. (CXX) g++ options: -O2 -lOpenCL

TiDB Community Server

Test: oltp_point_select - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 128Linux 6.7-rc2Linux 6.6.1Linux 6.5.1140K80K120K160K200KSE +/- 749.34, N = 3SE +/- 985.41, N = 3SE +/- 2673.31, N = 9177894177492175369

NAS Parallel Benchmarks

Test / Class: SP.B

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.BLinux 6.7-rc2Linux 6.6.1Linux 6.5.1120K40K60K80K100KSE +/- 459.85, N = 3SE +/- 1175.18, N = 3SE +/- 864.04, N = 396716.4297720.7196376.551. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastLinux 6.7-rc2Linux 6.6.1Linux 6.5.1120406080100SE +/- 0.22, N = 3SE +/- 0.16, N = 3SE +/- 0.29, N = 377.3176.9577.99

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1130060090012001500SE +/- 4.84, N = 3SE +/- 2.64, N = 3SE +/- 1.90, N = 31537.051544.891557.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NAS Parallel Benchmarks

Test / Class: MG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CLinux 6.7-rc2Linux 6.6.1Linux 6.5.1111K22K33K44K55KSE +/- 132.72, N = 3SE +/- 203.14, N = 3SE +/- 279.14, N = 352076.6852021.3151405.131. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CLinux 6.7-rc2Linux 6.6.1Linux 6.5.1130K60K90K120K150KSE +/- 391.58, N = 3SE +/- 159.56, N = 3SE +/- 134.91, N = 3153052.36152852.83151244.691. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Random ReadLinux 6.7-rc2Linux 6.6.1Linux 6.5.11100M200M300M400M500MSE +/- 870916.50, N = 3SE +/- 894376.78, N = 3SE +/- 5866807.50, N = 34587473504586203974536331341. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11400800120016002000SE +/- 5.57, N = 3SE +/- 1.09, N = 3SE +/- 1.32, N = 31852.811848.901867.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunLinux 6.7-rc2Linux 6.6.1Linux 6.5.1190180270360450SE +/- 2.81, N = 3SE +/- 2.57, N = 3SE +/- 5.91, N = 3388.37391.96392.24MIN: 35.13 / MAX: 5000MIN: 37.24 / MAX: 6666.67MIN: 36.76 / MAX: 7500

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1150100150200250SE +/- 0.35, N = 3SE +/- 0.36, N = 3SE +/- 0.19, N = 3214.09214.45216.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Redis

Test: SET - Parallel Connections: 50

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 50Linux 6.7-rc2Linux 6.6.1Linux 6.5.11900K1800K2700K3600K4500KSE +/- 54428.66, N = 3SE +/- 46331.69, N = 3SE +/- 44859.45, N = 54012674.004020968.924051356.251. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MLinux 6.7-rc2Linux 6.6.1Linux 6.5.1170140210280350SE +/- 0.33, N = 3SE +/- 0.54, N = 3SE +/- 0.07, N = 3303.42305.52302.69

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11510152025SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 320.6920.6020.51MIN: 10.43 / MAX: 43.77MIN: 9.7 / MAX: 44.33MIN: 10.53 / MAX: 39.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Chaos Group V-RAY

Mode: CPU

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1120K40K60K80K100KSE +/- 257.94, N = 3SE +/- 542.65, N = 3SE +/- 122.98, N = 3936479339894204

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11306090120150SE +/- 0.24, N = 3SE +/- 0.24, N = 3SE +/- 0.13, N = 3149.08148.84147.85MIN: 79.56 / MAX: 205.56MIN: 68.97 / MAX: 210.06MIN: 47.23 / MAX: 203.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1148121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 314.5914.6314.51MIN: 7.18 / MAX: 38.96MIN: 7.02 / MAX: 30.15MIN: 6.73 / MAX: 31.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyLinux 6.7-rc2Linux 6.6.1Linux 6.5.11510152025SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 321.9022.0821.95

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 6.7-rc2Linux 6.6.1Linux 6.5.111224364860SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.33, N = 352.9052.8053.23

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 6.7-rc2Linux 6.6.1Linux 6.5.111326395265SE +/- 0.17, N = 3SE +/- 0.69, N = 4SE +/- 0.20, N = 356.4656.1656.06

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingLinux 6.7-rc2Linux 6.6.1Linux 6.5.11120K240K360K480K600KSE +/- 1252.01, N = 3SE +/- 1654.26, N = 3SE +/- 319.90, N = 35740785700575728481. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumLinux 6.7-rc2Linux 6.6.1Linux 6.5.11918273645SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 336.9036.9736.721. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Memcached

Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:10Linux 6.7-rc2Linux 6.6.1Linux 6.5.111.5M3M4.5M6M7.5MSE +/- 27325.44, N = 3SE +/- 8234.86, N = 3SE +/- 9983.74, N = 36920394.516873621.136893541.041. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 6.7-rc2Linux 6.6.1Linux 6.5.11306090120150SE +/- 1.09, N = 8SE +/- 1.36, N = 5SE +/- 0.72, N = 14123.67124.14123.391. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1150100150200250SE +/- 0.47, N = 3SE +/- 0.16, N = 3SE +/- 0.04, N = 3214.38214.31215.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 6.7-rc2Linux 6.6.1Linux 6.5.111632486480SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 370.9671.3971.07

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastLinux 6.7-rc2Linux 6.6.1Linux 6.5.111632486480SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 373.6173.4573.88

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 6.7-rc2Linux 6.6.1Linux 6.5.1120406080100SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 392.7392.7693.22

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsLinux 6.7-rc2Linux 6.6.1Linux 6.5.110.05980.11960.17940.23920.299SE +/- 0.00096, N = 3SE +/- 0.00134, N = 3SE +/- 0.00060, N = 30.264600.265990.26522

IndigoBench

Acceleration: CPU - Scene: Supercar

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarLinux 6.7-rc2Linux 6.6.1Linux 6.5.11816243240SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 336.5036.3236.36

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1180160240320400SE +/- 0.42, N = 3SE +/- 0.89, N = 3SE +/- 0.07, N = 3385.26385.09387.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11306090120150SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3148.88148.92148.25MIN: 59.78 / MAX: 208.1MIN: 57.11 / MAX: 203.85MIN: 72.66 / MAX: 203.851. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastLinux 6.7-rc2Linux 6.6.1Linux 6.5.1120406080100SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.16, N = 382.0882.1581.811. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11816243240SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 334.3034.3834.24MIN: 19.84 / MAX: 61.81MIN: 21.13 / MAX: 61.76MIN: 20.51 / MAX: 60.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.111020304050SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 343.3943.3143.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FastLinux 6.7-rc2Linux 6.6.1Linux 6.5.113691215SE +/- 0.084, N = 3SE +/- 0.079, N = 3SE +/- 0.080, N = 39.3499.3529.3841. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

NAS Parallel Benchmarks

Test / Class: BT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.CLinux 6.7-rc2Linux 6.6.1Linux 6.5.1130K60K90K120K150KSE +/- 173.39, N = 3SE +/- 175.49, N = 3SE +/- 111.65, N = 3128229.44127915.76127752.081. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 6.7-rc2Linux 6.6.1Linux 6.5.11246810SE +/- 0.006, N = 3SE +/- 0.037, N = 3SE +/- 0.012, N = 37.3327.3237.3501. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

NAS Parallel Benchmarks

Test / Class: SP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CLinux 6.7-rc2Linux 6.6.1Linux 6.5.1110K20K30K40K50KSE +/- 24.99, N = 3SE +/- 23.20, N = 3SE +/- 17.83, N = 345258.9345157.0145105.921. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyLinux 6.7-rc2Linux 6.6.1Linux 6.5.111020304050SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 342.9443.0342.89

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP StreamclusterLinux 6.7-rc2Linux 6.6.1Linux 6.5.110.9321.8642.7963.7284.66SE +/- 0.004, N = 3SE +/- 0.009, N = 3SE +/- 0.005, N = 34.1294.1314.1421. (CXX) g++ options: -O2 -lOpenCL

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FasterLinux 6.7-rc2Linux 6.6.1Linux 6.5.1148121620SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 316.5216.5016.551. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

uvg266

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowLinux 6.7-rc2Linux 6.6.1Linux 6.5.11612182430SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 326.2426.2426.16

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumLinux 6.7-rc2Linux 6.6.1Linux 6.5.11714212835SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 329.5829.6429.56

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1120406080100SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 385.4285.2085.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

IndigoBench

Acceleration: CPU - Scene: Bedroom

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomLinux 6.7-rc2Linux 6.6.1Linux 6.5.1148121620SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 316.4616.4316.47

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowLinux 6.7-rc2Linux 6.6.1Linux 6.5.11816243240SE +/- 0.27, N = 3SE +/- 0.23, N = 3SE +/- 0.20, N = 335.7335.7235.651. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1180160240320400SE +/- 0.33, N = 3SE +/- 0.27, N = 3SE +/- 0.27, N = 3373.70374.49374.07MIN: 347.28 / MAX: 394.08MIN: 319.13 / MAX: 388.08MIN: 323.11 / MAX: 388.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.1120406080100SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.02, N = 382.7282.7482.58MIN: 44.94 / MAX: 114.32MIN: 38.04 / MAX: 113.57MIN: 34.87 / MAX: 114.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyLinux 6.7-rc2Linux 6.6.1Linux 6.5.1148121620SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 316.9416.9416.91

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPULinux 6.7-rc2Linux 6.6.1Linux 6.5.11160320480640800SE +/- 0.77, N = 3SE +/- 0.39, N = 3SE +/- 0.34, N = 3734.01734.50733.57MIN: 628.8 / MAX: 797.69MIN: 617.23 / MAX: 793.79MIN: 649.39 / MAX: 800.121. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 6.7-rc2Linux 6.6.1Linux 6.5.1120406080100SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 381.3481.4081.44

NAS Parallel Benchmarks

Test / Class: FT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.CLinux 6.7-rc2Linux 6.6.1Linux 6.5.1112K24K36K48K60KSE +/- 8.07, N = 3SE +/- 94.44, N = 3SE +/- 115.56, N = 354409.4854460.1454457.041. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyLinux 6.7-rc2Linux 6.6.1Linux 6.5.11306090120150SE +/- 0.24, N = 3SE +/- 0.24, N = 3SE +/- 0.09, N = 3158.03158.10158.12

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyLinux 6.7-rc2Linux 6.6.1Linux 6.5.11816243240SE +/- 0.56, N = 12SE +/- 0.58, N = 12SE +/- 0.41, N = 1233.8533.3034.511. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteLinux 6.7-rc2Linux 6.6.1Linux 6.5.116K12K18K24K30KSE +/- 509.92, N = 12SE +/- 537.19, N = 12SE +/- 345.65, N = 122963930134290221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Redis

Test: GET - Parallel Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500Linux 6.7-rc2Linux 6.6.1Linux 6.5.111000K2000K3000K4000K5000KSE +/- 91167.93, N = 15SE +/- 40269.92, N = 15SE +/- 26983.75, N = 34365520.624512541.704630742.701. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

NAS Parallel Benchmarks

Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.CLinux 6.7-rc2Linux 6.6.1Linux 6.5.112K4K6K8K10KSE +/- 125.21, N = 15SE +/- 147.22, N = 15SE +/- 87.80, N = 38184.387943.367413.461. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.5

Phoronix Test Suite v10.8.5