System76 Thelio Kernels Linux 6.8

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2401218-PTS-SYSTEM7660&gru&sor.

System76 Thelio Kernels Linux 6.8ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen Resolutionv6.6.6 Stockv6.7v6.8 20 JanAMD Ryzen Threadripper 7980X 64-Cores @ 7.79GHz (64 Cores / 128 Threads)System76 Thelio Major (FA Z5 BIOS)AMD Device 14a44 x 32 GB DRAM-4800MT/s Micron MTC20F1045S1RC48BA21000GB CT1000T700SSD5NAVI31 45GB (1760/1124MHz)AMD Device 14ccASUS VP28UAquantia Device 14c0 + Realtek RTL8125 2.5GbE + Intel Wi-Fi 6 AX210/AX211/AX411Pop 22.046.6.6-76060606-generic (x86_64)GNOME Shell 42.5X Server 1.21.1.44.6 Mesa 23.3.2-1pop0~1704238321~22.04~36f1d0e (LLVM 15.0.7 DRM 3.54)1.3.267GCC 11.4.0ext43840x21606.7.0-060700-generic (x86_64)4.6 Mesa 23.3.2-1pop0~1704238321~22.04~36f1d0e (LLVM 15.0.7 DRM 3.56)6.7.0-060700daily20240120-generic (x86_64)4.6 Mesa 23.3.2-1pop0~1704238321~22.04~36f1d0e (LLVM 15.0.7 DRM 3.57)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105Python Details- Python 3.10.12Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

System76 Thelio Kernels Linux 6.8pytorch: CPU - 1 - ResNet-50pytorch: CPU - 16 - ResNet-50pytorch: CPU - 512 - ResNet-50stress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pipestress-ng: Pollstress-ng: Zlibstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Cloningstress-ng: Forkingstress-ng: Pthreadstress-ng: AVL Treestress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: AVX-512 VNNIstress-ng: Function Callstress-ng: x86_64 RdRandstress-ng: Floating Pointstress-ng: Matrix 3D Mathstress-ng: Memory Copyingstress-ng: Vector Shufflestress-ng: Mixed Schedulerstress-ng: Wide Vector Mathstress-ng: Context Switchingstress-ng: Fused Multiply-Addstress-ng: Vector Floating Pointstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingquicksilver: CTS2quicksilver: CORAL2 P1quicksilver: CORAL2 P2openvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUrav1e: 1rav1e: 5rav1e: 6rav1e: 10svt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ktensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 512 - ResNet-50quantlib: Multi-Threadedquantlib: Single-Threadedcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratinglczero: Eigenspeedb: Rand Readspeedb: Update Randspeedb: Read While Writingspeedb: Read Rand Write Randpgbench: 100 - 1000 - Read Onlypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Write - Average Latencyopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-llvm: Ninjabuild-llvm: Unix Makefilesbuild-nodejs: Time To Compilebuild-php: Time To Compiley-cruncher: 1By-cruncher: 500Mencode-flac: WAV To FLACblender: BMW27 - CPU-Onlyblender: Barbershop - CPU-Onlyv6.6.6 Stockv6.7v6.8 20 Jan57.3246.8646.3817033307.631037.831036.7727118341.217394187.647881.103008388.98730.6223109393.80319.94183183.99150760521.225992.4557664.20125130.59432.831486513.95816781.541268835.49185200.3893013794.86385258.18485001.348158371.9459193.7811327.0626744.362308.9824004.5355853.5453828.663230461.5020153249.5670244822.75228832.1373865789.561894.2826211336.69233266672728000022070000128.7383.264926.8313960.221271.04206.027959.973740.501728.88113672.151.3695.6207.37017.6019.08188.830183.372188.7167.1948.27266288.44354.93563955567613654530598224446501346725431010773886975293560.25734.689249.98383.156.374.3625.08154.917.698.4136.900.3923.905250.165162.961181.646121.21427.12111.0235.46312.52417.76163.3852.6943.2943.1917551780.141042.841068.0928997709.977499767.918041.123014245.49733.7024181954.44319.64188548.45154494959.666798.1074065.57125537.87635.152249186.661002168.851271089.94194017.28100143123.74396041.26499009.498282501.9261613.7611326.1227569.664379.7824695.6457494.6555946.693320137.0221313434.9072100478.14234027.6475382089.041953.7126702772.59238766672804000022036667188.8385.225045.5114310.251561.17354.548161.264254.671828.77117409.531.3845.6727.39817.5639.20890.360186.249192.3057.1290.57269955.54410.43633975708833584681236274629171304024433486324004740318990.25031.969169.15374.516.214.2520.4290.027.507.3634.870.3823.605213.968128.920180.187118.04826.69411.0565.48012.36917.38157.3752.3943.1643.0317563822.26969.101081.6928177842.387868494.178060.143115686.21626.3726762751.75319.56189063.33150399862.326732.4470085.01124066.29638.581779056.72911584.271289645.53196549.81106517080.67395555.26500004.388295943.7761542.1311328.3627614.734331.8824217.0557552.2356064.473328142.0921334268.5971381983.24235304.7374823547.612020.6928955467.63236633332791333322086667196.2585.255040.8114329.961556.06355.358146.274274.681821.25116852.121.3805.6667.46517.7169.12588.956179.570188.2307.2790.59270826.14422.23590395725163634678247434787431318231133829854067249345260.24628.963162.79374.316.224.2520.4889.827.507.3335.020.3824.476222.590129.395179.853118.90426.91511.0195.44412.37517.40157.47OpenBenchmarking.org

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50v6.6.6 Stockv6.7v6.8 20 Jan1326395265SE +/- 0.26, N = 3SE +/- 0.25, N = 3SE +/- 0.14, N = 357.3252.6952.39MIN: 52.6 / MAX: 59.56MIN: 48.03 / MAX: 54.61MIN: 47.83 / MAX: 54.23

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-50v6.6.6 Stockv6.7v6.8 20 Jan1122334455SE +/- 0.23, N = 3SE +/- 0.20, N = 3SE +/- 0.24, N = 346.8643.2943.16MIN: 43.35 / MAX: 48.24MIN: 40.69 / MAX: 44.45MIN: 39.88 / MAX: 44.49

PyTorch

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: ResNet-50v6.6.6 Stockv6.7v6.8 20 Jan1122334455SE +/- 0.21, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 346.3843.1943.03MIN: 43.06 / MAX: 47.63MIN: 40.2 / MAX: 44.13MIN: 39.58 / MAX: 44.49

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hashv6.8 20 Janv6.7v6.6.6 Stock4M8M12M16M20MSE +/- 6056.44, N = 3SE +/- 3053.25, N = 3SE +/- 3192.96, N = 317563822.2617551780.1417033307.631. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPv6.7v6.6.6 Stockv6.8 20 Jan2004006008001000SE +/- 0.51, N = 3SE +/- 0.43, N = 3SE +/- 0.31, N = 31042.841037.83969.101. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMAv6.8 20 Janv6.7v6.6.6 Stock2004006008001000SE +/- 3.43, N = 3SE +/- 0.24, N = 3SE +/- 1.80, N = 31081.691068.091036.771. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipev6.7v6.8 20 Janv6.6.6 Stock6M12M18M24M30MSE +/- 293042.41, N = 5SE +/- 66944.79, N = 3SE +/- 38316.59, N = 328997709.9728177842.3827118341.211. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pollv6.8 20 Janv6.7v6.6.6 Stock2M4M6M8M10MSE +/- 1265.21, N = 3SE +/- 7207.98, N = 3SE +/- 8703.67, N = 37868494.177499767.917394187.641. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlibv6.8 20 Janv6.7v6.6.6 Stock2K4K6K8K10KSE +/- 14.00, N = 3SE +/- 39.53, N = 3SE +/- 15.44, N = 38060.148041.127881.101. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Futexv6.8 20 Janv6.7v6.6.6 Stock700K1400K2100K2800K3500KSE +/- 17686.67, N = 3SE +/- 51913.47, N = 15SE +/- 38705.18, N = 123115686.213014245.493008388.981. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDv6.7v6.6.6 Stockv6.8 20 Jan160320480640800SE +/- 0.59, N = 3SE +/- 0.47, N = 3SE +/- 0.42, N = 3733.70730.62626.371. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutexv6.8 20 Janv6.7v6.6.6 Stock6M12M18M24M30MSE +/- 108268.55, N = 3SE +/- 9399.14, N = 3SE +/- 17585.48, N = 326762751.7524181954.4423109393.801. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Atomicv6.6.6 Stockv6.7v6.8 20 Jan70140210280350SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3319.94319.64319.561. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cryptov6.8 20 Janv6.7v6.6.6 Stock40K80K120K160K200KSE +/- 303.68, N = 3SE +/- 161.24, N = 3SE +/- 260.91, N = 3189063.33188548.45183183.991. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mallocv6.7v6.6.6 Stockv6.8 20 Jan30M60M90M120M150MSE +/- 1238064.72, N = 3SE +/- 917737.04, N = 3SE +/- 123392.16, N = 3154494959.66150760521.22150399862.321. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Cloning

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cloningv6.7v6.8 20 Janv6.6.6 Stock15003000450060007500SE +/- 1.62, N = 3SE +/- 4.20, N = 3SE +/- 50.66, N = 156798.106732.445992.451. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Forkingv6.7v6.8 20 Janv6.6.6 Stock16K32K48K64K80KSE +/- 80.89, N = 3SE +/- 551.50, N = 15SE +/- 621.24, N = 1574065.5770085.0157664.201. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthreadv6.7v6.6.6 Stockv6.8 20 Jan30K60K90K120K150KSE +/- 142.99, N = 3SE +/- 452.99, N = 3SE +/- 80.91, N = 3125537.87125130.59124066.291. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Treev6.8 20 Janv6.7v6.6.6 Stock140280420560700SE +/- 0.39, N = 3SE +/- 0.67, N = 3SE +/- 9.75, N = 14638.58635.15432.831. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringv6.7v6.8 20 Janv6.6.6 Stock500K1000K1500K2000K2500KSE +/- 27934.77, N = 3SE +/- 103521.52, N = 12SE +/- 109628.32, N = 122249186.661779056.721486513.951. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILEv6.7v6.8 20 Janv6.6.6 Stock200K400K600K800K1000KSE +/- 4805.80, N = 3SE +/- 5909.38, N = 3SE +/- 5266.72, N = 31002168.85911584.27816781.541. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cachev6.8 20 Janv6.7v6.6.6 Stock300K600K900K1200K1500KSE +/- 21363.01, N = 15SE +/- 23675.00, N = 12SE +/- 16798.31, N = 31289645.531271089.941268835.491. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stressv6.8 20 Janv6.7v6.6.6 Stock40K80K120K160K200KSE +/- 672.45, N = 3SE +/- 511.22, N = 3SE +/- 1715.48, N = 3196549.81194017.28185200.381. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphoresv6.8 20 Janv6.7v6.6.6 Stock20M40M60M80M100MSE +/- 6780651.21, N = 15SE +/- 673729.70, N = 3SE +/- 315601.64, N = 3106517080.67100143123.7493013794.861. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Mathv6.7v6.8 20 Janv6.6.6 Stock80K160K240K320K400KSE +/- 272.90, N = 3SE +/- 266.39, N = 3SE +/- 637.54, N = 3396041.26395555.26385258.181. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Mathv6.8 20 Janv6.7v6.6.6 Stock110K220K330K440K550KSE +/- 393.56, N = 3SE +/- 258.25, N = 3SE +/- 152.98, N = 3500004.38499009.49485001.341. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: AVX-512 VNNI

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNIv6.8 20 Janv6.7v6.6.6 Stock2M4M6M8M10MSE +/- 10648.54, N = 3SE +/- 3726.82, N = 3SE +/- 86949.56, N = 58295943.778282501.928158371.941. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Callv6.7v6.8 20 Janv6.6.6 Stock13K26K39K52K65KSE +/- 22.20, N = 3SE +/- 32.44, N = 3SE +/- 468.48, N = 361613.7661542.1359193.781. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRandv6.8 20 Janv6.6.6 Stockv6.72K4K6K8K10KSE +/- 0.33, N = 3SE +/- 0.34, N = 3SE +/- 0.18, N = 311328.3611327.0611326.121. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Pointv6.8 20 Janv6.7v6.6.6 Stock6K12K18K24K30KSE +/- 31.86, N = 3SE +/- 32.79, N = 3SE +/- 16.76, N = 327614.7327569.6626744.361. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Mathv6.7v6.8 20 Janv6.6.6 Stock9001800270036004500SE +/- 46.41, N = 13SE +/- 1.56, N = 3SE +/- 161.28, N = 154379.784331.882308.981. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copyingv6.7v6.8 20 Janv6.6.6 Stock5K10K15K20K25KSE +/- 57.39, N = 3SE +/- 66.11, N = 3SE +/- 17.95, N = 324695.6424217.0524004.531. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shufflev6.8 20 Janv6.7v6.6.6 Stock12K24K36K48K60KSE +/- 33.42, N = 3SE +/- 7.11, N = 3SE +/- 29.85, N = 357552.2357494.6555853.541. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed Schedulerv6.8 20 Janv6.7v6.6.6 Stock12K24K36K48K60KSE +/- 72.36, N = 3SE +/- 246.60, N = 3SE +/- 166.89, N = 356064.4755946.6953828.661. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Mathv6.8 20 Janv6.7v6.6.6 Stock700K1400K2100K2800K3500KSE +/- 2085.07, N = 3SE +/- 1754.36, N = 3SE +/- 830.00, N = 33328142.093320137.023230461.501. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context Switchingv6.8 20 Janv6.7v6.6.6 Stock5M10M15M20M25MSE +/- 121700.79, N = 3SE +/- 193579.79, N = 15SE +/- 190129.10, N = 1521334268.5921313434.9020153249.561. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Addv6.7v6.8 20 Janv6.6.6 Stock15M30M45M60M75MSE +/- 42666.45, N = 3SE +/- 471689.87, N = 3SE +/- 21862.72, N = 372100478.1471381983.2470244822.751. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Pointv6.8 20 Janv6.7v6.6.6 Stock50K100K150K200K250KSE +/- 1244.36, N = 15SE +/- 394.44, N = 3SE +/- 217.62, N = 3235304.73234027.64228832.131. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functionsv6.7v6.8 20 Janv6.6.6 Stock16M32M48M64M80MSE +/- 469274.41, N = 3SE +/- 224384.57, N = 3SE +/- 346470.68, N = 375382089.0474823547.6173865789.561. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sortingv6.8 20 Janv6.7v6.6.6 Stock400800120016002000SE +/- 1.64, N = 3SE +/- 2.29, N = 3SE +/- 3.32, N = 32020.691953.711894.281. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passingv6.8 20 Janv6.7v6.6.6 Stock6M12M18M24M30MSE +/- 346710.82, N = 3SE +/- 35321.93, N = 3SE +/- 24713.27, N = 328955467.6326702772.5926211336.691. (CXX) g++ options: -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lpthread -lrt -lz

Quicksilver

Input: CTS2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CTS2v6.7v6.8 20 Janv6.6.6 Stock5M10M15M20M25MSE +/- 38441.88, N = 3SE +/- 14529.66, N = 3SE +/- 32829.53, N = 32387666723663333233266671. (CXX) g++ options: -fopenmp -O3 -march=native

Quicksilver

Input: CORAL2 P1

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1v6.7v6.8 20 Janv6.6.6 Stock6M12M18M24M30MSE +/- 55075.71, N = 3SE +/- 8819.17, N = 3SE +/- 211266.03, N = 32804000027913333272800001. (CXX) g++ options: -fopenmp -O3 -march=native

Quicksilver

Input: CORAL2 P2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2v6.8 20 Janv6.6.6 Stockv6.75M10M15M20M25MSE +/- 32829.53, N = 3SE +/- 34641.02, N = 3SE +/- 14529.66, N = 32208666722070000220366671. (CXX) g++ options: -fopenmp -O3 -march=native

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUv6.8 20 Janv6.7v6.6.6 Stock4080120160200SE +/- 0.37, N = 3SE +/- 0.29, N = 3SE +/- 2.69, N = 15196.25188.83128.731. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUv6.8 20 Janv6.7v6.6.6 Stock20406080100SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.20, N = 385.2585.2283.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock11002200330044005500SE +/- 2.97, N = 3SE +/- 5.72, N = 3SE +/- 7.01, N = 35045.515040.814926.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUv6.8 20 Janv6.7v6.6.6 Stock3K6K9K12K15KSE +/- 20.70, N = 3SE +/- 19.49, N = 3SE +/- 10.92, N = 314329.9614310.2513960.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock30060090012001500SE +/- 1.78, N = 3SE +/- 6.55, N = 3SE +/- 12.47, N = 151561.171556.061271.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUv6.8 20 Janv6.7v6.6.6 Stock80160240320400SE +/- 0.50, N = 3SE +/- 1.14, N = 3SE +/- 1.84, N = 3355.35354.54206.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock2K4K6K8K10KSE +/- 9.48, N = 3SE +/- 14.31, N = 3SE +/- 4.62, N = 38161.268146.277959.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUv6.8 20 Janv6.7v6.6.6 Stock9001800270036004500SE +/- 7.29, N = 3SE +/- 1.62, N = 3SE +/- 35.82, N = 154274.684254.673740.501. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock400800120016002000SE +/- 12.63, N = 3SE +/- 4.34, N = 3SE +/- 0.64, N = 31828.771821.251728.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock30K60K90K120K150KSE +/- 316.75, N = 3SE +/- 450.26, N = 3SE +/- 181.97, N = 3117409.53116852.12113672.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

rav1e

Speed: 1

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.7Speed: 1v6.7v6.8 20 Janv6.6.6 Stock0.31140.62280.93421.24561.557SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.004, N = 31.3841.3801.369

rav1e

Speed: 5

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.7Speed: 5v6.7v6.8 20 Janv6.6.6 Stock1.27622.55243.82865.10486.381SE +/- 0.009, N = 3SE +/- 0.015, N = 3SE +/- 0.008, N = 35.6725.6665.620

rav1e

Speed: 6

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.7Speed: 6v6.8 20 Janv6.7v6.6.6 Stock246810SE +/- 0.030, N = 3SE +/- 0.031, N = 3SE +/- 0.022, N = 37.4657.3987.370

rav1e

Speed: 10

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.7Speed: 10v6.8 20 Janv6.6.6 Stockv6.748121620SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 317.7217.6017.56

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4Kv6.7v6.8 20 Janv6.6.6 Stock3691215SE +/- 0.044, N = 3SE +/- 0.023, N = 3SE +/- 0.052, N = 39.2089.1259.0811. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4Kv6.7v6.8 20 Janv6.6.6 Stock20406080100SE +/- 0.69, N = 3SE +/- 0.77, N = 3SE +/- 0.57, N = 390.3688.9688.831. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4Kv6.7v6.6.6 Stockv6.8 20 Jan4080120160200SE +/- 0.60, N = 3SE +/- 1.21, N = 3SE +/- 1.68, N = 14186.25183.37179.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4Kv6.7v6.6.6 Stockv6.8 20 Jan4080120160200SE +/- 0.83, N = 3SE +/- 0.41, N = 3SE +/- 0.78, N = 3192.31188.72188.231. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TensorFlow

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 1 - Model: ResNet-50v6.8 20 Janv6.6.6 Stockv6.7246810SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 37.277.197.12

TensorFlow

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: ResNet-50v6.8 20 Janv6.7v6.6.6 Stock20406080100SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.22, N = 390.5990.5748.27

QuantLib

Configuration: Multi-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-Threadedv6.8 20 Janv6.7v6.6.6 Stock60K120K180K240K300KSE +/- 704.18, N = 3SE +/- 922.38, N = 3SE +/- 1629.93, N = 3270826.1269955.5266288.41. (CXX) g++ options: -O3 -march=native -fPIE -pie

QuantLib

Configuration: Single-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-Threadedv6.8 20 Janv6.7v6.6.6 Stock9001800270036004500SE +/- 38.02, N = 3SE +/- 17.53, N = 3SE +/- 23.44, N = 34422.24410.44354.91. (CXX) g++ options: -O3 -march=native -fPIE -pie

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingv6.7v6.8 20 Janv6.6.6 Stock80K160K240K320K400KSE +/- 967.86, N = 3SE +/- 716.12, N = 3SE +/- 1642.20, N = 33633973590393563951. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingv6.8 20 Janv6.7v6.6.6 Stock120K240K360K480K600KSE +/- 1758.24, N = 3SE +/- 1033.82, N = 3SE +/- 3472.31, N = 35725165708835567611. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: Eigenv6.6.6 Stockv6.8 20 Janv6.780160240320400SE +/- 2.67, N = 3SE +/- 3.25, N = 7SE +/- 4.26, N = 43653633581. (CXX) g++ options: -flto -pthread

Speedb

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random Readv6.7v6.8 20 Janv6.6.6 Stock100M200M300M400M500MSE +/- 358460.93, N = 3SE +/- 660803.31, N = 3SE +/- 2124225.27, N = 34681236274678247434530598221. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Update Randomv6.8 20 Janv6.7v6.6.6 Stock100K200K300K400K500KSE +/- 2903.23, N = 3SE +/- 227.10, N = 3SE +/- 1868.95, N = 34787434629174446501. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While Writingv6.6.6 Stockv6.8 20 Janv6.73M6M9M12M15MSE +/- 134947.32, N = 6SE +/- 184754.10, N = 3SE +/- 144991.37, N = 41346725413182311130402441. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Speedb

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read Random Write Randomv6.8 20 Janv6.7v6.6.6 Stock700K1400K2100K2800K3500KSE +/- 35242.08, N = 3SE +/- 14008.04, N = 3SE +/- 10648.79, N = 33382985334863231010771. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyv6.8 20 Janv6.7v6.6.6 Stock900K1800K2700K3600K4500KSE +/- 32554.05, N = 3SE +/- 12389.83, N = 3SE +/- 19489.13, N = 34067249400474038869751. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Writev6.8 20 Janv6.7v6.6.6 Stock7K14K21K28K35KSE +/- 37.82, N = 3SE +/- 1238.01, N = 12SE +/- 1131.34, N = 123452631899293561. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyv6.8 20 Janv6.7v6.6.6 Stock0.05780.11560.17340.23120.289SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.001, N = 30.2460.2500.2571. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyv6.8 20 Janv6.7v6.6.6 Stock816243240SE +/- 0.03, N = 3SE +/- 1.45, N = 12SE +/- 1.47, N = 1228.9631.9734.691. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUv6.8 20 Janv6.7v6.6.6 Stock50100150200250SE +/- 0.30, N = 3SE +/- 0.26, N = 3SE +/- 6.32, N = 15162.79169.15249.98MIN: 79.12 / MAX: 219.93MIN: 69.93 / MAX: 221.3MIN: 40.51 / MAX: 811.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUv6.8 20 Janv6.7v6.6.6 Stock80160240320400SE +/- 0.18, N = 3SE +/- 0.25, N = 3SE +/- 0.84, N = 3374.31374.51383.15MIN: 196.32 / MAX: 397.31MIN: 321.16 / MAX: 396.63MIN: 303.22 / MAX: 402.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.216.226.37MIN: 3.17 / MAX: 23.34MIN: 3.17 / MAX: 35.72MIN: 3.34 / MAX: 29.671. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock0.9811.9622.9433.9244.905SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34.254.254.36MIN: 1.95 / MAX: 30.92MIN: 2.02 / MAX: 29.34MIN: 2.15 / MAX: 271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock612182430SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.22, N = 1520.4220.4825.08MIN: 11.89 / MAX: 42.47MIN: 9.39 / MAX: 41.18MIN: 11.1 / MAX: 59.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUv6.8 20 Janv6.7v6.6.6 Stock306090120150SE +/- 0.12, N = 3SE +/- 0.29, N = 3SE +/- 1.37, N = 389.8290.02154.91MIN: 37.27 / MAX: 122.76MIN: 35.71 / MAX: 120.27MIN: 45.52 / MAX: 256.281. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 37.507.507.69MIN: 3.43 / MAX: 27.91MIN: 3.39 / MAX: 29.37MIN: 3.31 / MAX: 27.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUv6.8 20 Janv6.7v6.6.6 Stock246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 157.337.368.41MIN: 4.02 / MAX: 31.11MIN: 3.93 / MAX: 27.08MIN: 3.83 / MAX: 32.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock816243240SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 334.8735.0236.90MIN: 20.35 / MAX: 61.86MIN: 20.04 / MAX: 63.63MIN: 20.64 / MAX: 64.41. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUv6.7v6.8 20 Janv6.6.6 Stock0.08780.17560.26340.35120.439SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.380.380.39MIN: 0.18 / MAX: 19.31MIN: 0.18 / MAX: 23.04MIN: 0.18 / MAX: 26.281. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigv6.7v6.6.6 Stockv6.8 20 Jan612182430SE +/- 0.27, N = 4SE +/- 0.22, N = 6SE +/- 0.28, N = 423.6123.9124.48

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigv6.7v6.8 20 Janv6.6.6 Stock50100150200250SE +/- 0.47, N = 3SE +/- 0.17, N = 3SE +/- 4.81, N = 9213.97222.59250.17

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Ninjav6.7v6.8 20 Janv6.6.6 Stock4080120160200SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 1.94, N = 3128.92129.40162.96

Timed LLVM Compilation

Build System: Unix Makefiles

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix Makefilesv6.8 20 Janv6.7v6.6.6 Stock4080120160200SE +/- 0.48, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3179.85180.19181.65

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To Compilev6.7v6.8 20 Janv6.6.6 Stock306090120150SE +/- 0.15, N = 3SE +/- 0.24, N = 3SE +/- 0.10, N = 3118.05118.90121.21

Timed PHP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9Time To Compilev6.7v6.8 20 Janv6.6.6 Stock612182430SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 326.6926.9227.12

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1Bv6.8 20 Janv6.6.6 Stockv6.73691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 311.0211.0211.06

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 500Mv6.8 20 Janv6.6.6 Stockv6.71.2332.4663.6994.9326.165SE +/- 0.009, N = 3SE +/- 0.006, N = 3SE +/- 0.004, N = 35.4445.4635.480

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4WAV To FLACv6.7v6.8 20 Janv6.6.6 Stock3691215SE +/- 0.02, N = 5SE +/- 0.03, N = 5SE +/- 0.03, N = 512.3712.3812.521. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-Onlyv6.7v6.8 20 Janv6.6.6 Stock48121620SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 317.3817.4017.76

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-Onlyv6.7v6.8 20 Janv6.6.6 Stock4080120160200SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3157.37157.47163.38

Phoronix Test Suite v10.8.5