Arch Linux Kernels

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2301244-NE-ARCHLINUX81&sro.

Arch Linux KernelsProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen Resolution6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rtAMD Ryzen 9 7950X 16-Core @ 4.50GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR X670E HERO (0805 BIOS)AMD Device 14d832GB2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash DriveAMD Radeon RX 6800 XT 16GBAMD Navi 21/23ASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411EndeavourOS rolling6.1.7-arch1-1 (x86_64)KDE Plasma 5.26.5X Server 1.21.1.64.6 Mesa 22.3.3 (LLVM 15.0.7 DRM 3.49)GCC 12.2.1 20230111 + Clang 15.0.7ext41920x10806.1.7-zen1-1-zen (x86_64)6.1.7-hardened1-1-hardened (x86_64)5.15.89-1-lts (x86_64)4.6 Mesa 22.3.3 (LLVM 15.0.7 DRM 3.42)6.0.5.14.realtime1-3-rt (x86_64)4.6 Mesa 22.3.3 (LLVM 15.0.7 DRM 3.48)OpenBenchmarking.orgKernel Details- 6.1.7-arch1-1: Transparent Huge Pages: always- 6.1.7-zen1-1-zen: Transparent Huge Pages: always- 6.1.7-hardened1-1-hardened: Transparent Huge Pages: madvise- 5.15.89-1-lts: Transparent Huge Pages: madviseCompiler Details- --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=c,c++,ada,fortran,go,lto,objc,obj-c++,d --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa601203Graphics Details- GLAMOR - BAR1 / Visible vRAM Size: 16368 MB - vBIOS Version: 113-D4120500-101Python Details- Python 3.10.9Security Details- 6.1.7-arch1-1: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - 6.1.7-zen1-1-zen: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - 6.1.7-hardened1-1-hardened: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - 5.15.89-1-lts: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - 6.0.5.14.realtime1-3-rt: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Arch Linux Kernelsddnet: 1920 x 1080 - Fullscreen - OpenGL 3.3 - Default - RaiNyMore2ddnet: 1920 x 1080 - Fullscreen - Vulkan - Default - RaiNyMore2ddnet: 1920 x 1080 - Fullscreen - Vulkan - Default - Multeasymaptesseract: 1920 x 1080unvanquished: 1920 x 1080 - Ultraxonotic: 1920 x 1080 - Ultimateyquake2: OpenGL 3.x - On - On - 1920 x 1080minibude: OpenMP - BM1minibude: OpenMP - BM1svt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingbuild-ffmpeg: Time To Compilebuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-llvm: Ninjabuild-mplayer: Time To Compiletensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - ResNet-50sqlite-speedtest: Timed Time - Size 1,000darktable: Boat - CPU-onlydarktable: Masskrug - CPU-onlydarktable: Server Rack - CPU-onlydarktable: Server Room - CPU-onlygimp: resizegimp: rotategimp: auto-levelsgimp: unsharp-maskoctave-benchmark: deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamstress-ng: MMAPstress-ng: NUMAstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Forkingstress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: Memory Copyingstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingblender: BMW27 - CPU-Onlyblender: Barbershop - CPU-Onlyopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUselenium: Kraken - Firefoxselenium: Jetstream 2 - Firefoxselenium: Speedometer - Firefoxselenium: PSPDFKit WASM - Firefoxselenium: WASM imageConvolute - Firefoxselenium: WASM collisionDetection - Firefox6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt4910.034861.041507.17973.7836463.2563.89898272091.21418.40756.7365.61772.197207.249211.51617.3947.6251.7960.6719090218439821.52249.40550.362252.75415.22542.3543.9333.8702.2642.4830.1612.20011.2207.7359.05211.2183.67312.6522629.9155444.119717.9999102.362678.1277115.435469.2343299.280226.7191184.256743.405740.0288199.644695.735983.552912.5596634.4209407.79785.884445561.912221.5612097176.21214020.8047547.5738072685.8252713.8134399.81548109.45185.2959197.633468096.84131537.38144964.917718.892274831.95384.9027546281.6149.07464.94795.5810.0428.13283.911875.524.26134.0159.662888.685.541643.004.8626049.310.61492.4201.165281220717.9244.24891.854860.421611.19973.6337462.3599.30079912191.21415.39956.6165.62071.229209.841214.56417.2747.3451.7360.5919053118433121.68849.91550.807255.06915.32642.1943.8833.9522.3252.5020.1622.22111.4317.7649.29211.5113.68812.6238631.0020441.798718.0913100.348179.6944114.719169.6777299.211026.7251185.563243.091740.0991199.217995.536083.726012.5532634.3815425.86776.404644321.741630.5512345529.96214740.9246860.3639894283.1753372.5131308.61584525.32183.9358675.633291676.96130364.49144966.027771.752278175.81382.7128100564.4549.12467.08780.9510.2328.20283.131863.244.29135.7158.902886.025.541689.004.7326031.090.61488.8197.219276222818.0241.74924.684872.721511.62978.7472399.6562.15466991914.91418.55256.7425.44570.023198.220206.80217.0846.5850.7458.2616588118293623.07555.68857.534277.83716.60142.4944.1147.3942.5263.0110.162.54314.73612.16513.77116.7215.46012.6205631.2459441.720018.097799.297980.5322115.987068.8910296.715726.9442183.487543.587339.6356201.701095.709483.575712.5694633.7834306.67804.043966450.671586.007112241.15214272.3147006.8518483969.6542503.9634239.42573189.67186.1159216.413396951.87130527.19145112.047668.062288023.68380.0415168900.9549.68471.91795.3110.0528.22283.121841.224.34136.3958.602887.645.531653.154.8325763.210.62529.7184.757250234818.0246.94815.944773.401421.67717.8427369.1373.10239831601.31419.11356.7654.99361.921173.785182.82516.6342.5145.8252.9416832418373721.92351.85750.772253.51115.86737.6340.6736.5002.3402.7170.1562.32612.6269.69710.86713.3474.65212.4491637.7709408.809219.539793.176485.7560108.331873.7266292.926627.2906179.911844.434838.5542207.346994.529984.598312.3778640.9462501.38246.473700678.411460.2312845717.62216086.5446987.9842863650.6455478.1834371.08548273.67167.5559061.113453178.48130619.50145204.637674.532273538.40387.7013140420.4349.61470.69389.7820.4326.68299.751364.665.83134.6459.322894.605.521166.446.8425715.100.62606.9148.406192254320.7249.64881.244838.301263.69996.0850581.0419.82926342321.21414.43356.5775.51369.361203.918210.97217.0145.6549.3256.3918284418337122.07052.65453.011261.52715.73941.6943.8435.4562.4272.7950.1672.41012.6879.60111.31715.5244.74112.6238631.0400438.493718.2296100.365979.6846115.971268.8752296.762126.9463183.465643.592639.2834203.435895.291283.942412.5606634.163180.4098.844819566.44427.5811921463.80217258.5546858.7030696533.9423051.4134831.08442574.24187.2859150.001533888.38130490.93145022.047744.862289685.59381.628024084.2849.61479.35775.8710.3028.13283.931855.834.30135.3759.042895.585.521647.854.8526196.060.61491.4199.637284211518.1244.3OpenBenchmarking.org

DDraceNetwork

Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: OpenGL 3.3 - Zoom: Default - Demo: RaiNyMore2

OpenBenchmarking.orgFrames Per Second, More Is BetterDDraceNetwork 16.3.2Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: OpenGL 3.3 - Zoom: Default - Demo: RaiNyMore25.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen11002200330044005500SE +/- 25.75, N = 3SE +/- 16.93, N = 3SE +/- 20.89, N = 3SE +/- 28.09, N = 3SE +/- 12.30, N = 34815.944881.244910.034924.684891.851. (CXX) g++ options: -O3 -lrt -ldl -lvulkan -lnotify -lgdk_pixbuf-2.0 -lgio-2.0 -lgobject-2.0 -lglib-2.0 -fuse-ld=gold

DDraceNetwork

Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: Vulkan - Zoom: Default - Demo: RaiNyMore2

OpenBenchmarking.orgFrames Per Second, More Is BetterDDraceNetwork 16.3.2Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: Vulkan - Zoom: Default - Demo: RaiNyMore25.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen10002000300040005000SE +/- 8.60, N = 3SE +/- 5.18, N = 3SE +/- 1.89, N = 3SE +/- 7.64, N = 3SE +/- 6.50, N = 34773.404838.304861.044872.724860.421. (CXX) g++ options: -O3 -lrt -ldl -lvulkan -lnotify -lgdk_pixbuf-2.0 -lgio-2.0 -lgobject-2.0 -lglib-2.0 -fuse-ld=gold

DDraceNetwork

Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: Vulkan - Zoom: Default - Demo: Multeasymap

OpenBenchmarking.orgFrames Per Second, More Is BetterDDraceNetwork 16.3.2Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: Vulkan - Zoom: Default - Demo: Multeasymap5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen30060090012001500SE +/- 16.54, N = 4SE +/- 6.39, N = 3SE +/- 5.82, N = 3SE +/- 14.58, N = 15SE +/- 16.11, N = 51421.671263.691507.171511.621611.191. (CXX) g++ options: -O3 -lrt -ldl -lvulkan -lnotify -lgdk_pixbuf-2.0 -lgio-2.0 -lgobject-2.0 -lglib-2.0 -fuse-ld=gold

Tesseract

Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is BetterTesseract 2014-05-12Resolution: 1920 x 10805.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen2004006008001000SE +/- 7.73, N = 15SE +/- 2.02, N = 3SE +/- 8.30, N = 8SE +/- 13.71, N = 3SE +/- 9.02, N = 7717.84996.09973.78978.75973.63

Unvanquished

Resolution: 1920 x 1080 - Effects Quality: Ultra

OpenBenchmarking.orgFrames Per Second, More Is BetterUnvanquished 0.53Resolution: 1920 x 1080 - Effects Quality: Ultra5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen130260390520650SE +/- 6.75, N = 12SE +/- 1.85, N = 3SE +/- 13.31, N = 15SE +/- 9.80, N = 15SE +/- 7.57, N = 13369.1581.0463.2399.6462.3

Xonotic

Resolution: 1920 x 1080 - Effects Quality: Ultimate

OpenBenchmarking.orgFrames Per Second, More Is BetterXonotic 0.8.5Resolution: 1920 x 1080 - Effects Quality: Ultimate5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen130260390520650SE +/- 2.06, N = 3SE +/- 1.19, N = 3SE +/- 3.09, N = 3SE +/- 2.98, N = 3SE +/- 2.39, N = 3373.10419.83563.90562.15599.30MIN: 84 / MAX: 797MIN: 45 / MAX: 1173MIN: 94 / MAX: 1190MIN: 99 / MAX: 1189MIN: 113 / MAX: 1256

yquake2

Renderer: OpenGL 3.x - AF: On - MSAA: On - Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is Betteryquake2 8.10Renderer: OpenGL 3.x - AF: On - MSAA: On - Resolution: 1920 x 10805.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen5001000150020002500SE +/- 23.06, N = 15SE +/- 24.85, N = 3SE +/- 51.45, N = 15SE +/- 70.34, N = 12SE +/- 65.67, N = 121601.32321.22091.21914.92191.21. (CC) gcc options: -shared -lm -ldl -rdynamic -lSDL2 -O2 -pipe -fomit-frame-pointer -std=gnu99 -fno-strict-aliasing -fwrapv -fvisibility=hidden -MMD -mfpmath=sse -fPIC

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM15.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen30060090012001500SE +/- 1.50, N = 3SE +/- 1.41, N = 3SE +/- 1.41, N = 3SE +/- 1.37, N = 3SE +/- 1.53, N = 31419.111414.431418.411418.551415.401. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM15.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1326395265SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 356.7756.5856.7456.7456.621. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4K5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1.26452.5293.79355.0586.3225SE +/- 0.009, N = 3SE +/- 0.009, N = 3SE +/- 0.011, N = 3SE +/- 0.013, N = 3SE +/- 0.005, N = 34.9935.5135.6175.4455.620

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4K5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1632486480SE +/- 0.36, N = 3SE +/- 0.08, N = 3SE +/- 0.70, N = 3SE +/- 0.74, N = 3SE +/- 0.58, N = 361.9269.3672.2070.0271.23

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4K5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen50100150200250SE +/- 1.92, N = 3SE +/- 1.53, N = 3SE +/- 0.58, N = 3SE +/- 1.05, N = 3SE +/- 0.53, N = 3173.79203.92207.25198.22209.84

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4K5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen50100150200250SE +/- 2.16, N = 3SE +/- 0.77, N = 3SE +/- 0.40, N = 3SE +/- 0.70, N = 3SE +/- 2.15, N = 3182.83210.97211.52206.80214.56

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Medium5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen48121620SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 316.6317.0117.3917.0817.27

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very Fast5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1122334455SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 342.5145.6547.6246.5847.34

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fast5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1224364860SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 345.8249.3251.7950.7451.73

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fast5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1428425670SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.15, N = 3SE +/- 0.02, N = 352.9456.3960.6758.2660.59

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Rating5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen40K80K120K160K200KSE +/- 114.72, N = 3SE +/- 142.43, N = 3SE +/- 144.31, N = 3SE +/- 557.98, N = 3SE +/- 94.07, N = 31683241828441909021658811905311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Rating5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen40K80K120K160K200KSE +/- 346.15, N = 3SE +/- 339.88, N = 3SE +/- 470.90, N = 3SE +/- 718.69, N = 3SE +/- 86.39, N = 31837371833711843981829361843311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 4.4Time To Compile5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen612182430SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 321.9222.0721.5223.0821.69

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To Compile5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1326395265SE +/- 0.11, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.17, N = 351.8652.6549.4155.6949.92

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfig5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1326395265SE +/- 0.56, N = 4SE +/- 0.67, N = 3SE +/- 0.63, N = 3SE +/- 0.76, N = 3SE +/- 0.63, N = 350.7753.0150.3657.5350.81

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: Ninja5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen60120180240300SE +/- 0.15, N = 3SE +/- 3.13, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 0.25, N = 3253.51261.53252.75277.84255.07

Timed MPlayer Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5Time To Compile5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen48121620SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 315.8715.7415.2316.6015.33

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-505.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1020304050SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 337.6341.6942.3542.4942.19

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-505.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1020304050SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 340.6743.8443.9344.1143.88

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,0005.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1122334455SE +/- 0.12, N = 3SE +/- 0.18, N = 3SE +/- 0.11, N = 3SE +/- 0.21, N = 3SE +/- 0.09, N = 336.5035.4633.8747.3933.951. (CC) gcc options: -O2 -lz

Darktable

Test: Boat - Acceleration: CPU-only

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.2.0Test: Boat - Acceleration: CPU-only5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen0.56841.13681.70522.27362.842SE +/- 0.002, N = 3SE +/- 0.010, N = 3SE +/- 0.004, N = 3SE +/- 0.005, N = 3SE +/- 0.014, N = 32.3402.4272.2642.5262.325

Darktable

Test: Masskrug - Acceleration: CPU-only

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.2.0Test: Masskrug - Acceleration: CPU-only5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen0.67751.3552.03252.713.3875SE +/- 0.003, N = 3SE +/- 0.006, N = 3SE +/- 0.017, N = 3SE +/- 0.015, N = 3SE +/- 0.006, N = 32.7172.7952.4833.0112.502

Darktable

Test: Server Rack - Acceleration: CPU-only

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.2.0Test: Server Rack - Acceleration: CPU-only5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen0.03760.07520.11280.15040.188SE +/- 0.000, N = 3SE +/- 0.001, N = 15SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.1560.1670.1610.1600.162

Darktable

Test: Server Room - Acceleration: CPU-only

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.2.0Test: Server Room - Acceleration: CPU-only5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen0.57221.14441.71662.28882.861SE +/- 0.005, N = 3SE +/- 0.001, N = 3SE +/- 0.010, N = 3SE +/- 0.009, N = 3SE +/- 0.012, N = 32.3262.4102.2002.5432.221

GIMP

Test: resize

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.32Test: resize5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen48121620SE +/- 0.12, N = 3SE +/- 0.07, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 312.6312.6911.2214.7411.43

GIMP

Test: rotate

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.32Test: rotate5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen3691215SE +/- 0.027, N = 3SE +/- 0.004, N = 3SE +/- 0.011, N = 3SE +/- 0.049, N = 3SE +/- 0.025, N = 39.6979.6017.73512.1657.764

GIMP

Test: auto-levels

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.32Test: auto-levels5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen48121620SE +/- 0.009, N = 3SE +/- 0.005, N = 3SE +/- 0.015, N = 3SE +/- 0.021, N = 3SE +/- 0.007, N = 310.86711.3179.05213.7719.292

GIMP

Test: unsharp-mask

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.32Test: unsharp-mask5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen48121620SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 313.3515.5211.2216.7211.51

GNU Octave Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 7.3.05.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1.22852.4573.68554.9146.1425SE +/- 0.025, N = 5SE +/- 0.032, N = 5SE +/- 0.031, N = 5SE +/- 0.029, N = 5SE +/- 0.020, N = 54.6524.7413.6735.4603.688

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen3691215SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 312.4512.6212.6512.6212.62

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen140280420560700SE +/- 0.76, N = 3SE +/- 1.03, N = 3SE +/- 1.30, N = 3SE +/- 0.62, N = 3SE +/- 1.42, N = 3637.77631.04629.92631.25631.00

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen100200300400500SE +/- 0.32, N = 3SE +/- 1.36, N = 3SE +/- 0.38, N = 3SE +/- 0.87, N = 3SE +/- 1.06, N = 3408.81438.49444.12441.72441.80

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen510152025SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 319.5418.2318.0018.1018.09

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen20406080100SE +/- 0.07, N = 3SE +/- 0.33, N = 3SE +/- 0.29, N = 3SE +/- 1.11, N = 3SE +/- 0.87, N = 393.18100.37102.3699.30100.35

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen20406080100SE +/- 0.05, N = 3SE +/- 0.26, N = 3SE +/- 0.22, N = 3SE +/- 0.91, N = 3SE +/- 0.68, N = 385.7679.6878.1380.5379.69

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen306090120150SE +/- 0.20, N = 3SE +/- 0.27, N = 3SE +/- 0.37, N = 3SE +/- 0.32, N = 3SE +/- 0.69, N = 3108.33115.97115.44115.99114.72

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1632486480SE +/- 0.13, N = 3SE +/- 0.16, N = 3SE +/- 0.20, N = 3SE +/- 0.18, N = 3SE +/- 0.42, N = 373.7368.8869.2368.8969.68

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen70140210280350SE +/- 0.19, N = 3SE +/- 0.27, N = 3SE +/- 0.19, N = 3SE +/- 0.29, N = 3SE +/- 0.14, N = 3292.93296.76299.28296.72299.21

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen612182430SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 327.2926.9526.7226.9426.73

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen4080120160200SE +/- 0.77, N = 3SE +/- 0.48, N = 3SE +/- 0.45, N = 3SE +/- 0.19, N = 3SE +/- 0.48, N = 3179.91183.47184.26183.49185.56

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1020304050SE +/- 0.19, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 344.4343.5943.4143.5943.09

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen918273645SE +/- 0.16, N = 3SE +/- 0.25, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.09, N = 338.5539.2840.0339.6440.10

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen50100150200250SE +/- 0.81, N = 3SE +/- 1.25, N = 3SE +/- 0.93, N = 3SE +/- 0.97, N = 3SE +/- 0.35, N = 3207.35203.44199.64201.70199.22

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen20406080100SE +/- 0.08, N = 3SE +/- 0.40, N = 3SE +/- 0.36, N = 3SE +/- 0.37, N = 3SE +/- 0.25, N = 394.5395.2995.7495.7195.54

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen20406080100SE +/- 0.08, N = 3SE +/- 0.36, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.22, N = 384.6083.9483.5583.5883.73

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 312.3812.5612.5612.5712.55

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen140280420560700SE +/- 0.35, N = 3SE +/- 0.74, N = 3SE +/- 0.52, N = 3SE +/- 0.44, N = 3SE +/- 0.52, N = 3640.95634.16634.42633.78634.38

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAP5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen110220330440550SE +/- 0.39, N = 3SE +/- 0.34, N = 3SE +/- 0.23, N = 3SE +/- 0.19, N = 3SE +/- 6.69, N = 14501.3880.40407.79306.67425.861. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMA5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen2004006008001000SE +/- 3.20, N = 15SE +/- 0.35, N = 3SE +/- 0.32, N = 3SE +/- 1.04, N = 3SE +/- 1.69, N = 3246.4798.84785.88804.04776.401. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Futex5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1000K2000K3000K4000K5000KSE +/- 37418.58, N = 15SE +/- 27792.65, N = 3SE +/- 29635.02, N = 3SE +/- 48998.53, N = 4SE +/- 50913.28, N = 33700678.414819566.444445561.913966450.674644321.741. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MEMFD5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen5001000150020002500SE +/- 1.00, N = 3SE +/- 0.29, N = 3SE +/- 0.44, N = 3SE +/- 0.43, N = 3SE +/- 1.98, N = 31460.23427.582221.561586.001630.551. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Mutex5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen3M6M9M12M15MSE +/- 32569.81, N = 3SE +/- 38080.32, N = 3SE +/- 10423.43, N = 3SE +/- 9491.75, N = 3SE +/- 47366.97, N = 312845717.6211921463.8012097176.217112241.1512345529.961. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Atomic5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen50K100K150K200K250KSE +/- 2686.92, N = 4SE +/- 2704.21, N = 4SE +/- 340.81, N = 3SE +/- 300.24, N = 3SE +/- 192.69, N = 3216086.54217258.55214020.80214272.31214740.921. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Crypto5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen10K20K30K40K50KSE +/- 23.83, N = 3SE +/- 47.73, N = 3SE +/- 658.64, N = 3SE +/- 55.20, N = 3SE +/- 34.27, N = 346987.9846858.7047547.5747006.8546860.361. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Malloc5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen9M18M27M36M45MSE +/- 495800.55, N = 3SE +/- 54240.16, N = 3SE +/- 185370.70, N = 3SE +/- 139546.62, N = 3SE +/- 199431.80, N = 342863650.6430696533.9438072685.8218483969.6539894283.171. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Forking5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen12K24K36K48K60KSE +/- 684.13, N = 4SE +/- 40.28, N = 3SE +/- 205.39, N = 3SE +/- 127.13, N = 3SE +/- 174.14, N = 355478.1823051.4152713.8142503.9653372.511. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uring5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen7K14K21K28K35KSE +/- 447.95, N = 15SE +/- 438.08, N = 14SE +/- 17.80, N = 3SE +/- 12.67, N = 3SE +/- 76.33, N = 334371.0834831.0834399.8134239.4231308.611. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILE5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen130K260K390K520K650KSE +/- 5544.14, N = 6SE +/- 823.21, N = 3SE +/- 1196.90, N = 3SE +/- 587.35, N = 3SE +/- 5514.19, N = 7548273.67442574.24548109.45573189.67584525.321. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU Cache5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen4080120160200SE +/- 2.31, N = 13SE +/- 1.90, N = 15SE +/- 2.31, N = 15SE +/- 1.81, N = 15SE +/- 4.24, N = 12167.55187.28185.29186.11183.931. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU Stress5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen13K26K39K52K65KSE +/- 620.04, N = 5SE +/- 526.23, N = 3SE +/- 484.41, N = 15SE +/- 307.43, N = 3SE +/- 296.78, N = 359061.1159150.0059197.6359216.4158675.631. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Semaphores5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen700K1400K2100K2800K3500KSE +/- 42045.87, N = 4SE +/- 42155.38, N = 14SE +/- 417.33, N = 3SE +/- 1870.40, N = 3SE +/- 1075.15, N = 33453178.481533888.383468096.843396951.873291676.961. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Matrix Math5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen30K60K90K120K150KSE +/- 105.16, N = 3SE +/- 91.82, N = 3SE +/- 1320.33, N = 6SE +/- 208.09, N = 3SE +/- 87.49, N = 3130619.50130490.93131537.38130527.19130364.491. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Vector Math5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen30K60K90K120K150KSE +/- 38.01, N = 3SE +/- 66.11, N = 3SE +/- 28.55, N = 3SE +/- 1.65, N = 3SE +/- 27.67, N = 3145204.63145022.04144964.91145112.04144966.021. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Memory Copying5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen17003400510068008500SE +/- 7.12, N = 3SE +/- 1.76, N = 3SE +/- 13.17, N = 3SE +/- 6.09, N = 3SE +/- 26.92, N = 37674.537744.867718.897668.067771.751. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc C String Functions5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen500K1000K1500K2000K2500KSE +/- 3211.48, N = 3SE +/- 17316.06, N = 3SE +/- 22966.43, N = 3SE +/- 1145.85, N = 3SE +/- 17802.28, N = 32273538.402289685.592274831.952288023.682278175.811. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc Qsort Data Sorting5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen80160240320400SE +/- 3.22, N = 3SE +/- 1.89, N = 3SE +/- 1.71, N = 3SE +/- 3.49, N = 3SE +/- 4.63, N = 3387.70381.62384.90380.04382.711. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: System V Message Passing5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen6M12M18M24M30MSE +/- 46317.96, N = 3SE +/- 11015.63, N = 3SE +/- 17548.66, N = 3SE +/- 31377.41, N = 3SE +/- 7184.14, N = 313140420.438024084.2827546281.6115168900.9528100564.451. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-Only5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1122334455SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 349.6149.6149.0749.6849.12

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-Only5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen100200300400500SE +/- 0.14, N = 3SE +/- 0.19, N = 3SE +/- 0.78, N = 3SE +/- 0.74, N = 3SE +/- 2.02, N = 3470.69479.35464.94471.91467.08

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen2004006008001000SE +/- 0.89, N = 3SE +/- 1.74, N = 3SE +/- 0.82, N = 3SE +/- 1.61, N = 3SE +/- 3.73, N = 3389.78775.87795.58795.31780.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen510152025SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 320.4310.3010.0410.0510.23MIN: 5.47 / MAX: 35.69MIN: 6.55 / MAX: 20.69MIN: 3.66 / MAX: 20.43MIN: 3.81 / MAX: 18.16MIN: 4.91 / MAX: 22.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen714212835SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 326.6828.1328.1328.2228.201. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen70140210280350SE +/- 0.14, N = 3SE +/- 0.21, N = 3SE +/- 0.16, N = 3SE +/- 0.58, N = 3SE +/- 0.84, N = 3299.75283.93283.91283.12283.13MIN: 278.17 / MAX: 332.75MIN: 274.3 / MAX: 310.57MIN: 269.66 / MAX: 311MIN: 267.4 / MAX: 303.06MIN: 235.07 / MAX: 321.61. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen400800120016002000SE +/- 13.97, N = 15SE +/- 2.87, N = 3SE +/- 4.81, N = 3SE +/- 4.35, N = 3SE +/- 6.23, N = 31364.661855.831875.521841.221863.241. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1.31182.62363.93545.24726.559SE +/- 0.06, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.834.304.264.344.29MIN: 2.69 / MAX: 18.68MIN: 2.67 / MAX: 10.33MIN: 2.75 / MAX: 12.01MIN: 2.84 / MAX: 10.64MIN: 2.63 / MAX: 10.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen306090120150SE +/- 0.49, N = 3SE +/- 0.08, N = 3SE +/- 1.50, N = 4SE +/- 0.89, N = 3SE +/- 1.14, N = 3134.64135.37134.01136.39135.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1326395265SE +/- 0.21, N = 3SE +/- 0.04, N = 3SE +/- 0.67, N = 4SE +/- 0.38, N = 3SE +/- 0.49, N = 359.3259.0459.6658.6058.90MIN: 31.01 / MAX: 70.61MIN: 29.94 / MAX: 77.07MIN: 30.41 / MAX: 70.12MIN: 31.74 / MAX: 67.18MIN: 50.98 / MAX: 70.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen6001200180024003000SE +/- 0.46, N = 3SE +/- 1.08, N = 3SE +/- 1.40, N = 3SE +/- 3.89, N = 3SE +/- 2.52, N = 32894.602895.582888.682887.642886.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen1.24652.4933.73954.9866.2325SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.525.525.545.535.54MIN: 3.31 / MAX: 11.97MIN: 3.14 / MAX: 10.61MIN: 3.02 / MAX: 12.09MIN: 3.23 / MAX: 11.46MIN: 2.93 / MAX: 11.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen400800120016002000SE +/- 4.51, N = 3SE +/- 17.23, N = 3SE +/- 22.46, N = 3SE +/- 14.29, N = 3SE +/- 13.73, N = 31166.441647.851643.001653.151689.001. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen246810SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 36.844.854.864.834.73MIN: 3.36 / MAX: 16MIN: 3.74 / MAX: 10.97MIN: 3.72 / MAX: 10.29MIN: 3.22 / MAX: 10.91MIN: 3.68 / MAX: 11.941. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen6K12K18K24K30KSE +/- 213.35, N = 3SE +/- 17.22, N = 3SE +/- 19.26, N = 3SE +/- 9.04, N = 3SE +/- 11.91, N = 325715.1026196.0626049.3125763.2126031.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen0.13950.2790.41850.5580.6975SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.620.610.610.620.61MIN: 0.34 / MAX: 5.06MIN: 0.32 / MAX: 3.84MIN: 0.34 / MAX: 2.54MIN: 0.33 / MAX: 3.78MIN: 0.34 / MAX: 2.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Selenium

Benchmark: Kraken - Browser: Firefox

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Firefox5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen130260390520650SE +/- 4.20, N = 3SE +/- 0.90, N = 3SE +/- 2.50, N = 3SE +/- 2.49, N = 3SE +/- 1.90, N = 3606.9491.4492.4529.7488.81. firefox 109.0

Selenium

Benchmark: Jetstream 2 - Browser: Firefox

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: Firefox5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen4080120160200SE +/- 0.61, N = 3SE +/- 0.74, N = 3SE +/- 0.32, N = 3SE +/- 0.49, N = 3SE +/- 2.14, N = 3148.41199.64201.17184.76197.221. firefox 109.0

Selenium

Benchmark: Speedometer - Browser: Firefox

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Firefox5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen60120180240300SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 2.08, N = 3SE +/- 1.76, N = 3SE +/- 0.58, N = 31922842812502761. firefox 109.0

Selenium

Benchmark: PSPDFKit WASM - Browser: Firefox

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: Firefox5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen5001000150020002500SE +/- 11.50, N = 3SE +/- 5.46, N = 3SE +/- 22.88, N = 3SE +/- 12.50, N = 3SE +/- 8.51, N = 3254321152207234822281. firefox 109.0

Selenium

Benchmark: WASM imageConvolute - Browser: Firefox

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: Firefox5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen510152025SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 320.718.117.918.018.01. firefox 109.0

Selenium

Benchmark: WASM collisionDetection - Browser: Firefox

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Firefox5.15.89-1-lts6.0.5.14.realtime1-3-rt6.1.7-arch1-16.1.7-hardened1-1-hardened6.1.7-zen1-1-zen50100150200250SE +/- 1.67, N = 3SE +/- 1.39, N = 3SE +/- 2.08, N = 3SE +/- 0.65, N = 3SE +/- 1.58, N = 3249.6244.3244.2246.9241.71. firefox 109.0

Phoronix Test Suite v10.8.5