Arch Linux Kernels

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2301244-NE-ARCHLINUX81&rdt.

Arch Linux KernelsProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen Resolution6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rtAMD Ryzen 9 7950X 16-Core @ 4.50GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR X670E HERO (0805 BIOS)AMD Device 14d832GB2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash DriveAMD Radeon RX 6800 XT 16GBAMD Navi 21/23ASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411EndeavourOS rolling6.1.7-arch1-1 (x86_64)KDE Plasma 5.26.5X Server 1.21.1.64.6 Mesa 22.3.3 (LLVM 15.0.7 DRM 3.49)GCC 12.2.1 20230111 + Clang 15.0.7ext41920x10806.1.7-zen1-1-zen (x86_64)6.1.7-hardened1-1-hardened (x86_64)5.15.89-1-lts (x86_64)4.6 Mesa 22.3.3 (LLVM 15.0.7 DRM 3.42)6.0.5.14.realtime1-3-rt (x86_64)4.6 Mesa 22.3.3 (LLVM 15.0.7 DRM 3.48)OpenBenchmarking.orgKernel Details- 6.1.7-arch1-1: Transparent Huge Pages: always- 6.1.7-zen1-1-zen: Transparent Huge Pages: always- 6.1.7-hardened1-1-hardened: Transparent Huge Pages: madvise- 5.15.89-1-lts: Transparent Huge Pages: madviseCompiler Details- --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=c,c++,ada,fortran,go,lto,objc,obj-c++,d --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa601203Graphics Details- GLAMOR - BAR1 / Visible vRAM Size: 16368 MB - vBIOS Version: 113-D4120500-101Python Details- Python 3.10.9Security Details- 6.1.7-arch1-1: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - 6.1.7-zen1-1-zen: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - 6.1.7-hardened1-1-hardened: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - 5.15.89-1-lts: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - 6.0.5.14.realtime1-3-rt: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Arch Linux Kernelsddnet: 1920 x 1080 - Fullscreen - OpenGL 3.3 - Default - RaiNyMore2ddnet: 1920 x 1080 - Fullscreen - Vulkan - Default - RaiNyMore2ddnet: 1920 x 1080 - Fullscreen - Vulkan - Default - Multeasymaptesseract: 1920 x 1080unvanquished: 1920 x 1080 - Ultraxonotic: 1920 x 1080 - Ultimateyquake2: OpenGL 3.x - On - On - 1920 x 1080minibude: OpenMP - BM1minibude: OpenMP - BM1svt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingbuild-ffmpeg: Time To Compilebuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-llvm: Ninjabuild-mplayer: Time To Compiletensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - ResNet-50sqlite-speedtest: Timed Time - Size 1,000darktable: Boat - CPU-onlydarktable: Masskrug - CPU-onlydarktable: Server Rack - CPU-onlydarktable: Server Room - CPU-onlygimp: resizegimp: rotategimp: auto-levelsgimp: unsharp-maskoctave-benchmark: deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamstress-ng: MMAPstress-ng: NUMAstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Forkingstress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: Memory Copyingstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingblender: BMW27 - CPU-Onlyblender: Barbershop - CPU-Onlyopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUselenium: Kraken - Firefoxselenium: Jetstream 2 - Firefoxselenium: Speedometer - Firefoxselenium: PSPDFKit WASM - Firefoxselenium: WASM imageConvolute - Firefoxselenium: WASM collisionDetection - Firefox6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt4910.034861.041507.17973.7836463.2563.89898272091.21418.40756.7365.61772.197207.249211.51617.3947.6251.7960.6719090218439821.52249.40550.362252.75415.22542.3543.9333.8702.2642.4830.1612.20011.2207.7359.05211.2183.67312.6522629.9155444.119717.9999102.362678.1277115.435469.2343299.280226.7191184.256743.405740.0288199.644695.735983.552912.5596634.4209407.79785.884445561.912221.5612097176.21214020.8047547.5738072685.8252713.8134399.81548109.45185.2959197.633468096.84131537.38144964.917718.892274831.95384.9027546281.6149.07464.94795.5810.0428.13283.911875.524.26134.0159.662888.685.541643.004.8626049.310.61492.4201.165281220717.9244.24891.854860.421611.19973.6337462.3599.30079912191.21415.39956.6165.62071.229209.841214.56417.2747.3451.7360.5919053118433121.68849.91550.807255.06915.32642.1943.8833.9522.3252.5020.1622.22111.4317.7649.29211.5113.68812.6238631.0020441.798718.0913100.348179.6944114.719169.6777299.211026.7251185.563243.091740.0991199.217995.536083.726012.5532634.3815425.86776.404644321.741630.5512345529.96214740.9246860.3639894283.1753372.5131308.61584525.32183.9358675.633291676.96130364.49144966.027771.752278175.81382.7128100564.4549.12467.08780.9510.2328.20283.131863.244.29135.7158.902886.025.541689.004.7326031.090.61488.8197.219276222818.0241.74924.684872.721511.62978.7472399.6562.15466991914.91418.55256.7425.44570.023198.220206.80217.0846.5850.7458.2616588118293623.07555.68857.534277.83716.60142.4944.1147.3942.5263.0110.162.54314.73612.16513.77116.7215.46012.6205631.2459441.720018.097799.297980.5322115.987068.8910296.715726.9442183.487543.587339.6356201.701095.709483.575712.5694633.7834306.67804.043966450.671586.007112241.15214272.3147006.8518483969.6542503.9634239.42573189.67186.1159216.413396951.87130527.19145112.047668.062288023.68380.0415168900.9549.68471.91795.3110.0528.22283.121841.224.34136.3958.602887.645.531653.154.8325763.210.62529.7184.757250234818.0246.94815.944773.401421.67717.8427369.1373.10239831601.31419.11356.7654.99361.921173.785182.82516.6342.5145.8252.9416832418373721.92351.85750.772253.51115.86737.6340.6736.5002.3402.7170.1562.32612.6269.69710.86713.3474.65212.4491637.7709408.809219.539793.176485.7560108.331873.7266292.926627.2906179.911844.434838.5542207.346994.529984.598312.3778640.9462501.38246.473700678.411460.2312845717.62216086.5446987.9842863650.6455478.1834371.08548273.67167.5559061.113453178.48130619.50145204.637674.532273538.40387.7013140420.4349.61470.69389.7820.4326.68299.751364.665.83134.6459.322894.605.521166.446.8425715.100.62606.9148.406192254320.7249.64881.244838.301263.69996.0850581.0419.82926342321.21414.43356.5775.51369.361203.918210.97217.0145.6549.3256.3918284418337122.07052.65453.011261.52715.73941.6943.8435.4562.4272.7950.1672.41012.6879.60111.31715.5244.74112.6238631.0400438.493718.2296100.365979.6846115.971268.8752296.762126.9463183.465643.592639.2834203.435895.291283.942412.5606634.163180.4098.844819566.44427.5811921463.80217258.5546858.7030696533.9423051.4134831.08442574.24187.2859150.001533888.38130490.93145022.047744.862289685.59381.628024084.2849.61479.35775.8710.3028.13283.931855.834.30135.3759.042895.585.521647.854.8526196.060.61491.4199.637284211518.1244.3OpenBenchmarking.org

DDraceNetwork

Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: OpenGL 3.3 - Zoom: Default - Demo: RaiNyMore2

OpenBenchmarking.orgFrames Per Second, More Is BetterDDraceNetwork 16.3.2Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: OpenGL 3.3 - Zoom: Default - Demo: RaiNyMore26.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt11002200330044005500SE +/- 20.89, N = 3SE +/- 12.30, N = 3SE +/- 28.09, N = 3SE +/- 25.75, N = 3SE +/- 16.93, N = 34910.034891.854924.684815.944881.241. (CXX) g++ options: -O3 -lrt -ldl -lvulkan -lnotify -lgdk_pixbuf-2.0 -lgio-2.0 -lgobject-2.0 -lglib-2.0 -fuse-ld=gold

DDraceNetwork

Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: Vulkan - Zoom: Default - Demo: RaiNyMore2

OpenBenchmarking.orgFrames Per Second, More Is BetterDDraceNetwork 16.3.2Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: Vulkan - Zoom: Default - Demo: RaiNyMore26.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt10002000300040005000SE +/- 1.89, N = 3SE +/- 6.50, N = 3SE +/- 7.64, N = 3SE +/- 8.60, N = 3SE +/- 5.18, N = 34861.044860.424872.724773.404838.301. (CXX) g++ options: -O3 -lrt -ldl -lvulkan -lnotify -lgdk_pixbuf-2.0 -lgio-2.0 -lgobject-2.0 -lglib-2.0 -fuse-ld=gold

DDraceNetwork

Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: Vulkan - Zoom: Default - Demo: Multeasymap

OpenBenchmarking.orgFrames Per Second, More Is BetterDDraceNetwork 16.3.2Resolution: 1920 x 1080 - Mode: Fullscreen - Renderer: Vulkan - Zoom: Default - Demo: Multeasymap6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt30060090012001500SE +/- 5.82, N = 3SE +/- 16.11, N = 5SE +/- 14.58, N = 15SE +/- 16.54, N = 4SE +/- 6.39, N = 31507.171611.191511.621421.671263.691. (CXX) g++ options: -O3 -lrt -ldl -lvulkan -lnotify -lgdk_pixbuf-2.0 -lgio-2.0 -lgobject-2.0 -lglib-2.0 -fuse-ld=gold

Tesseract

Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is BetterTesseract 2014-05-12Resolution: 1920 x 10806.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt2004006008001000SE +/- 8.30, N = 8SE +/- 9.02, N = 7SE +/- 13.71, N = 3SE +/- 7.73, N = 15SE +/- 2.02, N = 3973.78973.63978.75717.84996.09

Unvanquished

Resolution: 1920 x 1080 - Effects Quality: Ultra

OpenBenchmarking.orgFrames Per Second, More Is BetterUnvanquished 0.53Resolution: 1920 x 1080 - Effects Quality: Ultra6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt130260390520650SE +/- 13.31, N = 15SE +/- 7.57, N = 13SE +/- 9.80, N = 15SE +/- 6.75, N = 12SE +/- 1.85, N = 3463.2462.3399.6369.1581.0

Xonotic

Resolution: 1920 x 1080 - Effects Quality: Ultimate

OpenBenchmarking.orgFrames Per Second, More Is BetterXonotic 0.8.5Resolution: 1920 x 1080 - Effects Quality: Ultimate6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt130260390520650SE +/- 3.09, N = 3SE +/- 2.39, N = 3SE +/- 2.98, N = 3SE +/- 2.06, N = 3SE +/- 1.19, N = 3563.90599.30562.15373.10419.83MIN: 94 / MAX: 1190MIN: 113 / MAX: 1256MIN: 99 / MAX: 1189MIN: 84 / MAX: 797MIN: 45 / MAX: 1173

yquake2

Renderer: OpenGL 3.x - AF: On - MSAA: On - Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is Betteryquake2 8.10Renderer: OpenGL 3.x - AF: On - MSAA: On - Resolution: 1920 x 10806.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt5001000150020002500SE +/- 51.45, N = 15SE +/- 65.67, N = 12SE +/- 70.34, N = 12SE +/- 23.06, N = 15SE +/- 24.85, N = 32091.22191.21914.91601.32321.21. (CC) gcc options: -shared -lm -ldl -rdynamic -lSDL2 -O2 -pipe -fomit-frame-pointer -std=gnu99 -fno-strict-aliasing -fwrapv -fvisibility=hidden -MMD -mfpmath=sse -fPIC

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM16.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt30060090012001500SE +/- 1.41, N = 3SE +/- 1.53, N = 3SE +/- 1.37, N = 3SE +/- 1.50, N = 3SE +/- 1.41, N = 31418.411415.401418.551419.111414.431. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM16.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1326395265SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 356.7456.6256.7456.7756.581. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4K6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1.26452.5293.79355.0586.3225SE +/- 0.011, N = 3SE +/- 0.005, N = 3SE +/- 0.013, N = 3SE +/- 0.009, N = 3SE +/- 0.009, N = 35.6175.6205.4454.9935.513

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4K6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1632486480SE +/- 0.70, N = 3SE +/- 0.58, N = 3SE +/- 0.74, N = 3SE +/- 0.36, N = 3SE +/- 0.08, N = 372.2071.2370.0261.9269.36

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4K6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt50100150200250SE +/- 0.58, N = 3SE +/- 0.53, N = 3SE +/- 1.05, N = 3SE +/- 1.92, N = 3SE +/- 1.53, N = 3207.25209.84198.22173.79203.92

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4K6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt50100150200250SE +/- 0.40, N = 3SE +/- 2.15, N = 3SE +/- 0.70, N = 3SE +/- 2.16, N = 3SE +/- 0.77, N = 3211.52214.56206.80182.83210.97

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Medium6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt48121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 317.3917.2717.0816.6317.01

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very Fast6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1122334455SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 347.6247.3446.5842.5145.65

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fast6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1224364860SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 351.7951.7350.7445.8249.32

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fast6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1428425670SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 360.6760.5958.2652.9456.39

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Rating6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt40K80K120K160K200KSE +/- 144.31, N = 3SE +/- 94.07, N = 3SE +/- 557.98, N = 3SE +/- 114.72, N = 3SE +/- 142.43, N = 31909021905311658811683241828441. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Rating6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt40K80K120K160K200KSE +/- 470.90, N = 3SE +/- 86.39, N = 3SE +/- 718.69, N = 3SE +/- 346.15, N = 3SE +/- 339.88, N = 31843981843311829361837371833711. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 4.4Time To Compile6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt612182430SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 321.5221.6923.0821.9222.07

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To Compile6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1326395265SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 349.4149.9255.6951.8652.65

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfig6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1326395265SE +/- 0.63, N = 3SE +/- 0.63, N = 3SE +/- 0.76, N = 3SE +/- 0.56, N = 4SE +/- 0.67, N = 350.3650.8157.5350.7753.01

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: Ninja6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt60120180240300SE +/- 0.17, N = 3SE +/- 0.25, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 3.13, N = 3252.75255.07277.84253.51261.53

Timed MPlayer Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5Time To Compile6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 315.2315.3316.6015.8715.74

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-506.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1020304050SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 342.3542.1942.4937.6341.69

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-506.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1020304050SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 343.9343.8844.1140.6743.84

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,0006.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1122334455SE +/- 0.11, N = 3SE +/- 0.09, N = 3SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.18, N = 333.8733.9547.3936.5035.461. (CC) gcc options: -O2 -lz

Darktable

Test: Boat - Acceleration: CPU-only

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.2.0Test: Boat - Acceleration: CPU-only6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt0.56841.13681.70522.27362.842SE +/- 0.004, N = 3SE +/- 0.014, N = 3SE +/- 0.005, N = 3SE +/- 0.002, N = 3SE +/- 0.010, N = 32.2642.3252.5262.3402.427

Darktable

Test: Masskrug - Acceleration: CPU-only

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.2.0Test: Masskrug - Acceleration: CPU-only6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt0.67751.3552.03252.713.3875SE +/- 0.017, N = 3SE +/- 0.006, N = 3SE +/- 0.015, N = 3SE +/- 0.003, N = 3SE +/- 0.006, N = 32.4832.5023.0112.7172.795

Darktable

Test: Server Rack - Acceleration: CPU-only

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.2.0Test: Server Rack - Acceleration: CPU-only6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt0.03760.07520.11280.15040.188SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 150.1610.1620.1600.1560.167

Darktable

Test: Server Room - Acceleration: CPU-only

OpenBenchmarking.orgSeconds, Fewer Is BetterDarktable 4.2.0Test: Server Room - Acceleration: CPU-only6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt0.57221.14441.71662.28882.861SE +/- 0.010, N = 3SE +/- 0.012, N = 3SE +/- 0.009, N = 3SE +/- 0.005, N = 3SE +/- 0.001, N = 32.2002.2212.5432.3262.410

GIMP

Test: resize

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.32Test: resize6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt48121620SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 311.2211.4314.7412.6312.69

GIMP

Test: rotate

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.32Test: rotate6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt3691215SE +/- 0.011, N = 3SE +/- 0.025, N = 3SE +/- 0.049, N = 3SE +/- 0.027, N = 3SE +/- 0.004, N = 37.7357.76412.1659.6979.601

GIMP

Test: auto-levels

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.32Test: auto-levels6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt48121620SE +/- 0.015, N = 3SE +/- 0.007, N = 3SE +/- 0.021, N = 3SE +/- 0.009, N = 3SE +/- 0.005, N = 39.0529.29213.77110.86711.317

GIMP

Test: unsharp-mask

OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.32Test: unsharp-mask6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt48121620SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 311.2211.5116.7213.3515.52

GNU Octave Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterGNU Octave Benchmark 7.3.06.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1.22852.4573.68554.9146.1425SE +/- 0.031, N = 5SE +/- 0.020, N = 5SE +/- 0.029, N = 5SE +/- 0.025, N = 5SE +/- 0.032, N = 53.6733.6885.4604.6524.741

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt3691215SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 312.6512.6212.6212.4512.62

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt140280420560700SE +/- 1.30, N = 3SE +/- 1.42, N = 3SE +/- 0.62, N = 3SE +/- 0.76, N = 3SE +/- 1.03, N = 3629.92631.00631.25637.77631.04

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt100200300400500SE +/- 0.38, N = 3SE +/- 1.06, N = 3SE +/- 0.87, N = 3SE +/- 0.32, N = 3SE +/- 1.36, N = 3444.12441.80441.72408.81438.49

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt510152025SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 318.0018.0918.1019.5418.23

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt20406080100SE +/- 0.29, N = 3SE +/- 0.87, N = 3SE +/- 1.11, N = 3SE +/- 0.07, N = 3SE +/- 0.33, N = 3102.36100.3599.3093.18100.37

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt20406080100SE +/- 0.22, N = 3SE +/- 0.68, N = 3SE +/- 0.91, N = 3SE +/- 0.05, N = 3SE +/- 0.26, N = 378.1379.6980.5385.7679.68

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt306090120150SE +/- 0.37, N = 3SE +/- 0.69, N = 3SE +/- 0.32, N = 3SE +/- 0.20, N = 3SE +/- 0.27, N = 3115.44114.72115.99108.33115.97

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1632486480SE +/- 0.20, N = 3SE +/- 0.42, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.16, N = 369.2369.6868.8973.7368.88

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt70140210280350SE +/- 0.19, N = 3SE +/- 0.14, N = 3SE +/- 0.29, N = 3SE +/- 0.19, N = 3SE +/- 0.27, N = 3299.28299.21296.72292.93296.76

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt612182430SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 326.7226.7326.9427.2926.95

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt4080120160200SE +/- 0.45, N = 3SE +/- 0.48, N = 3SE +/- 0.19, N = 3SE +/- 0.77, N = 3SE +/- 0.48, N = 3184.26185.56183.49179.91183.47

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1020304050SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.11, N = 343.4143.0943.5944.4343.59

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt918273645SE +/- 0.16, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.25, N = 340.0340.1039.6438.5539.28

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt50100150200250SE +/- 0.93, N = 3SE +/- 0.35, N = 3SE +/- 0.97, N = 3SE +/- 0.81, N = 3SE +/- 1.25, N = 3199.64199.22201.70207.35203.44

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt20406080100SE +/- 0.36, N = 3SE +/- 0.25, N = 3SE +/- 0.37, N = 3SE +/- 0.08, N = 3SE +/- 0.40, N = 395.7495.5495.7194.5395.29

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt20406080100SE +/- 0.32, N = 3SE +/- 0.22, N = 3SE +/- 0.33, N = 3SE +/- 0.08, N = 3SE +/- 0.36, N = 383.5583.7383.5884.6083.94

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt3691215SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 312.5612.5512.5712.3812.56

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt140280420560700SE +/- 0.52, N = 3SE +/- 0.52, N = 3SE +/- 0.44, N = 3SE +/- 0.35, N = 3SE +/- 0.74, N = 3634.42634.38633.78640.95634.16

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAP6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt110220330440550SE +/- 0.23, N = 3SE +/- 6.69, N = 14SE +/- 0.19, N = 3SE +/- 0.39, N = 3SE +/- 0.34, N = 3407.79425.86306.67501.3880.401. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMA6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt2004006008001000SE +/- 0.32, N = 3SE +/- 1.69, N = 3SE +/- 1.04, N = 3SE +/- 3.20, N = 15SE +/- 0.35, N = 3785.88776.40804.04246.4798.841. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Futex6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1000K2000K3000K4000K5000KSE +/- 29635.02, N = 3SE +/- 50913.28, N = 3SE +/- 48998.53, N = 4SE +/- 37418.58, N = 15SE +/- 27792.65, N = 34445561.914644321.743966450.673700678.414819566.441. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MEMFD6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt5001000150020002500SE +/- 0.44, N = 3SE +/- 1.98, N = 3SE +/- 0.43, N = 3SE +/- 1.00, N = 3SE +/- 0.29, N = 32221.561630.551586.001460.23427.581. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Mutex6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt3M6M9M12M15MSE +/- 10423.43, N = 3SE +/- 47366.97, N = 3SE +/- 9491.75, N = 3SE +/- 32569.81, N = 3SE +/- 38080.32, N = 312097176.2112345529.967112241.1512845717.6211921463.801. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Atomic6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt50K100K150K200K250KSE +/- 340.81, N = 3SE +/- 192.69, N = 3SE +/- 300.24, N = 3SE +/- 2686.92, N = 4SE +/- 2704.21, N = 4214020.80214740.92214272.31216086.54217258.551. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Crypto6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt10K20K30K40K50KSE +/- 658.64, N = 3SE +/- 34.27, N = 3SE +/- 55.20, N = 3SE +/- 23.83, N = 3SE +/- 47.73, N = 347547.5746860.3647006.8546987.9846858.701. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Malloc6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt9M18M27M36M45MSE +/- 185370.70, N = 3SE +/- 199431.80, N = 3SE +/- 139546.62, N = 3SE +/- 495800.55, N = 3SE +/- 54240.16, N = 338072685.8239894283.1718483969.6542863650.6430696533.941. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Forking6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt12K24K36K48K60KSE +/- 205.39, N = 3SE +/- 174.14, N = 3SE +/- 127.13, N = 3SE +/- 684.13, N = 4SE +/- 40.28, N = 352713.8153372.5142503.9655478.1823051.411. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uring6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt7K14K21K28K35KSE +/- 17.80, N = 3SE +/- 76.33, N = 3SE +/- 12.67, N = 3SE +/- 447.95, N = 15SE +/- 438.08, N = 1434399.8131308.6134239.4234371.0834831.081. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILE6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt130K260K390K520K650KSE +/- 1196.90, N = 3SE +/- 5514.19, N = 7SE +/- 587.35, N = 3SE +/- 5544.14, N = 6SE +/- 823.21, N = 3548109.45584525.32573189.67548273.67442574.241. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU Cache6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt4080120160200SE +/- 2.31, N = 15SE +/- 4.24, N = 12SE +/- 1.81, N = 15SE +/- 2.31, N = 13SE +/- 1.90, N = 15185.29183.93186.11167.55187.281. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU Stress6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt13K26K39K52K65KSE +/- 484.41, N = 15SE +/- 296.78, N = 3SE +/- 307.43, N = 3SE +/- 620.04, N = 5SE +/- 526.23, N = 359197.6358675.6359216.4159061.1159150.001. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Semaphores6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt700K1400K2100K2800K3500KSE +/- 417.33, N = 3SE +/- 1075.15, N = 3SE +/- 1870.40, N = 3SE +/- 42045.87, N = 4SE +/- 42155.38, N = 143468096.843291676.963396951.873453178.481533888.381. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Matrix Math6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt30K60K90K120K150KSE +/- 1320.33, N = 6SE +/- 87.49, N = 3SE +/- 208.09, N = 3SE +/- 105.16, N = 3SE +/- 91.82, N = 3131537.38130364.49130527.19130619.50130490.931. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Vector Math6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt30K60K90K120K150KSE +/- 28.55, N = 3SE +/- 27.67, N = 3SE +/- 1.65, N = 3SE +/- 38.01, N = 3SE +/- 66.11, N = 3144964.91144966.02145112.04145204.63145022.041. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Memory Copying6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt17003400510068008500SE +/- 13.17, N = 3SE +/- 26.92, N = 3SE +/- 6.09, N = 3SE +/- 7.12, N = 3SE +/- 1.76, N = 37718.897771.757668.067674.537744.861. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc C String Functions6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt500K1000K1500K2000K2500KSE +/- 22966.43, N = 3SE +/- 17802.28, N = 3SE +/- 1145.85, N = 3SE +/- 3211.48, N = 3SE +/- 17316.06, N = 32274831.952278175.812288023.682273538.402289685.591. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc Qsort Data Sorting6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt80160240320400SE +/- 1.71, N = 3SE +/- 4.63, N = 3SE +/- 3.49, N = 3SE +/- 3.22, N = 3SE +/- 1.89, N = 3384.90382.71380.04387.70381.621. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: System V Message Passing6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt6M12M18M24M30MSE +/- 17548.66, N = 3SE +/- 7184.14, N = 3SE +/- 31377.41, N = 3SE +/- 46317.96, N = 3SE +/- 11015.63, N = 327546281.6128100564.4515168900.9513140420.438024084.281. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lkmod -lmd -lrt -lxxhash -lz -pthread

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-Only6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1122334455SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 349.0749.1249.6849.6149.61

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-Only6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt100200300400500SE +/- 0.78, N = 3SE +/- 2.02, N = 3SE +/- 0.74, N = 3SE +/- 0.14, N = 3SE +/- 0.19, N = 3464.94467.08471.91470.69479.35

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt2004006008001000SE +/- 0.82, N = 3SE +/- 3.73, N = 3SE +/- 1.61, N = 3SE +/- 0.89, N = 3SE +/- 1.74, N = 3795.58780.95795.31389.78775.871. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt510152025SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 310.0410.2310.0520.4310.30MIN: 3.66 / MAX: 20.43MIN: 4.91 / MAX: 22.04MIN: 3.81 / MAX: 18.16MIN: 5.47 / MAX: 35.69MIN: 6.55 / MAX: 20.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt714212835SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 328.1328.2028.2226.6828.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt70140210280350SE +/- 0.16, N = 3SE +/- 0.84, N = 3SE +/- 0.58, N = 3SE +/- 0.14, N = 3SE +/- 0.21, N = 3283.91283.13283.12299.75283.93MIN: 269.66 / MAX: 311MIN: 235.07 / MAX: 321.6MIN: 267.4 / MAX: 303.06MIN: 278.17 / MAX: 332.75MIN: 274.3 / MAX: 310.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt400800120016002000SE +/- 4.81, N = 3SE +/- 6.23, N = 3SE +/- 4.35, N = 3SE +/- 13.97, N = 15SE +/- 2.87, N = 31875.521863.241841.221364.661855.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1.31182.62363.93545.24726.559SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 15SE +/- 0.01, N = 34.264.294.345.834.30MIN: 2.75 / MAX: 12.01MIN: 2.63 / MAX: 10.26MIN: 2.84 / MAX: 10.64MIN: 2.69 / MAX: 18.68MIN: 2.67 / MAX: 10.331. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt306090120150SE +/- 1.50, N = 4SE +/- 1.14, N = 3SE +/- 0.89, N = 3SE +/- 0.49, N = 3SE +/- 0.08, N = 3134.01135.71136.39134.64135.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1326395265SE +/- 0.67, N = 4SE +/- 0.49, N = 3SE +/- 0.38, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 359.6658.9058.6059.3259.04MIN: 30.41 / MAX: 70.12MIN: 50.98 / MAX: 70.17MIN: 31.74 / MAX: 67.18MIN: 31.01 / MAX: 70.61MIN: 29.94 / MAX: 77.071. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt6001200180024003000SE +/- 1.40, N = 3SE +/- 2.52, N = 3SE +/- 3.89, N = 3SE +/- 0.46, N = 3SE +/- 1.08, N = 32888.682886.022887.642894.602895.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt1.24652.4933.73954.9866.2325SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 35.545.545.535.525.52MIN: 3.02 / MAX: 12.09MIN: 2.93 / MAX: 11.52MIN: 3.23 / MAX: 11.46MIN: 3.31 / MAX: 11.97MIN: 3.14 / MAX: 10.611. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt400800120016002000SE +/- 22.46, N = 3SE +/- 13.73, N = 3SE +/- 14.29, N = 3SE +/- 4.51, N = 3SE +/- 17.23, N = 31643.001689.001653.151166.441647.851. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt246810SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 34.864.734.836.844.85MIN: 3.72 / MAX: 10.29MIN: 3.68 / MAX: 11.94MIN: 3.22 / MAX: 10.91MIN: 3.36 / MAX: 16MIN: 3.74 / MAX: 10.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt6K12K18K24K30KSE +/- 19.26, N = 3SE +/- 11.91, N = 3SE +/- 9.04, N = 3SE +/- 213.35, N = 3SE +/- 17.22, N = 326049.3126031.0925763.2125715.1026196.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt0.13950.2790.41850.5580.6975SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 30.610.610.620.620.61MIN: 0.34 / MAX: 2.54MIN: 0.34 / MAX: 2.83MIN: 0.33 / MAX: 3.78MIN: 0.34 / MAX: 5.06MIN: 0.32 / MAX: 3.841. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Selenium

Benchmark: Kraken - Browser: Firefox

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Firefox6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt130260390520650SE +/- 2.50, N = 3SE +/- 1.90, N = 3SE +/- 2.49, N = 3SE +/- 4.20, N = 3SE +/- 0.90, N = 3492.4488.8529.7606.9491.41. firefox 109.0

Selenium

Benchmark: Jetstream 2 - Browser: Firefox

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: Firefox6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt4080120160200SE +/- 0.32, N = 3SE +/- 2.14, N = 3SE +/- 0.49, N = 3SE +/- 0.61, N = 3SE +/- 0.74, N = 3201.17197.22184.76148.41199.641. firefox 109.0

Selenium

Benchmark: Speedometer - Browser: Firefox

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Firefox6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt60120180240300SE +/- 2.08, N = 3SE +/- 0.58, N = 3SE +/- 1.76, N = 3SE +/- 0.58, N = 3SE +/- 0.67, N = 32812762501922841. firefox 109.0

Selenium

Benchmark: PSPDFKit WASM - Browser: Firefox

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: Firefox6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt5001000150020002500SE +/- 22.88, N = 3SE +/- 8.51, N = 3SE +/- 12.50, N = 3SE +/- 11.50, N = 3SE +/- 5.46, N = 3220722282348254321151. firefox 109.0

Selenium

Benchmark: WASM imageConvolute - Browser: Firefox

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: Firefox6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt510152025SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 317.918.018.020.718.11. firefox 109.0

Selenium

Benchmark: WASM collisionDetection - Browser: Firefox

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Firefox6.1.7-arch1-16.1.7-zen1-1-zen6.1.7-hardened1-1-hardened5.15.89-1-lts6.0.5.14.realtime1-3-rt50100150200250SE +/- 2.08, N = 3SE +/- 1.58, N = 3SE +/- 0.65, N = 3SE +/- 1.67, N = 3SE +/- 1.39, N = 3244.2241.7246.9249.6244.31. firefox 109.0

Phoronix Test Suite v10.8.5