sss

AMD Ryzen 9 5950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2210145-NE-SSS86725756
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 2 Tests
Creator Workloads 2 Tests
HPC - High Performance Computing 5 Tests
Machine Learning 4 Tests
Multi-Core 2 Tests
Python Tests 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
A
October 13 2022
  1 Hour, 20 Minutes
B
October 13 2022
  4 Hours, 14 Minutes
C
October 14 2022
  4 Hours, 53 Minutes
Invert Hiding All Results Option
  3 Hours, 29 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

A

Kernel Notes: i915.force_probe=56a5 - Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016
Python Notes: Python 2.7.18 + Python 3.8.10
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

B

C

Processor: AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 500GB Western Digital WDS500G3X0C-00SJG0, Graphics: llvmpipe (2450MHz), Audio: Intel Device 4f92, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200

OS: Ubuntu 20.04, Kernel: 6.0.0-060000rc5daily20220915-generic (x86_64), Desktop: GNOME Shell 3.36.9, Display Server: X Server 1.20.13, OpenGL: 4.5 Mesa 21.2.6 (LLVM 12.0.0 256 bits), OpenCL: OpenCL 3.0, Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 3840x2160

sssOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS)AMD Starship/Matisse32GB500GB Western Digital WDS500G3X0C-00SJG0llvmpipe (2450MHz)Intel Device 4f92ASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.046.0.0-060000rc5daily20220915-generic (x86_64)GNOME Shell 3.36.9X Server 1.20.134.5 Mesa 21.2.6 (LLVM 12.0.0 256 bits)OpenCL 3.01.1.182GCC 9.4.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionSss PerformanceSystem Logs- i915.force_probe=56a5 - Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016 - Python 2.7.18 + Python 3.8.10- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

ABCResult OverviewPhoronix Test Suite100%100%101%101%SMHasheroneDNNOpenRadiossNeural Magic DeepSparsespaCyTensorFlowY-CruncherQuadRay

ssssmhasher: wyhashsmhasher: wyhashsmhasher: SHA3-256smhasher: SHA3-256smhasher: Spooky32smhasher: Spooky32smhasher: fasthash32smhasher: fasthash32smhasher: FarmHash128smhasher: FarmHash128smhasher: t1ha2_atoncesmhasher: t1ha2_atoncesmhasher: FarmHash32 x86_64 AVXsmhasher: FarmHash32 x86_64 AVXsmhasher: t1ha0_aes_avx2 x86_64smhasher: t1ha0_aes_avx2 x86_64smhasher: MeowHash x86_64 AES-NIsmhasher: MeowHash x86_64 AES-NIopenradioss: Bumper Beamopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containerquadray: 1 - 4Kquadray: 2 - 4Kquadray: 3 - 4Kquadray: 5 - 4Kquadray: 1 - 1080pquadray: 2 - 1080pquadray: 3 - 1080pquadray: 5 - 1080py-cruncher: 1By-cruncher: 500Monednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUtensorflow: CPU - 16 - AlexNettensorflow: CPU - 32 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 32 - ResNet-50deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamspacy: en_core_web_lgspacy: en_core_web_trfABC28600.2414.968209.851852.22519879.9329.9448321.9723.5120617.6852.11418113.8522.87833990.6928.72583813.9322.09746922.8353.591110.0687.55225.5492.08512.2511.13.412.870.8946.0313.4411.443.5438.8218.0583.866258.180950.7761190.46766917.03324.407523.5780518.42241.071591.659822602.441647.732594.591641.150.7862432608.121637.870.68193756.1780.0134.0511.7932.3611.512.7346622.838411.361488.011441.582192.355731.914831.326567.8059117.845756.227817.7758159.54350.1021112.55728.8777119.366666.992380.496112.41855.2955144.473341.346424.180512.7051626.728611.429587.487516000107427320.4916.315204.911898.73819280.7230.8157974.2124.69020202.8151.83218237.8223.11134077.2028.52382904.4421.95046726.1153.462110.2987.66226.9693.05511.3811.113.392.900.8945.9413.3311.443.5538.81918.1263.923867.957400.7775070.45990916.81224.360023.6344518.23131.072451.686782624.271666.792590.101655.470.7954732597.671679.640.68274756.6779.6734.1611.8332.4811.4912.7366625.546511.350688.095941.4807192.825131.880831.360068.3274116.965556.304417.7512158.590350.4242112.46328.8852119.284967.031580.327712.443855.2420144.701141.291824.212712.6875626.008711.307588.431116021107627857.6715.420206.291889.90519028.9731.1988089.0224.31620364.5051.63018384.2722.88033941.3328.56081425.1922.09747376.7353.361107.7688.81227.5294.30518.2911.113.392.900.8945.7513.3611.443.5738.71018.1183.963229.085800.7750550.47311317.12134.395043.6037018.92831.076021.670462670.401744.782627.851664.440.7899102598.171703.110.68222856.5179.5434.2011.7832.5311.4712.6662628.285611.327488.276040.5820197.096331.834531.406067.4911118.405755.909617.8768158.249650.5237112.36458.8930118.959867.208180.043212.488055.2232144.773441.230724.248612.6218631.115411.346088.1329160161069OpenBenchmarking.org

SMHasher

SMHasher is a hash function tester supporting various algorithms and able to make use of AVX and other modern CPU instruction set extensions. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: wyhashCBA6K12K18K24K30KSE +/- 110.01, N = 3SE +/- 37.17, N = 327857.6727320.4928600.241. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: wyhashCBA48121620SE +/- 0.16, N = 3SE +/- 0.35, N = 315.4216.3214.971. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: wyhashCBA5K10K15K20K25KMin: 27739.5 / Avg: 27857.67 / Max: 28077.49Min: 27247.6 / Avg: 27320.49 / Max: 27369.581. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: SHA3-256CBA50100150200250SE +/- 0.30, N = 3SE +/- 1.57, N = 3206.29204.91209.851. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: SHA3-256CBA400800120016002000SE +/- 3.87, N = 3SE +/- 14.44, N = 31889.911898.741852.231. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: SHA3-256CBA4080120160200Min: 205.99 / Avg: 206.29 / Max: 206.89Min: 202.59 / Avg: 204.91 / Max: 207.911. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: Spooky32CBA4K8K12K16K20KSE +/- 43.76, N = 3SE +/- 10.48, N = 319028.9719280.7219879.931. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: Spooky32CBA714212835SE +/- 0.11, N = 3SE +/- 0.09, N = 331.2030.8229.941. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: Spooky32CBA3K6K9K12K15KMin: 18964.14 / Avg: 19028.97 / Max: 19112.3Min: 19260.01 / Avg: 19280.72 / Max: 19293.831. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: fasthash32CBA2K4K6K8K10KSE +/- 59.27, N = 3SE +/- 27.99, N = 38089.027974.218321.971. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: fasthash32CBA612182430SE +/- 0.16, N = 3SE +/- 0.10, N = 324.3224.6923.511. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: fasthash32CBA14002800420056007000Min: 7990.29 / Avg: 8089.02 / Max: 8195.2Min: 7946.18 / Avg: 7974.21 / Max: 8030.181. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash128CBA4K8K12K16K20KSE +/- 92.08, N = 3SE +/- 147.41, N = 320364.5020202.8120617.681. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash128CBA1224364860SE +/- 0.45, N = 3SE +/- 0.44, N = 351.6351.8352.111. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash128CBA4K8K12K16K20KMin: 20186.52 / Avg: 20364.5 / Max: 20494.44Min: 20018.31 / Avg: 20202.81 / Max: 20494.211. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: t1ha2_atonceCBA4K8K12K16K20KSE +/- 219.35, N = 4SE +/- 55.92, N = 318384.2718237.8218113.851. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: t1ha2_atonceCBA612182430SE +/- 0.43, N = 4SE +/- 0.27, N = 322.8823.1122.881. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: t1ha2_atonceCBA3K6K9K12K15KMin: 18117.32 / Avg: 18384.27 / Max: 19034.06Min: 18152.9 / Avg: 18237.82 / Max: 18343.311. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXCBA7K14K21K28K35KSE +/- 52.01, N = 3SE +/- 102.23, N = 333941.3334077.2033990.691. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXCBA714212835SE +/- 0.02, N = 3SE +/- 0.01, N = 328.5628.5228.731. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXCBA6K12K18K24K30KMin: 33851.74 / Avg: 33941.33 / Max: 34031.89Min: 33874.95 / Avg: 34077.2 / Max: 34204.291. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: t1ha0_aes_avx2 x86_64CBA20K40K60K80K100KSE +/- 940.93, N = 3SE +/- 679.73, N = 981425.1982904.4483813.931. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: t1ha0_aes_avx2 x86_64CBA510152025SE +/- 0.00, N = 3SE +/- 0.17, N = 922.1021.9522.101. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: t1ha0_aes_avx2 x86_64CBA15K30K45K60K75KMin: 80253.43 / Avg: 81425.19 / Max: 83286.34Min: 79048.39 / Avg: 82904.44 / Max: 85305.341. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: MeowHash x86_64 AES-NICBA10K20K30K40K50KSE +/- 226.78, N = 3SE +/- 324.08, N = 347376.7346726.1146922.831. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: MeowHash x86_64 AES-NICBA1224364860SE +/- 0.30, N = 3SE +/- 0.18, N = 353.3653.4653.591. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: MeowHash x86_64 AES-NICBA8K16K24K32K40KMin: 46948.21 / Avg: 47376.73 / Max: 47719.7Min: 46108.23 / Avg: 46726.11 / Max: 47204.611. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamCBA20406080100SE +/- 0.29, N = 3SE +/- 0.53, N = 3107.76110.29110.06
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamCBA20406080100Min: 107.22 / Avg: 107.76 / Max: 108.19Min: 109.39 / Avg: 110.29 / Max: 111.24

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestCBA20406080100SE +/- 0.52, N = 3SE +/- 0.05, N = 388.8187.6687.55
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestCBA20406080100Min: 87.99 / Avg: 88.81 / Max: 89.77Min: 87.56 / Avg: 87.66 / Max: 87.75

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldCBA50100150200250SE +/- 0.78, N = 3SE +/- 0.53, N = 3227.52226.96225.54
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldCBA4080120160200Min: 226.58 / Avg: 227.52 / Max: 229.06Min: 226.33 / Avg: 226.96 / Max: 228.02

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationCBA20406080100SE +/- 0.41, N = 3SE +/- 0.43, N = 394.3093.0592.08
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationCBA20406080100Min: 93.5 / Avg: 94.3 / Max: 94.84Min: 92.3 / Avg: 93.05 / Max: 93.8

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerCBA110220330440550SE +/- 4.41, N = 8SE +/- 0.30, N = 3518.29511.38512.25
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerCBA90180270360450Min: 511.29 / Avg: 518.29 / Max: 546.31Min: 510.78 / Avg: 511.38 / Max: 511.69

QuadRay

VectorChief's QuadRay is a real-time ray-tracing engine written to support SIMD across ARM, MIPS, PPC, and x86/x86_64 processors. QuadRay supports SSE/SSE2/SSE4 and AVX/AVX2/AVX-512 usage on Intel/AMD CPUs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 4KCBA3691215SE +/- 0.02, N = 3SE +/- 0.03, N = 311.1111.1111.101. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread
OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 4KCBA3691215Min: 11.08 / Avg: 11.11 / Max: 11.16Min: 11.05 / Avg: 11.11 / Max: 11.151. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 4KCBA0.76731.53462.30193.06923.8365SE +/- 0.01, N = 3SE +/- 0.01, N = 33.393.393.411. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread
OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 4KCBA246810Min: 3.38 / Avg: 3.39 / Max: 3.41Min: 3.37 / Avg: 3.39 / Max: 3.41. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 4KCBA0.65251.3051.95752.613.2625SE +/- 0.01, N = 3SE +/- 0.01, N = 32.902.902.871. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread
OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 4KCBA246810Min: 2.89 / Avg: 2.9 / Max: 2.91Min: 2.89 / Avg: 2.9 / Max: 2.911. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 4KCBA0.20030.40060.60090.80121.0015SE +/- 0.00, N = 3SE +/- 0.00, N = 30.890.890.891. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread
OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 4KCBA246810Min: 0.89 / Avg: 0.89 / Max: 0.89Min: 0.89 / Avg: 0.89 / Max: 0.891. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 1080pCBA1020304050SE +/- 0.04, N = 3SE +/- 0.09, N = 345.7545.9446.031. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread
OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 1080pCBA918273645Min: 45.67 / Avg: 45.75 / Max: 45.82Min: 45.77 / Avg: 45.94 / Max: 46.061. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 1080pCBA3691215SE +/- 0.04, N = 3SE +/- 0.02, N = 313.3613.3313.441. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread
OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 1080pCBA48121620Min: 13.29 / Avg: 13.36 / Max: 13.41Min: 13.29 / Avg: 13.33 / Max: 13.361. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 1080pCBA3691215SE +/- 0.01, N = 3SE +/- 0.03, N = 311.4411.4411.441. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread
OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 1080pCBA3691215Min: 11.43 / Avg: 11.44 / Max: 11.46Min: 11.41 / Avg: 11.44 / Max: 11.51. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 1080pCBA0.80331.60662.40993.21324.0165SE +/- 0.00, N = 3SE +/- 0.01, N = 33.573.553.541. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread
OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 1080pCBA246810Min: 3.56 / Avg: 3.57 / Max: 3.57Min: 3.53 / Avg: 3.55 / Max: 3.561. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1BCBA918273645SE +/- 0.09, N = 3SE +/- 0.13, N = 338.7138.8238.82
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1BCBA816243240Min: 38.54 / Avg: 38.71 / Max: 38.85Min: 38.6 / Avg: 38.82 / Max: 39.06

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500MCBA48121620SE +/- 0.01, N = 3SE +/- 0.02, N = 318.1218.1318.06
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500MCBA510152025Min: 18.1 / Avg: 18.12 / Max: 18.14Min: 18.09 / Avg: 18.13 / Max: 18.16

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUCBA0.89171.78342.67513.56684.4585SE +/- 0.00111, N = 3SE +/- 0.03093, N = 33.963223.923863.86625MIN: 3.73MIN: 3.68MIN: 3.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUCBA246810Min: 3.96 / Avg: 3.96 / Max: 3.96Min: 3.87 / Avg: 3.92 / Max: 3.981. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUCBA3691215SE +/- 0.00928, N = 3SE +/- 0.05903, N = 39.085807.957408.18095MIN: 8.89MIN: 7.47MIN: 7.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUCBA3691215Min: 9.07 / Avg: 9.09 / Max: 9.1Min: 7.85 / Avg: 7.96 / Max: 8.051. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUCBA0.17490.34980.52470.69960.8745SE +/- 0.001575, N = 3SE +/- 0.000399, N = 30.7750550.7775070.776119MIN: 0.7MIN: 0.71MIN: 0.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUCBA246810Min: 0.77 / Avg: 0.78 / Max: 0.78Min: 0.78 / Avg: 0.78 / Max: 0.781. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUCBA0.10650.2130.31950.4260.5325SE +/- 0.001374, N = 3SE +/- 0.004656, N = 30.4731130.4599090.467669MIN: 0.44MIN: 0.41MIN: 0.431. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUCBA12345Min: 0.47 / Avg: 0.47 / Max: 0.48Min: 0.45 / Avg: 0.46 / Max: 0.471. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

A: The test run did not produce a result.

B: The test run did not produce a result.

C: The test run did not produce a result.

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

A: The test run did not produce a result.

B: The test run did not produce a result.

C: The test run did not produce a result.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUCBA48121620SE +/- 0.03, N = 3SE +/- 0.04, N = 317.1216.8117.03MIN: 16.81MIN: 16.43MIN: 16.721. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUCBA48121620Min: 17.09 / Avg: 17.12 / Max: 17.17Min: 16.73 / Avg: 16.81 / Max: 16.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUCBA0.99171.98342.97513.96684.9585SE +/- 0.01829, N = 3SE +/- 0.03778, N = 84.395044.360024.40752MIN: 3.54MIN: 3.52MIN: 3.51. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUCBA246810Min: 4.37 / Avg: 4.4 / Max: 4.43Min: 4.25 / Avg: 4.36 / Max: 4.561. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUCBA0.81781.63562.45343.27124.089SE +/- 0.01247, N = 3SE +/- 0.00327, N = 33.603703.634453.57805MIN: 3.4MIN: 3.41MIN: 3.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUCBA246810Min: 3.58 / Avg: 3.6 / Max: 3.62Min: 3.63 / Avg: 3.63 / Max: 3.641. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUCBA510152025SE +/- 0.05, N = 3SE +/- 0.06, N = 318.9318.2318.42MIN: 18.48MIN: 17.9MIN: 18.061. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUCBA510152025Min: 18.85 / Avg: 18.93 / Max: 19.01Min: 18.12 / Avg: 18.23 / Max: 18.331. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUCBA0.24210.48420.72630.96841.2105SE +/- 0.00183, N = 3SE +/- 0.00134, N = 31.076021.072451.07159MIN: 0.97MIN: 0.97MIN: 0.971. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUCBA246810Min: 1.07 / Avg: 1.08 / Max: 1.08Min: 1.07 / Avg: 1.07 / Max: 1.081. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUCBA0.37950.7591.13851.5181.8975SE +/- 0.00419, N = 3SE +/- 0.01458, N = 31.670461.686781.65982MIN: 1.54MIN: 1.52MIN: 1.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUCBA246810Min: 1.67 / Avg: 1.67 / Max: 1.68Min: 1.67 / Avg: 1.69 / Max: 1.721. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUCBA6001200180024003000SE +/- 28.26, N = 5SE +/- 11.17, N = 32670.402624.272602.44MIN: 2578.83MIN: 2596.85MIN: 2590.621. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUCBA5001000150020002500Min: 2590.12 / Avg: 2670.4 / Max: 2734.13Min: 2610.05 / Avg: 2624.27 / Max: 2646.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUCBA400800120016002000SE +/- 19.41, N = 3SE +/- 19.69, N = 31744.781666.791647.73MIN: 1706.54MIN: 1620.68MIN: 1635.211. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUCBA30060090012001500Min: 1720.62 / Avg: 1744.78 / Max: 1783.18Min: 1628.71 / Avg: 1666.79 / Max: 1694.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUCBA6001200180024003000SE +/- 31.84, N = 3SE +/- 6.69, N = 32627.852590.102594.59MIN: 2582.8MIN: 2567.75MIN: 2584.091. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUCBA5001000150020002500Min: 2595.22 / Avg: 2627.85 / Max: 2691.53Min: 2576.72 / Avg: 2590.1 / Max: 2597.111. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

A: The test run did not produce a result.

B: The test run did not produce a result.

C: The test run did not produce a result.

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

A: The test run did not produce a result.

B: The test run did not produce a result.

C: The test run did not produce a result.

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

A: The test run did not produce a result.

B: The test run did not produce a result.

C: The test run did not produce a result.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUCBA400800120016002000SE +/- 17.63, N = 5SE +/- 15.95, N = 31664.441655.471641.15MIN: 1618.12MIN: 1622.09MIN: 1622.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUCBA30060090012001500Min: 1629.66 / Avg: 1664.44 / Max: 1707.68Min: 1637.35 / Avg: 1655.47 / Max: 1687.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUCBA0.1790.3580.5370.7160.895SE +/- 0.002635, N = 3SE +/- 0.008536, N = 30.7899100.7954730.786243MIN: 0.7MIN: 0.7MIN: 0.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUCBA246810Min: 0.79 / Avg: 0.79 / Max: 0.79Min: 0.78 / Avg: 0.8 / Max: 0.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUCBA6001200180024003000SE +/- 7.36, N = 3SE +/- 8.68, N = 32598.172597.672608.12MIN: 2573.5MIN: 2576.33MIN: 2597.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUCBA5001000150020002500Min: 2586.37 / Avg: 2598.17 / Max: 2611.7Min: 2586.38 / Avg: 2597.67 / Max: 2614.731. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUCBA400800120016002000SE +/- 15.79, N = 6SE +/- 12.64, N = 111703.111679.641637.87MIN: 1634.78MIN: 1619.79MIN: 1622.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUCBA30060090012001500Min: 1644.08 / Avg: 1703.11 / Max: 1742.61Min: 1635.47 / Avg: 1679.64 / Max: 1768.941. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUCBA0.15360.30720.46080.61440.768SE +/- 0.002683, N = 3SE +/- 0.002859, N = 30.6822280.6827470.681937MIN: 0.58MIN: 0.58MIN: 0.591. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUCBA246810Min: 0.68 / Avg: 0.68 / Max: 0.69Min: 0.68 / Avg: 0.68 / Max: 0.691. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

A: The test run did not produce a result.

B: The test run did not produce a result.

C: The test run did not produce a result.

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetCBA1326395265SE +/- 0.15, N = 3SE +/- 0.14, N = 356.5156.6756.17
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetCBA1122334455Min: 56.22 / Avg: 56.51 / Max: 56.69Min: 56.51 / Avg: 56.67 / Max: 56.95

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetCBA20406080100SE +/- 0.12, N = 3SE +/- 0.15, N = 379.5479.6780.01
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetCBA1530456075Min: 79.33 / Avg: 79.54 / Max: 79.75Min: 79.37 / Avg: 79.67 / Max: 79.86

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetCBA816243240SE +/- 0.02, N = 3SE +/- 0.02, N = 334.2034.1634.05
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetCBA714212835Min: 34.18 / Avg: 34.2 / Max: 34.23Min: 34.12 / Avg: 34.16 / Max: 34.2

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50CBA3691215SE +/- 0.03, N = 3SE +/- 0.01, N = 311.7811.8311.79
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50CBA3691215Min: 11.72 / Avg: 11.78 / Max: 11.82Min: 11.81 / Avg: 11.83 / Max: 11.84

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetCBA816243240SE +/- 0.02, N = 3SE +/- 0.02, N = 332.5332.4832.36
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetCBA714212835Min: 32.51 / Avg: 32.53 / Max: 32.57Min: 32.44 / Avg: 32.48 / Max: 32.51

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50CBA3691215SE +/- 0.02, N = 3SE +/- 0.01, N = 311.4711.4911.50
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50CBA3691215Min: 11.44 / Avg: 11.47 / Max: 11.51Min: 11.48 / Avg: 11.49 / Max: 11.51

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamCBA3691215SE +/- 0.04, N = 3SE +/- 0.07, N = 312.6712.7412.73
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamCBA48121620Min: 12.6 / Avg: 12.67 / Max: 12.72Min: 12.65 / Avg: 12.74 / Max: 12.88

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamCBA140280420560700SE +/- 2.78, N = 3SE +/- 2.50, N = 3628.29625.55622.84
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamCBA110220330440550Min: 623.81 / Avg: 628.29 / Max: 633.37Min: 620.65 / Avg: 625.55 / Max: 628.89

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamCBA3691215SE +/- 0.01, N = 3SE +/- 0.02, N = 311.3311.3511.36
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamCBA3691215Min: 11.32 / Avg: 11.33 / Max: 11.34Min: 11.33 / Avg: 11.35 / Max: 11.38

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamCBA20406080100SE +/- 0.06, N = 3SE +/- 0.13, N = 388.2888.1088.01
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamCBA20406080100Min: 88.15 / Avg: 88.28 / Max: 88.35Min: 87.83 / Avg: 88.1 / Max: 88.23

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamCBA918273645SE +/- 0.03, N = 3SE +/- 0.02, N = 340.5841.4841.58
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamCBA918273645Min: 40.53 / Avg: 40.58 / Max: 40.62Min: 41.44 / Avg: 41.48 / Max: 41.52

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamCBA4080120160200SE +/- 0.14, N = 3SE +/- 0.11, N = 3197.10192.83192.36
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamCBA4080120160200Min: 196.93 / Avg: 197.1 / Max: 197.37Min: 192.64 / Avg: 192.83 / Max: 193.02

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamCBA714212835SE +/- 0.10, N = 3SE +/- 0.06, N = 331.8331.8831.91
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamCBA714212835Min: 31.65 / Avg: 31.83 / Max: 31.99Min: 31.79 / Avg: 31.88 / Max: 31.99

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamCBA714212835SE +/- 0.10, N = 3SE +/- 0.06, N = 331.4131.3631.33
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamCBA714212835Min: 31.25 / Avg: 31.41 / Max: 31.58Min: 31.25 / Avg: 31.36 / Max: 31.45

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamCBA1530456075SE +/- 0.13, N = 3SE +/- 0.91, N = 367.4968.3367.81
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamCBA1326395265Min: 67.24 / Avg: 67.49 / Max: 67.64Min: 66.82 / Avg: 68.33 / Max: 69.95

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamCBA306090120150SE +/- 0.21, N = 3SE +/- 1.56, N = 3118.41116.97117.85
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamCBA20406080100Min: 118.19 / Avg: 118.41 / Max: 118.83Min: 114.22 / Avg: 116.97 / Max: 119.61

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamCBA1326395265SE +/- 0.03, N = 3SE +/- 0.05, N = 355.9156.3056.23
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamCBA1122334455Min: 55.87 / Avg: 55.91 / Max: 55.96Min: 56.21 / Avg: 56.3 / Max: 56.36

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamCBA48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 317.8817.7517.78
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamCBA510152025Min: 17.86 / Avg: 17.88 / Max: 17.89Min: 17.73 / Avg: 17.75 / Max: 17.78

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamCBA4080120160200SE +/- 0.56, N = 3SE +/- 0.71, N = 3158.25158.59159.54
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamCBA306090120150Min: 157.47 / Avg: 158.25 / Max: 159.34Min: 157.74 / Avg: 158.59 / Max: 160

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamCBA1122334455SE +/- 0.18, N = 3SE +/- 0.23, N = 350.5250.4250.10
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamCBA1020304050Min: 50.17 / Avg: 50.52 / Max: 50.79Min: 49.96 / Avg: 50.42 / Max: 50.7

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamCBA306090120150SE +/- 0.06, N = 3SE +/- 0.02, N = 3112.36112.46112.56
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamCBA20406080100Min: 112.24 / Avg: 112.36 / Max: 112.45Min: 112.43 / Avg: 112.46 / Max: 112.49

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamCBA246810SE +/- 0.0051, N = 3SE +/- 0.0017, N = 38.89308.88528.8777
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamCBA3691215Min: 8.89 / Avg: 8.89 / Max: 8.9Min: 8.88 / Avg: 8.89 / Max: 8.89

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamCBA306090120150SE +/- 0.06, N = 3SE +/- 0.08, N = 3118.96119.28119.37
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamCBA20406080100Min: 118.87 / Avg: 118.96 / Max: 119.07Min: 119.12 / Avg: 119.28 / Max: 119.37

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamCBA1530456075SE +/- 0.02, N = 3SE +/- 0.03, N = 367.2167.0366.99
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamCBA1326395265Min: 67.16 / Avg: 67.21 / Max: 67.24Min: 67 / Avg: 67.03 / Max: 67.1

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamCBA20406080100SE +/- 0.18, N = 3SE +/- 0.08, N = 380.0480.3380.50
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamCBA1530456075Min: 79.72 / Avg: 80.04 / Max: 80.35Min: 80.21 / Avg: 80.33 / Max: 80.47

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamCBA3691215SE +/- 0.03, N = 3SE +/- 0.01, N = 312.4912.4412.42
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamCBA48121620Min: 12.44 / Avg: 12.49 / Max: 12.54Min: 12.42 / Avg: 12.44 / Max: 12.46

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamCBA1224364860SE +/- 0.05, N = 3SE +/- 0.08, N = 355.2255.2455.30
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamCBA1122334455Min: 55.12 / Avg: 55.22 / Max: 55.28Min: 55.09 / Avg: 55.24 / Max: 55.35

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamCBA306090120150SE +/- 0.12, N = 3SE +/- 0.23, N = 3144.77144.70144.47
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamCBA306090120150Min: 144.63 / Avg: 144.77 / Max: 145.02Min: 144.44 / Avg: 144.7 / Max: 145.17

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamCBA918273645SE +/- 0.05, N = 3SE +/- 0.02, N = 341.2341.2941.35
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamCBA918273645Min: 41.15 / Avg: 41.23 / Max: 41.3Min: 41.27 / Avg: 41.29 / Max: 41.32

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamCBA612182430SE +/- 0.03, N = 3SE +/- 0.01, N = 324.2524.2124.18
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamCBA612182430Min: 24.21 / Avg: 24.25 / Max: 24.3Min: 24.19 / Avg: 24.21 / Max: 24.23

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamCBA3691215SE +/- 0.03, N = 3SE +/- 0.02, N = 312.6212.6912.71
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamCBA48121620Min: 12.58 / Avg: 12.62 / Max: 12.68Min: 12.64 / Avg: 12.69 / Max: 12.72

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamCBA140280420560700SE +/- 1.66, N = 3SE +/- 1.55, N = 3631.12626.01626.73
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamCBA110220330440550Min: 628.14 / Avg: 631.12 / Max: 633.88Min: 623.58 / Avg: 626.01 / Max: 628.9

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamCBA3691215SE +/- 0.03, N = 3SE +/- 0.01, N = 311.3511.3111.43
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamCBA3691215Min: 11.31 / Avg: 11.35 / Max: 11.4Min: 11.29 / Avg: 11.31 / Max: 11.33

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamCBA20406080100SE +/- 0.22, N = 3SE +/- 0.09, N = 388.1388.4387.49
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamCBA20406080100Min: 87.69 / Avg: 88.13 / Max: 88.4Min: 88.27 / Avg: 88.43 / Max: 88.57

spaCy

The spaCy library is an open-source solution for advanced neural language processing (NLP). The spaCy library leverages Python and is a leading neural language processing solution. This test profile times the spaCy CPU performance with various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgCBA3K6K9K12K15KSE +/- 4.58, N = 3SE +/- 18.22, N = 3160161602116000
OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgCBA3K6K9K12K15KMin: 16010 / Avg: 16016 / Max: 16025Min: 15988 / Avg: 16020.67 / Max: 16051

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfCBA2004006008001000SE +/- 4.93, N = 3SE +/- 3.48, N = 3106910761074
OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfCBA2004006008001000Min: 1061 / Avg: 1069 / Max: 1078Min: 1070 / Avg: 1076.33 / Max: 1082

78 Results Shown

SMHasher:
  wyhash
  SHA3-256
  Spooky32
  fasthash32
  FarmHash128
  t1ha2_atonce
  FarmHash32 x86_64 AVX
  t1ha0_aes_avx2 x86_64
  MeowHash x86_64 AES-NI
OpenRadioss:
  Bumper Beam
  Cell Phone Drop Test
  Bird Strike on Windshield
  Rubber O-Ring Seal Installation
  INIVOL and Fluid Structure Interaction Drop Container
QuadRay:
  1 - 4K
  2 - 4K
  3 - 4K
  5 - 4K
  1 - 1080p
  2 - 1080p
  3 - 1080p
  5 - 1080p
Y-Cruncher:
  1B
  500M
oneDNN:
  IP Shapes 1D - f32 - CPU
  IP Shapes 3D - f32 - CPU
  IP Shapes 1D - u8s8f32 - CPU
  IP Shapes 3D - u8s8f32 - CPU
  Convolution Batch Shapes Auto - f32 - CPU
  Deconvolution Batch shapes_1d - f32 - CPU
  Deconvolution Batch shapes_3d - f32 - CPU
  Convolution Batch Shapes Auto - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
  Recurrent Neural Network Training - f32 - CPU
  Recurrent Neural Network Inference - f32 - CPU
  Recurrent Neural Network Training - u8s8f32 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
  Matrix Multiply Batch Shapes Transformer - f32 - CPU
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
  Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU
TensorFlow:
  CPU - 16 - AlexNet
  CPU - 32 - AlexNet
  CPU - 16 - GoogLeNet
  CPU - 16 - ResNet-50
  CPU - 32 - GoogLeNet
  CPU - 32 - ResNet-50
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream:
    items/sec
    ms/batch
  CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection,YOLOv5s COCO - Synchronous Single-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream:
    items/sec
    ms/batch
spaCy:
  en_core_web_lg
  en_core_web_trf

A

Kernel Notes: i915.force_probe=56a5 - Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016
Python Notes: Python 2.7.18 + Python 3.8.10
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 13 October 2022 19:27 by user phoronix.

B

Kernel Notes: i915.force_probe=56a5 - Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016
Python Notes: Python 2.7.18 + Python 3.8.10
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 13 October 2022 20:42 by user phoronix.

C

Processor: AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 500GB Western Digital WDS500G3X0C-00SJG0, Graphics: llvmpipe (2450MHz), Audio: Intel Device 4f92, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200

OS: Ubuntu 20.04, Kernel: 6.0.0-060000rc5daily20220915-generic (x86_64), Desktop: GNOME Shell 3.36.9, Display Server: X Server 1.20.13, OpenGL: 4.5 Mesa 21.2.6 (LLVM 12.0.0 256 bits), OpenCL: OpenCL 3.0, Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 3840x2160

Kernel Notes: i915.force_probe=56a5 - Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201016
Python Notes: Python 2.7.18 + Python 3.8.10
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 14 October 2022 04:46 by user phoronix.