extra tests

benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2309060-NE-EXTRATEST87
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

AV1 2 Tests
C/C++ Compiler Tests 2 Tests
CPU Massive 5 Tests
Creator Workloads 8 Tests
Database Test Suite 2 Tests
Encoding 3 Tests
Game Development 2 Tests
HPC - High Performance Computing 4 Tests
Machine Learning 2 Tests
Multi-Core 9 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 3 Tests
OpenMPI Tests 5 Tests
Renderers 2 Tests
Server 2 Tests
Server CPU Tests 4 Tests
Video Encoding 3 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
d
August 25 2023
  3 Hours, 8 Minutes
g
August 30 2023
  4 Hours, 25 Minutes
h
August 30 2023
  4 Hours, 23 Minutes
2 x AMD EPYC 9334 32-Core
September 06 2023
  3 Hours, 9 Minutes
9334 2p
September 06 2023
  3 Hours, 11 Minutes
93334 rep
September 06 2023
  3 Hours, 13 Minutes
Invert Hiding All Results Option
  3 Hours, 35 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


extra tests - Phoronix Test Suite

extra tests

benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2309060-NE-EXTRATEST87&export=txt&grs&sro.

extra testsProcessorMotherboardMemoryDiskGraphicsOSKernelCompilerFile-SystemScreen Resolutiondgh2 x AMD EPYC 9334 32-Core9334 2p93334 rep2 x AMD EPYC 9124 16-Core @ 3.00GHz (32 Cores / 64 Threads)Supermicro H13DSH (1.5 BIOS)24 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07astdrmfbAlmaLinux 9.25.14.0-284.25.1.el9_2.x86_64 (x86_64)GCC 11.3.1 20221121ext41024x7682 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads)23 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET2 x AMD EPYC 9334 32-Core @ 2.70GHz (64 Cores / 128 Threads)21 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKETOpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details- d: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- g: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- h: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- 2 x AMD EPYC 9334 32-Core: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- 9334 2p: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- 93334 rep: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113eJava Details- OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Details- Python 3.9.16Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

extra testsstress-ng: Semaphoresstress-ng: Pipedeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamstress-ng: x86_64 RdRandstress-ng: Hashstress-ng: Context Switchingstress-ng: Vector Shuffledeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamncnn: CPU - regnety_400mstress-ng: Floating Pointstress-ng: CPU Stressstress-ng: Function Callstress-ng: Matrix Mathstress-ng: Vector Floating Pointstress-ng: Fused Multiply-Addstress-ng: Zlibdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamblender: Classroom - CPU-Onlystress-ng: Vector Mathblender: Pabellon Barcelona - CPU-Onlystress-ng: AVX-512 VNNIstress-ng: Memory Copyingstress-ng: Wide Vector Mathstress-ng: Glibc Qsort Data Sortingstress-ng: Mallocstress-ng: Glibc C String Functionsblender: Barbershop - CPU-Onlyblender: BMW27 - CPU-Onlyospray: gravity_spheres_volume/dim_512/scivis/real_timeembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objospray: gravity_spheres_volume/dim_512/ao/real_timedeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamembree: Pathtracer - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownstress-ng: Pollblender: Fishy Cat - CPU-Onlyncnn: CPU - blazefaceembree: Pathtracer ISPC - Asian Dragon Objstress-ng: SENDFILEospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timestress-ng: Cryptoncnn: CPU - shufflenet-v2stress-ng: Forkingstress-ng: AVL Treestress-ng: CPU Cachestress-ng: MMAPncnn: CPU - efficientnet-b0ncnn: CPU-v3-v3 - mobilenet-v3stress-ng: NUMAncnn: CPU - mnasnetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU - FastestDetdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyncnn: CPU - squeezenet_ssdospray: gravity_spheres_volume/dim_512/pathtracer/real_timeoidn: RTLightmap.hdr.4096x4096 - CPU-Onlydeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdragonflydb: 20 - 1:100dragonflydb: 10 - 1:100ncnn: CPU - resnet18ncnn: CPU - alexnetdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamdragonflydb: 10 - 1:10deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamncnn: CPU - vgg16ncnn: CPU - resnet50dragonflydb: 20 - 1:10ncnn: CPU - mobilenetncnn: CPU - vision_transformerstress-ng: Socket Activitybrl-cad: VGR Performance Metricstress-ng: MEMFDncnn: CPU - googlenetdeepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamdeepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamspecfem3d: Layered Halfspacespecfem3d: Mount St. Helensdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamspecfem3d: Water-layered Halfspacedeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamstress-ng: Futexdeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamspecfem3d: Homogeneous Halfspacesvt-av1: Preset 13 - Bosphorus 4Kspecfem3d: Tomographic Modeldeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamremhos: Sample Remap Examplebuild-linux-kernel: defconfigdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamliquid-dsp: 64 - 256 - 512laghos: Sedov Blast Wave, ube_922_hex.meshstress-ng: Matrix 3D Mathcassandra: Writessvt-av1: Preset 13 - Bosphorus 1080pnekrs: Kershawncnn: CPU - yolov4-tinydeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamnekrs: TurboPipe Periodicstress-ng: System V Message Passingdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamliquid-dsp: 2 - 256 - 32ospray: particle_volume/pathtracer/real_timesvt-av1: Preset 4 - Bosphorus 1080pliquid-dsp: 2 - 256 - 57stress-ng: Mixed Schedulerstress-ng: Pthreadliquid-dsp: 4 - 256 - 512liquid-dsp: 1 - 256 - 32liquid-dsp: 8 - 256 - 32liquid-dsp: 32 - 256 - 32liquid-dsp: 8 - 256 - 512liquid-dsp: 16 - 256 - 32liquid-dsp: 16 - 256 - 512liquid-dsp: 4 - 256 - 32liquid-dsp: 1 - 256 - 57liquid-dsp: 1 - 256 - 512liquid-dsp: 64 - 256 - 57liquid-dsp: 2 - 256 - 512liquid-dsp: 32 - 256 - 512stress-ng: Mutexliquid-dsp: 64 - 256 - 32svt-av1: Preset 4 - Bosphorus 1080pstress-ng: Atomicliquid-dsp: 8 - 256 - 57deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamliquid-dsp: 16 - 256 - 57deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 4Kliquid-dsp: 4 - 256 - 57liquid-dsp: 32 - 256 - 57svt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Kdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 4Kdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 1080pdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080pvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 1080p - Faststress-ng: Cloningvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastersvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Kkripke: laghos: Triple Point Problemdragonflydb: 50 - 1:100dragonflydb: 50 - 1:10build-linux-kernel: allmodconfigdgh2 x AMD EPYC 9334 32-Core9334 2p93334 rep92019395.1320249488.61373.0279257.4237258.5599757.47724.7153355.8877114.282113.6578168.724785.485419.876319.8112013602.067218607.1217931974.9225006.7336.384933.511939.4188466.5427731.16173878.7106715.8532151217.032944.542661.225594.88234239.6122.73667964.1513428.641543291.91916.74137476652.9340991307.95372.7237.939.8131842.764137.987610.0774106.146737.67748.474639.38414337787.7248.955.6340.5726857324.8910.863410.8453107643.4913.961007.46410.89776708.721131.5514.7611.6418.3510.711.291614.745467.765714.663268.16211.361.3724.2211.90020.6571.3514.013971.836213.919214250093.7111860591.6513.658.134.9317202.501911686474.2640.734524.53628.6926.5315179164.8623.5555.059504.38544648912.6229.031.1189890.944811.086890.075638.48977964914.5056452535.9947150.27634.8222274827.1456139.79344022496.0758.827916.996118.85382887614.87771034620.71448.251220.90435.2837.1102140.45687.1228140.2014504660000263.8510869.492304021152090000035.7519.635650.908974704900006851573.210.081399.1222436.974968834000176.61414.97410563000035640.3670043.7849884000351950002717300001073800000964490005493900001955100001365000005276500012652000177860000024900000387460000438280.162045600000236.99331200000794.0387650410000795.852199.52317428000012345000005.053195.829140.5767139.6127186.648294.619744.914842.8337641.605121.0894419.85361.805362.1006545.195136.0716.76819.1661170.3112.67833.57272.353372072000195.4017583489.3815253621.53800762640.11173499514.942613.0881780.23791778.36165150.4252166.73352405.8755770.5065761.86571128.8846566.7259129.4385129.384978673620.1445298625.91110432440.32154267.34220.9069202.3471782.95523898.45156381.63989553.8604724.84180789739.0816624.0714854.85617.311288008.2622.420133541.1172825.568237581.374846.22719479964.33215429087.6171.977.5149.5123217.591193.050250.4014497.8976183.4023239.4187193.604121346079.310.0226.9193.42973761786.2946.656746.6054462528.7357.6731064.951564.42334039.113664.3447.6735.9614.3829.9231.2444.275.4661182.64175.4478183.37173.403.2858.6628.35211.5030.223533.077931.451931.786529.2615.17.3831135.395520.598148.498956.3453.6241.21108.73110254.19639840497.9457.721.6492605.467213.847372.1848.5843256.16428.7387114.37842951631.9642.038823.7821203.00715.022366.522323.0587.2026138.75847.2111138.59465914000014658.75185134599.57348.0814.415969.32717729966.178.0302124.4072573.358255708000161.16913.5758810900029932.254906.434164100029219000228520000914570000830900004578200001651800001145500004418700010576000207660000020660000331240000364035.5718276000009.831204.44279840000969.2352542300000969.8849189.16415101000010573000004.615191.6654.124167.4236165.5104224.6455113.019153.115648.8841756.6198179.40524.7947490.15471.821471.7619511.795600.23125.22134.8751139.8792.64175.15786069338.66159491222.342633.5921784.35591786.17565175.4863168.75062429.7418774.4054764.73741127.7925569.3208131.5432131.101378690548.4945265797.34110991931.6154293.33222.8586201.5971790.06518600.85158994.25990104.85605340.53181626937.8516625.5713153.495817.121285121.422.3520123210.1472800.748234456.234850.99725705488.15215308424.8171.397.450.0879207.2492172.206850.9618532.4594187.4161225.8305194.274320251576.3310.0223.63184.45373745995.1646.756246.5528461785.3645.2230591.671628.91361173.713749.4748.7637.5614.4629.5530.8942.35.4481183.23655.4268184.09213.533.4658.4128.25371.5430.365132.922630.723132.540629.5617.397.4589134.015919.744650.597558.8554.4744.1493.15113347.776270577115.8355.361.6419608.161112.828677.91699.6974239.19158.6016116.19272880825.1135.850827.8849197.0314.564968.612323.0467.1792139.21457.1163140.440365282000015802.86190955600.76248.8213.96571.56547761412.617.6734130.1929567.85555923000160.8712.9138804200029481.4555328.714105200029200000228090000911870000827490004574200001653900001143900004418300010567000207200000020837000329210000363892.118221000009.901203.49277250000952.8689546690000954.9445194.86315536000010650000004.593177.3634.204166.7561164.6605223.8503113.202752.57748.5107751.7219187.67724.6777485.59371.535571.5815507.017581.067124.695134.381209.5394.83173.25226498215.4439461287.6773.5125519.8211519.99321522.046249.7556718.354233.9079231.4583333.851169.271840.574540.247725697538.815425278.8329340312.9652591.7770.902954.5924103.76176344.3854824.58314789.68198651.8858550931.395876.155651.571151.86430109.2663.376626091.9326146.712804498.361675.93262321226.7872167140.03201.5320.6517.435775.282567.483717.8136204.414969.487686.78572.65149104744.1526.437.272.25531312330.4420.398420.3347156553.5118.631641.77788.211095211.772289.819.7914.8742.3313.7413.9416.448.9324111.8518.8864112.46812.212.2125.5120.34161.0444.304422.567344.739222.347831139658.4925802999.0315.169.393.5591280.781922176931.9826.50637.698136.6529.6231053489.2421.853.7938147.9710125371004.7931.030.87111144.30647.5379132.502221.6690898468.4554735345.6462156.059821.3919205075.3972185.02424717570.3637.142126.917311.61697014127.1369.48714578113.306475.100413.51224.744.809207.71534.8028207.99754210000389.8614005.29255016416.173809563000034.6315.021666.536454411000009268236.48.0098124.7249448.734872597000204.93216.19711132000037887.1470405.47523150003717000028873000011581000001043100005755100002086300001442100005415500013207000224720000025706000413970000457807.79228470000012.06253.6346260000776.9139658580000780.5977163.44218539000012930000005.599162.8554.914137.9127136.595188.743295.739244.487341.3109635.6357158.70520.9994442.5561.457261.4884462.328562.313142.186149.1087.39720.7271245.2113.73236.02589.90577.219391567400198.94212194044.2142013739.43779.2277521.805522.111519.29549.8006719.7723234.1305232.2319334.5256168.338740.550940.446525688067.5215412840.2135971998.9852548.2570.207753.7824101.4176621.2754852.06315324.18198855.7558491170.755885.265626.770552.77430141.5463.456624476.3626144.82802185.771674.65263438850.6477814243.76201.5120.5117.330775.456467.323717.7639204.347769.671586.528872.63629067852.1926.158.1572.77461465208.8120.452620.3981156859.2218.351615793.081135334.92299.2819.9215.1841.4913.6914.0222.298.938111.77868.8725112.64632.202.2028.4720.38911.0344.745722.344744.627922.403929330317.3422585212.5617.4910.73.5922278.179424460221.4826.477237.738436.930.628043162.327.4166.6537674.679943711014.2433.40.86771149.12557.7484128.907721.5373245738.3200918565.6693156.277320.8594721725.3028188.31794644551.2937.297326.805511.643695909155.1129.41908663513.296775.1513.96224.6714.7159211.81054.7942208.3426755970000388.86519828914022.5258638560.785814712000040.1915.086866.247354260300009258853.698.0136124.6687451.054472480000209.60916.29511133000037702.2270476.97524690003712600028843000011587000001051700005795100002078100001448000005562400013357000223160000025885000414060000456942.16229130000012.358254.16336320000779.176674330000781.5381160.62618536000012750000005.643163.4255.012137.4827136.4554189.515895.536444.410641.0198635.6516159.25821.0312442.43661.218461.2502458.518520.167140.171150.3467.44720.882119013.68435.57596.10576.503393276500199.20214488001.2142047609.47777.8507520.3204519.7251521.745149.8729715.5913233.339231.4234334.2742168.63140.379640.286825663966.0215326552.1435280554.4252511.0770.824468.6824129.62176710.8554675.85314753.85198610.9358570424.415875.455618.588951.99430096.5563.716621974.9826129.52802578.871676.27263330738.6372810418.71201.9320.4317.278975.11766.850717.8324204.221169.48586.55572.17499078474.0126.378.3972.84651536517.6520.388220.3139156863.7818.471616.05797.641096840.322287.6919.9615.8742.114.2415.0221.58.9437111.70148.8896112.43152.192.2134.9920.33161.0444.358522.539844.661122.386929280070.9724588214.8116.2210.593.5347282.716523645213.1326.479537.735242.0841.0229580028.0627.9561.2438727.869998931009.4733.680.87041145.23438.1347122.790521.6888129918.486910525.6773156.192821.1513706085.2862188.92434752131.3737.574226.607611.533002652152.5839.37456308213.380174.68413.82524.7844.7957208.31034.8205207.2316753120000387.15078606914009.23268984517.438813095000043.5915.082966.267754372400009251814.097.9992124.8961448.886372532000208.8616.6788624800037534518210003718300029032000011595000001022700005809200002093700001438300005588200013320000219430000026081000415200000457061.39229170000012.25254.23329180000779.8287656510000781.9977161.05318667000013024000005.65160.0785.03137.9731136.8061189.326195.597144.680941.101635.1989161.66620.9984416.14961.49161.4475443.322593.633137.614148.8467.35821.0051188.6413.80334.7694.72677.191375715500197.19OpenBenchmarking.org

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphores2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh200M400M600M800M1000M226498215.44214488001.21212194044.2192019395.13800762640.11786069338.661. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipe2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh40M80M120M160M200M39461287.6042047609.4742013739.4320249488.61173499514.94159491222.341. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh6001200180024003000773.51777.85779.23373.032613.092633.59

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh400800120016002000519.82520.32521.81257.421780.241784.36

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh400800120016002000519.99519.73522.11258.561778.361786.18

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh110022003300440055001522.051521.751519.30757.485150.435175.49

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020049.7649.8749.8024.72166.73168.75

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5001000150020002500718.35715.59719.77355.892405.882429.74

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh170340510680850233.91233.34234.13114.28770.51774.41

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh160320480640800231.46231.42232.23113.66761.87764.74

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2004006008001000333.85334.27334.53168.721128.881127.79

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh120240360480600169.27168.63168.3485.49566.73569.32

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30609012015040.5740.3840.5519.88129.44131.54

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30609012015040.2540.2940.4519.81129.38131.10

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRand2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20M40M60M80M100M25697538.8025663966.0225688067.5212013602.0678673620.1478690548.491. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hash2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh10M20M30M40M50M15425278.8315326552.1415412840.217218607.1245298625.9145265797.341. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context Switching2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20M40M60M80M100M29340312.9635280554.4235971998.9817931974.92110432440.32110991931.601. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shuffle2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30K60K90K120K150K52591.7752511.0752548.2525006.73154267.34154293.331. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5010015020025070.9070.8270.2136.38220.91222.86

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400m2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020054.5968.6853.7833.50202.34201.59MIN: 50.39 / MAX: 663.91MIN: 53.81 / MAX: 3458.69MIN: 53.02 / MAX: 60.41MIN: 33.26 / MAX: 37.92MIN: 187.7 / MAX: 1161.84MIN: 191.08 / MAX: 1525.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Point2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh15K30K45K60K75K24103.7624129.6224101.4011939.4171782.9571790.061. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stress2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh110K220K330K440K550K176344.38176710.85176621.2788466.54523898.45518600.851. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Call2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30K60K90K120K150K54824.5854675.8554852.0627731.16156381.63158994.251. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Math2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh200K400K600K800K1000K314789.68314753.85315324.18173878.70989553.80990104.851. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Point2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh130K260K390K520K650K198651.88198610.93198855.75106715.85604724.84605340.531. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Add2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh40M80M120M160M200M58550931.3958570424.4158491170.7532151217.03180789739.08181626937.851. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlib2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4K8K12K16K20K5876.155875.455885.262944.5416624.0716625.571. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh3K6K9K12K15K5651.575618.595626.772661.2314854.8613153.50

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2040608010051.8651.9952.7794.8817.3117.12

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Math2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh300K600K900K1200K1500K430109.26430096.55430141.54234239.601288008.261285121.401. (CXX) g++ options: -O2 -std=gnu99 -lc

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30609012015063.3763.7163.45122.7022.4022.35

Stress-NG

Test: AVX-512 VNNI

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNI2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4M8M12M16M20M6626091.936621974.986624476.363667964.1520133541.1120123210.141. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copying2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh16K32K48K64K80K26146.7126129.5026144.8013428.6472825.5672800.741. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Math2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2M4M6M8M10M2804498.362802578.872802185.771543291.918237581.378234456.231. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sorting2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh100020003000400050001675.931676.271674.65916.744846.224850.991. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Malloc2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh160M320M480M640M800M262321226.78263330738.63263438850.64137476652.93719479964.33725705488.151. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functions2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50M100M150M200M250M72167140.0372810418.7177814243.7640991307.95215429087.61215308424.811. (CXX) g++ options: -O2 -std=gnu99 -lc

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh80160240320400201.53201.93201.51372.7271.9771.39

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh91827364520.6520.4320.5137.937.517.40

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445517.4357017.2789017.330709.8131849.5123050.08790

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragon2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5010015020025075.2875.1275.4642.76217.59207.25MIN: 73.5 / MAX: 78.24MIN: 73.42 / MAX: 78.19MIN: 73.59 / MAX: 78.22MIN: 42.48 / MAX: 43.18MIN: 211.81 / MAX: 228.26MIN: 203.29 / MAX: 214.14

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragon Obj2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020067.4866.8567.3237.99193.05172.21MIN: 65.8 / MAX: 70.02MIN: 65.41 / MAX: 70.72MIN: 65.8 / MAX: 70.31MIN: 37.71 / MAX: 38.4MIN: 174.03 / MAX: 205.21MIN: 150.53 / MAX: 183.32

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445517.8117.8317.7610.0850.4050.96

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh120240360480600204.41204.22204.35106.15497.90532.46

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Crown2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020069.4969.4969.6737.68183.40187.42MIN: 65.97 / MAX: 75.27MIN: 65.87 / MAX: 75.16MIN: 66.25 / MAX: 75.27MIN: 37.26 / MAX: 39.44MIN: 179.05 / MAX: 191.46MIN: 183.21 / MAX: 193.83

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5010015020025086.7986.5686.5348.47239.42225.83MIN: 83.33 / MAX: 93.39MIN: 83.15 / MAX: 93.4MIN: 83.4 / MAX: 92.47MIN: 48.1 / MAX: 49.28MIN: 232.82 / MAX: 253.03MIN: 221.04 / MAX: 232.51

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Crown2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020072.6572.1772.6439.38193.60194.27MIN: 68.96 / MAX: 77.69MIN: 68.85 / MAX: 77.58MIN: 69.23 / MAX: 79.15MIN: 38.86 / MAX: 40.97MIN: 188.25 / MAX: 201.2MIN: 188.82 / MAX: 203.12

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Poll2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5M10M15M20M25M9104744.159078474.019067852.194337787.7221346079.3020251576.331. (CXX) g++ options: -O2 -std=gnu99 -lc

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445526.4326.3726.1548.9510.0210.02

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazeface2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh6121824307.208.398.155.6326.9023.63MIN: 7.05 / MAX: 7.44MIN: 8.09 / MAX: 17.41MIN: 7.89 / MAX: 14.8MIN: 5.53 / MAX: 5.95MIN: 21.88 / MAX: 899.43MIN: 21.98 / MAX: 379.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon Obj2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020072.2672.8572.7740.57193.43184.45MIN: 69.72 / MAX: 77.54MIN: 70.3 / MAX: 76.96MIN: 70.2 / MAX: 78.62MIN: 40.28 / MAX: 41.19MIN: 170.24 / MAX: 203.63MIN: 159.04 / MAX: 199.2

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILE2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh800K1600K2400K3200K4000K1312330.441536517.651465208.81857324.893761786.293745995.161. (CXX) g++ options: -O2 -std=gnu99 -lc

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445520.4020.3920.4510.8646.6646.76

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445520.3320.3120.4010.8546.6146.55

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Crypto2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh100K200K300K400K500K156553.51156863.78156859.22107643.49462528.73461785.361. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v22 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526518.6318.4718.3513.9657.6745.22MIN: 18.34 / MAX: 19.34MIN: 18.09 / MAX: 20.53MIN: 17.76 / MAX: 24.49MIN: 13.65 / MAX: 18.71MIN: 40.74 / MAX: 1797.58MIN: 40.32 / MAX: 296.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Forking2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh7K14K21K28K35K1641.771616.051615.001007.4631064.9530591.671. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Tree2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30060090012001500788.21797.64793.08410.891564.421628.911. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cache2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh200K400K600K800K1000K1095211.771096840.321135334.90776708.72334039.11361173.711. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAP2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh80016002400320040002289.802287.692299.281131.553664.343749.471. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b02 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445519.7919.9619.9214.7647.6748.76MIN: 18.88 / MAX: 151.97MIN: 19.55 / MAX: 33.09MIN: 19.72 / MAX: 21.08MIN: 14.47 / MAX: 29.12MIN: 47.05 / MAX: 112.46MIN: 47.17 / MAX: 210.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v32 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh91827364514.8715.8715.1811.6435.9637.56MIN: 14.55 / MAX: 15.42MIN: 15.57 / MAX: 16.37MIN: 14.82 / MAX: 21.88MIN: 11.48 / MAX: 15.48MIN: 34.15 / MAX: 266.64MIN: 33.74 / MAX: 351.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMA2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh102030405042.3342.1041.4918.3514.3814.461. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283513.7414.2413.6910.7029.9229.55MIN: 13.14 / MAX: 22.9MIN: 13.93 / MAX: 14.54MIN: 13.25 / MAX: 14.74MIN: 10.22 / MAX: 14.66MIN: 27.82 / MAX: 234.43MIN: 28.64 / MAX: 97.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v22 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283513.9415.0214.0211.2931.2430.89MIN: 13.14 / MAX: 22.71MIN: 14.05 / MAX: 103.51MIN: 13.46 / MAX: 22.99MIN: 10.83 / MAX: 11.91MIN: 30.27 / MAX: 71.7MIN: 29.59 / MAX: 58.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh102030405016.4421.5022.2916.0044.2742.30MIN: 16.09 / MAX: 32.24MIN: 20.83 / MAX: 30.28MIN: 21.86 / MAX: 23.6MIN: 15.86 / MAX: 20.49MIN: 40.55 / MAX: 822.5MIN: 41.82 / MAX: 83.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh481216208.93248.94378.938014.74545.46615.4481

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200111.85111.70111.7867.77182.64183.24

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh481216208.88648.88968.872514.66325.44785.4268

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200112.47112.43112.6568.16183.37184.09

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh0.79431.58862.38293.17723.97152.212.192.201.363.403.53

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh0.77851.5572.33553.1143.89252.212.212.201.373.283.46

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssd2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526525.5134.9928.4724.2258.6658.41MIN: 23.43 / MAX: 95.27MIN: 28.93 / MAX: 1349.8MIN: 28.05 / MAX: 34.83MIN: 23.8 / MAX: 28.97MIN: 55.23 / MAX: 333.73MIN: 57.55 / MAX: 98.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283520.3420.3320.3911.9028.3528.25

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh0.34650.6931.03951.3861.73251.041.041.030.651.501.54

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648044.3044.3644.7571.3530.2230.37

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh81624324022.5722.5422.3414.0133.0832.92

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648044.7444.6644.6371.8431.4530.72

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh81624324022.3522.3922.4013.9231.7932.54

Dragonflydb

Clients Per Thread: 20 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 20 - Set To Get Ratio: 1:1002 x AMD EPYC 9334 32-Core93334 rep9334 2pd7M14M21M28M35M31139658.4929280070.9729330317.3414250093.711. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 10 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 10 - Set To Get Ratio: 1:1002 x AMD EPYC 9334 32-Core93334 rep9334 2pd6M12M18M24M30M25802999.0324588214.8122585212.5611860591.651. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet182 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283515.1616.2217.4913.6529.2629.56MIN: 14.45 / MAX: 22.73MIN: 15.17 / MAX: 57.27MIN: 16.57 / MAX: 24.11MIN: 13.29 / MAX: 15.11MIN: 26.62 / MAX: 124.57MIN: 27.99 / MAX: 114.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh481216209.3910.5910.708.1315.1017.39MIN: 9 / MAX: 9.79MIN: 9.51 / MAX: 107.87MIN: 10.12 / MAX: 12.2MIN: 7.95 / MAX: 8.44MIN: 14.22 / MAX: 74.43MIN: 14.86 / MAX: 374.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2468103.55913.53473.59224.93177.38317.4589

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60120180240300280.78282.72278.18202.50135.40134.02

Dragonflydb

Clients Per Thread: 10 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 10 - Set To Get Ratio: 1:102 x AMD EPYC 9334 32-Core93334 rep9334 2pd5M10M15M20M25M22176931.9823645213.1324460221.4811686474.261. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh91827364526.5126.4826.4840.7320.6019.74

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445537.7037.7437.7424.5448.5050.60

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg162 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526536.6542.0836.9028.5756.3458.85MIN: 33.43 / MAX: 47.15MIN: 36.25 / MAX: 590.93MIN: 34.81 / MAX: 49.99MIN: 27.98 / MAX: 32.46MIN: 50.98 / MAX: 172.01MIN: 55.68 / MAX: 98.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet502 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh122436486029.6241.0230.6026.5353.6254.47MIN: 27.91 / MAX: 147.23MIN: 30.92 / MAX: 2215.16MIN: 30.17 / MAX: 37.09MIN: 26.13 / MAX: 30.95MIN: 51.72 / MAX: 288.16MIN: 51.64 / MAX: 145.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Dragonflydb

Clients Per Thread: 20 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 20 - Set To Get Ratio: 1:102 x AMD EPYC 9334 32-Core93334 rep9334 2pd7M14M21M28M35M31053489.2429580028.0628043162.3015179164.861. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh102030405021.8027.9527.4123.5541.2144.14MIN: 21.41 / MAX: 29.57MIN: 27.34 / MAX: 34.73MIN: 26.74 / MAX: 33.85MIN: 23.18 / MAX: 27.8MIN: 40.54 / MAX: 69.23MIN: 42.79 / MAX: 118.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformer2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2040608010053.7961.2466.6555.05108.7393.15MIN: 52.29 / MAX: 122.53MIN: 59.18 / MAX: 264.24MIN: 59.07 / MAX: 626.24MIN: 54.24 / MAX: 72.37MIN: 94.5 / MAX: 1869.82MIN: 88.26 / MAX: 206.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket Activity2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20K40K60K80K100K38147.9738727.8637674.679504.38110254.19113347.771. (CXX) g++ options: -O2 -std=gnu99 -lc

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metric2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh1.4M2.8M4.2M5.6M7M1012537999893994371544648639840462705771. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFD2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20040060080010001004.791009.471014.24912.6297.94115.831. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526531.0333.6833.4029.0357.7255.36MIN: 30.4 / MAX: 40.18MIN: 32.93 / MAX: 40.38MIN: 32.92 / MAX: 35.55MIN: 27.97 / MAX: 36.49MIN: 52.79 / MAX: 429.12MIN: 54.42 / MAX: 115.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh0.37110.74221.11331.48441.85550.87110.87040.86771.11891.64921.6419

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20040060080010001144.311145.231149.13890.94605.47608.16

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh481216207.53798.13477.748411.086813.847312.8286

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh306090120150132.50122.79128.9190.0872.1877.92

SPECFEM3D

Model: Layered Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Layered Halfspace2 x AMD EPYC 9334 32-Core93334 rep9334 2pd91827364521.6721.6921.5438.491. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

SPECFEM3D

Model: Mount St. Helens

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Mount St. Helens2 x AMD EPYC 9334 32-Core93334 rep9334 2pd481216208.4554735348.4869105208.32009185614.5056452531. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh36912155.64625.67735.66935.99478.58439.6974

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60120180240300156.06156.19156.28150.28256.16239.19

SPECFEM3D

Model: Water-layered Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Water-layered Halfspace2 x AMD EPYC 9334 32-Core93334 rep9334 2pd81624324021.3921.1520.8634.821. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2468105.39725.28625.30287.14568.73878.6016

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200185.02188.92188.32139.79114.38116.19

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Futex2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh1000K2000K3000K4000K5000K4717570.364752131.374644551.294022496.072951631.962880825.111. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526537.1437.5737.3058.8342.0435.85

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283526.9226.6126.8117.0023.7827.88

SPECFEM3D

Model: Homogeneous Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Homogeneous Halfspace2 x AMD EPYC 9334 32-Core93334 rep9334 2pd51015202511.6211.5311.6418.851. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh4080120160200127.14152.58155.11203.01197.031. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SPECFEM3D

Model: Tomographic Model

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Tomographic Model2 x AMD EPYC 9334 32-Core93334 rep9334 2pd481216209.4871457819.3745630829.41908663514.8777103461. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh51015202513.3113.3813.3020.7115.0214.56

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2040608010075.1074.6875.1548.2566.5268.61

Remhos

Test: Sample Remap Example

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap Example2 x AMD EPYC 9334 32-Core93334 rep9334 2pd51015202513.5113.8313.9620.901. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfig2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh81624324024.7424.7824.6735.2823.0623.05

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2468104.80904.79574.71597.11027.20267.1792

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50100150200250207.72208.31211.81140.46138.76139.21

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2468104.80284.82054.79427.12287.21117.1163

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50100150200250207.99207.23208.34140.20138.59140.44

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh160M320M480M640M800M7542100007531200007559700005046600006591400006528200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Laghos

Test: Sedov Blast Wave, ube_922_hex.mesh

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Sedov Blast Wave, ube_922_hex.mesh2 x AMD EPYC 9334 32-Core93334 rep9334 2pd80160240320400389.86387.15388.87263.851. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Math2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh3K6K9K12K15K14005.2914009.2314022.5010869.4914658.7515802.861. (CXX) g++ options: -O2 -std=gnu99 -lc

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writes2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60K120K180K240K300K255016268984258638230402185134190955

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh130260390520650416.17517.44560.79599.57600.761. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershaw2 x AMD EPYC 9334 32-Core93334 rep9334 2pd2000M4000M6000M8000M10000M809563000081309500008147120000115209000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tiny2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445534.6343.5940.1935.7548.0848.82MIN: 32.71 / MAX: 43.98MIN: 35.28 / MAX: 640.68MIN: 39.2 / MAX: 49.85MIN: 34.32 / MAX: 45.5MIN: 42.94 / MAX: 393.57MIN: 45.36 / MAX: 93.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh51015202515.0215.0815.0919.6414.4213.97

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648066.5466.2766.2550.9169.3371.57

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodic2 x AMD EPYC 9334 32-Core93334 rep9334 2pd1600M3200M4800M6400M8000M54411000005437240000542603000074704900001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passing2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2M4M6M8M10M9268236.409251814.099258853.696851573.207729966.177761412.611. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh36912158.00987.99928.013610.08138.03027.6734

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh306090120150124.72124.90124.6799.12124.41130.19

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh120240360480600448.73448.89451.05436.97573.36567.86

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh16M32M48M64M80M7259700072532000724800006883400055708000559230001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50100150200250204.93208.86209.61176.61161.17160.87

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 4 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4812162016.2016.6816.3014.9713.5812.911. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20M40M60M80M100M1113200008624800011133000010563000088109000880420001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed Scheduler2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh8K16K24K32K40K37887.1437534.0037702.2235640.3629932.2029481.451. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthread2 x AMD EPYC 9334 32-Core9334 2pdgh15K30K45K60K75K70405.4770476.9770043.7854906.4355328.711. (CXX) g++ options: -O2 -std=gnu99 -lc

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh11M22M33M44M55M5231500051821000524690004988400041641000410520001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh8M16M24M32M40M3717000037183000371260003519500029219000292000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60M120M180M240M300M2887300002903200002884300002717300002285200002280900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh200M400M600M800M1000M11581000001159500000115870000010738000009145700009118700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20M40M60M80M100M1043100001022700001051700009644900083090000827490001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh120M240M360M480M600M5755100005809200005795100005493900004578200004574200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh40M80M120M160M200M2086300002093700002078100001955100001651800001653900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30M60M90M120M150M1442100001438300001448000001365000001145500001143900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh12M24M36M48M60M5415500055882000556240005276500044187000441830001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh3M6M9M12M15M1320700013320000133570001265200010576000105670001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh500M1000M1500M2000M2500M2247200000219430000022316000001778600000207660000020720000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh6M12M18M24M30M2570600026081000258850002490000020660000208370001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh90M180M270M360M450M4139700004152000004140600003874600003312400003292100001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutex2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh100K200K300K400K500K457807.79457061.39456942.16438280.16364035.57363892.101. (CXX) g++ options: -O2 -std=gnu99 -lc

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh500M1000M1500M2000M2500M2284700000229170000022913000002045600000182760000018221000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh369121512.06012.25012.3589.8319.9011. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Atomic2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60120180240300253.60254.23254.16236.99204.44203.491. (CXX) g++ options: -O2 -std=gnu99 -lc

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh70M140M210M280M350M3462600003291800003363200003312000002798400002772500001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2004006008001000776.91779.83779.18794.04969.24952.87

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh140M280M420M560M700M6585800006565100006743300006504100005423000005466900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2004006008001000780.60782.00781.54795.85969.88954.94

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 12 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200163.44161.05160.63199.52189.16194.861. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh40M80M120M160M200M1853900001866700001853600001742800001510100001553600001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh300M600M900M1200M1500M1293000000130240000012750000001234500000105730000010650000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 4 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh1.27132.54263.81395.08526.35655.5995.6505.6435.0534.6154.5931. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 13 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200162.86160.08163.43195.83191.67177.361. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh1.13182.26363.39544.52725.6594.9145.0305.0124.1244.2041. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200137.91137.97137.48140.58167.42166.76

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200136.60136.81136.46139.61165.51164.66

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50100150200250188.74189.33189.52186.65224.65223.85

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30609012015095.7495.6095.5494.62113.02113.20

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh122436486044.4944.6844.4144.9153.1252.58

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445541.3141.1041.0242.8348.8848.51

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh160320480640800635.64635.20635.65641.61756.62751.72

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh4080120160200158.71161.67159.26179.41187.681. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh61218243021.0021.0021.0321.0924.7924.68

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 12 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh110220330440550442.55416.15442.44419.85490.15485.591. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648061.4661.4961.2261.8171.8271.54

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648061.4961.4561.2562.1071.7671.58

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh110220330440550462.33443.32458.52511.80507.021. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 13 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh130260390520650562.31593.63520.17545.20600.23581.071. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh306090120150142.19137.61140.17125.22124.701. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 8 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh306090120150149.11148.85150.35136.07134.88134.381. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fast2 x AMD EPYC 9334 32-Core93334 rep9334 2pd2468107.3977.3587.4476.7681. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fast2 x AMD EPYC 9334 32-Core93334 rep9334 2pd51015202520.7321.0120.8819.171. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Stress-NG

Test: Cloning

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cloning2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh300600900120015001245.211188.641190.001170.311139.871209.531. (CXX) g++ options: -O2 -std=gnu99 -lc

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Faster2 x AMD EPYC 9334 32-Core93334 rep9334 2pd4812162013.7313.8013.6812.681. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Faster2 x AMD EPYC 9334 32-Core93334 rep9334 2pd81624324036.0334.7635.5833.571. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh2040608010089.9194.7396.1192.6494.831. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 8 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2040608010077.2277.1976.5072.3575.1573.251. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Kripke

OpenBenchmarking.orgThroughput FoM, More Is BetterKripke 1.2.62 x AMD EPYC 9334 32-Core93334 rep9334 2pd80M160M240M320M400M3915674003757155003932765003720720001. (CXX) g++ options: -O3 -fopenmp -ldl

Laghos

Test: Triple Point Problem

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Triple Point Problem2 x AMD EPYC 9334 32-Core93334 rep9334 2pd4080120160200198.94197.19199.20195.401. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Dragonflydb

Clients Per Thread: 50 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 50 - Set To Get Ratio: 1:100d4M8M12M16M20M17583489.381. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 50 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 50 - Set To Get Ratio: 1:10d3M6M9M12M15M15253621.531. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre


Phoronix Test Suite v10.8.4