extra tests

benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2309060-NE-EXTRATEST87&grs&sro.

extra testsProcessorMotherboardMemoryDiskGraphicsOSKernelCompilerFile-SystemScreen Resolutiondgh2 x AMD EPYC 9334 32-Core9334 2p93334 rep2 x AMD EPYC 9124 16-Core @ 3.00GHz (32 Cores / 64 Threads)Supermicro H13DSH (1.5 BIOS)24 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07astdrmfbAlmaLinux 9.25.14.0-284.25.1.el9_2.x86_64 (x86_64)GCC 11.3.1 20221121ext41024x7682 x AMD EPYC 9754 128-Core @ 2.25GHz (256 Cores / 512 Threads)23 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET2 x AMD EPYC 9334 32-Core @ 2.70GHz (64 Cores / 128 Threads)21 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKETOpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details- d: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- g: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- h: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xaa00116- 2 x AMD EPYC 9334 32-Core: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- 9334 2p: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- 93334 rep: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113eJava Details- OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Details- Python 3.9.16Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

extra testsstress-ng: Semaphoresstress-ng: Pipedeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamstress-ng: x86_64 RdRandstress-ng: Hashstress-ng: Context Switchingstress-ng: Vector Shuffledeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamncnn: CPU - regnety_400mstress-ng: Floating Pointstress-ng: CPU Stressstress-ng: Function Callstress-ng: Matrix Mathstress-ng: Vector Floating Pointstress-ng: Fused Multiply-Addstress-ng: Zlibdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamblender: Classroom - CPU-Onlystress-ng: Vector Mathblender: Pabellon Barcelona - CPU-Onlystress-ng: AVX-512 VNNIstress-ng: Memory Copyingstress-ng: Wide Vector Mathstress-ng: Glibc Qsort Data Sortingstress-ng: Mallocstress-ng: Glibc C String Functionsblender: Barbershop - CPU-Onlyblender: BMW27 - CPU-Onlyospray: gravity_spheres_volume/dim_512/scivis/real_timeembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objospray: gravity_spheres_volume/dim_512/ao/real_timedeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamembree: Pathtracer - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownstress-ng: Pollblender: Fishy Cat - CPU-Onlyncnn: CPU - blazefaceembree: Pathtracer ISPC - Asian Dragon Objstress-ng: SENDFILEospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timestress-ng: Cryptoncnn: CPU - shufflenet-v2stress-ng: Forkingstress-ng: AVL Treestress-ng: CPU Cachestress-ng: MMAPncnn: CPU - efficientnet-b0ncnn: CPU-v3-v3 - mobilenet-v3stress-ng: NUMAncnn: CPU - mnasnetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU - FastestDetdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyncnn: CPU - squeezenet_ssdospray: gravity_spheres_volume/dim_512/pathtracer/real_timeoidn: RTLightmap.hdr.4096x4096 - CPU-Onlydeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdragonflydb: 20 - 1:100dragonflydb: 10 - 1:100ncnn: CPU - resnet18ncnn: CPU - alexnetdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamdragonflydb: 10 - 1:10deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamncnn: CPU - vgg16ncnn: CPU - resnet50dragonflydb: 20 - 1:10ncnn: CPU - mobilenetncnn: CPU - vision_transformerstress-ng: Socket Activitybrl-cad: VGR Performance Metricstress-ng: MEMFDncnn: CPU - googlenetdeepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamdeepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamspecfem3d: Layered Halfspacespecfem3d: Mount St. Helensdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamspecfem3d: Water-layered Halfspacedeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamstress-ng: Futexdeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamspecfem3d: Homogeneous Halfspacesvt-av1: Preset 13 - Bosphorus 4Kspecfem3d: Tomographic Modeldeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamremhos: Sample Remap Examplebuild-linux-kernel: defconfigdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamliquid-dsp: 64 - 256 - 512laghos: Sedov Blast Wave, ube_922_hex.meshstress-ng: Matrix 3D Mathcassandra: Writessvt-av1: Preset 13 - Bosphorus 1080pnekrs: Kershawncnn: CPU - yolov4-tinydeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamnekrs: TurboPipe Periodicstress-ng: System V Message Passingdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamliquid-dsp: 2 - 256 - 32ospray: particle_volume/pathtracer/real_timesvt-av1: Preset 4 - Bosphorus 1080pliquid-dsp: 2 - 256 - 57stress-ng: Mixed Schedulerstress-ng: Pthreadliquid-dsp: 4 - 256 - 512liquid-dsp: 1 - 256 - 32liquid-dsp: 8 - 256 - 32liquid-dsp: 32 - 256 - 32liquid-dsp: 8 - 256 - 512liquid-dsp: 16 - 256 - 32liquid-dsp: 16 - 256 - 512liquid-dsp: 4 - 256 - 32liquid-dsp: 1 - 256 - 57liquid-dsp: 1 - 256 - 512liquid-dsp: 64 - 256 - 57liquid-dsp: 2 - 256 - 512liquid-dsp: 32 - 256 - 512stress-ng: Mutexliquid-dsp: 64 - 256 - 32svt-av1: Preset 4 - Bosphorus 1080pstress-ng: Atomicliquid-dsp: 8 - 256 - 57deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamliquid-dsp: 16 - 256 - 57deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 4Kliquid-dsp: 4 - 256 - 57liquid-dsp: 32 - 256 - 57svt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Kdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 4Kdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 1080pdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080pvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 1080p - Faststress-ng: Cloningvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastersvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Kkripke: laghos: Triple Point Problemdragonflydb: 50 - 1:100dragonflydb: 50 - 1:10build-linux-kernel: allmodconfigdgh2 x AMD EPYC 9334 32-Core9334 2p93334 rep92019395.1320249488.61373.0279257.4237258.5599757.47724.7153355.8877114.282113.6578168.724785.485419.876319.8112013602.067218607.1217931974.9225006.7336.384933.511939.4188466.5427731.16173878.7106715.8532151217.032944.542661.225594.88234239.6122.73667964.1513428.641543291.91916.74137476652.9340991307.95372.7237.939.8131842.764137.987610.0774106.146737.67748.474639.38414337787.7248.955.6340.5726857324.8910.863410.8453107643.4913.961007.46410.89776708.721131.5514.7611.6418.3510.711.291614.745467.765714.663268.16211.361.3724.2211.90020.6571.3514.013971.836213.919214250093.7111860591.6513.658.134.9317202.501911686474.2640.734524.53628.6926.5315179164.8623.5555.059504.38544648912.6229.031.1189890.944811.086890.075638.48977964914.5056452535.9947150.27634.8222274827.1456139.79344022496.0758.827916.996118.85382887614.87771034620.71448.251220.90435.2837.1102140.45687.1228140.2014504660000263.8510869.492304021152090000035.7519.635650.908974704900006851573.210.081399.1222436.974968834000176.61414.97410563000035640.3670043.7849884000351950002717300001073800000964490005493900001955100001365000005276500012652000177860000024900000387460000438280.162045600000236.99331200000794.0387650410000795.852199.52317428000012345000005.053195.829140.5767139.6127186.648294.619744.914842.8337641.605121.0894419.85361.805362.1006545.195136.0716.76819.1661170.3112.67833.57272.353372072000195.4017583489.3815253621.53800762640.11173499514.942613.0881780.23791778.36165150.4252166.73352405.8755770.5065761.86571128.8846566.7259129.4385129.384978673620.1445298625.91110432440.32154267.34220.9069202.3471782.95523898.45156381.63989553.8604724.84180789739.0816624.0714854.85617.311288008.2622.420133541.1172825.568237581.374846.22719479964.33215429087.6171.977.5149.5123217.591193.050250.4014497.8976183.4023239.4187193.604121346079.310.0226.9193.42973761786.2946.656746.6054462528.7357.6731064.951564.42334039.113664.3447.6735.9614.3829.9231.2444.275.4661182.64175.4478183.37173.403.2858.6628.35211.5030.223533.077931.451931.786529.2615.17.3831135.395520.598148.498956.3453.6241.21108.73110254.19639840497.9457.721.6492605.467213.847372.1848.5843256.16428.7387114.37842951631.9642.038823.7821203.00715.022366.522323.0587.2026138.75847.2111138.59465914000014658.75185134599.57348.0814.415969.32717729966.178.0302124.4072573.358255708000161.16913.5758810900029932.254906.434164100029219000228520000914570000830900004578200001651800001145500004418700010576000207660000020660000331240000364035.5718276000009.831204.44279840000969.2352542300000969.8849189.16415101000010573000004.615191.6654.124167.4236165.5104224.6455113.019153.115648.8841756.6198179.40524.7947490.15471.821471.7619511.795600.23125.22134.8751139.8792.64175.15786069338.66159491222.342633.5921784.35591786.17565175.4863168.75062429.7418774.4054764.73741127.7925569.3208131.5432131.101378690548.4945265797.34110991931.6154293.33222.8586201.5971790.06518600.85158994.25990104.85605340.53181626937.8516625.5713153.495817.121285121.422.3520123210.1472800.748234456.234850.99725705488.15215308424.8171.397.450.0879207.2492172.206850.9618532.4594187.4161225.8305194.274320251576.3310.0223.63184.45373745995.1646.756246.5528461785.3645.2230591.671628.91361173.713749.4748.7637.5614.4629.5530.8942.35.4481183.23655.4268184.09213.533.4658.4128.25371.5430.365132.922630.723132.540629.5617.397.4589134.015919.744650.597558.8554.4744.1493.15113347.776270577115.8355.361.6419608.161112.828677.91699.6974239.19158.6016116.19272880825.1135.850827.8849197.0314.564968.612323.0467.1792139.21457.1163140.440365282000015802.86190955600.76248.8213.96571.56547761412.617.6734130.1929567.85555923000160.8712.9138804200029481.4555328.714105200029200000228090000911870000827490004574200001653900001143900004418300010567000207200000020837000329210000363892.118221000009.901203.49277250000952.8689546690000954.9445194.86315536000010650000004.593177.3634.204166.7561164.6605223.8503113.202752.57748.5107751.7219187.67724.6777485.59371.535571.5815507.017581.067124.695134.381209.5394.83173.25226498215.4439461287.6773.5125519.8211519.99321522.046249.7556718.354233.9079231.4583333.851169.271840.574540.247725697538.815425278.8329340312.9652591.7770.902954.5924103.76176344.3854824.58314789.68198651.8858550931.395876.155651.571151.86430109.2663.376626091.9326146.712804498.361675.93262321226.7872167140.03201.5320.6517.435775.282567.483717.8136204.414969.487686.78572.65149104744.1526.437.272.25531312330.4420.398420.3347156553.5118.631641.77788.211095211.772289.819.7914.8742.3313.7413.9416.448.9324111.8518.8864112.46812.212.2125.5120.34161.0444.304422.567344.739222.347831139658.4925802999.0315.169.393.5591280.781922176931.9826.50637.698136.6529.6231053489.2421.853.7938147.9710125371004.7931.030.87111144.30647.5379132.502221.6690898468.4554735345.6462156.059821.3919205075.3972185.02424717570.3637.142126.917311.61697014127.1369.48714578113.306475.100413.51224.744.809207.71534.8028207.99754210000389.8614005.29255016416.173809563000034.6315.021666.536454411000009268236.48.0098124.7249448.734872597000204.93216.19711132000037887.1470405.47523150003717000028873000011581000001043100005755100002086300001442100005415500013207000224720000025706000413970000457807.79228470000012.06253.6346260000776.9139658580000780.5977163.44218539000012930000005.599162.8554.914137.9127136.595188.743295.739244.487341.3109635.6357158.70520.9994442.5561.457261.4884462.328562.313142.186149.1087.39720.7271245.2113.73236.02589.90577.219391567400198.94212194044.2142013739.43779.2277521.805522.111519.29549.8006719.7723234.1305232.2319334.5256168.338740.550940.446525688067.5215412840.2135971998.9852548.2570.207753.7824101.4176621.2754852.06315324.18198855.7558491170.755885.265626.770552.77430141.5463.456624476.3626144.82802185.771674.65263438850.6477814243.76201.5120.5117.330775.456467.323717.7639204.347769.671586.528872.63629067852.1926.158.1572.77461465208.8120.452620.3981156859.2218.351615793.081135334.92299.2819.9215.1841.4913.6914.0222.298.938111.77868.8725112.64632.202.2028.4720.38911.0344.745722.344744.627922.403929330317.3422585212.5617.4910.73.5922278.179424460221.4826.477237.738436.930.628043162.327.4166.6537674.679943711014.2433.40.86771149.12557.7484128.907721.5373245738.3200918565.6693156.277320.8594721725.3028188.31794644551.2937.297326.805511.643695909155.1129.41908663513.296775.1513.96224.6714.7159211.81054.7942208.3426755970000388.86519828914022.5258638560.785814712000040.1915.086866.247354260300009258853.698.0136124.6687451.054472480000209.60916.29511133000037702.2270476.97524690003712600028843000011587000001051700005795100002078100001448000005562400013357000223160000025885000414060000456942.16229130000012.358254.16336320000779.176674330000781.5381160.62618536000012750000005.643163.4255.012137.4827136.4554189.515895.536444.410641.0198635.6516159.25821.0312442.43661.218461.2502458.518520.167140.171150.3467.44720.882119013.68435.57596.10576.503393276500199.20214488001.2142047609.47777.8507520.3204519.7251521.745149.8729715.5913233.339231.4234334.2742168.63140.379640.286825663966.0215326552.1435280554.4252511.0770.824468.6824129.62176710.8554675.85314753.85198610.9358570424.415875.455618.588951.99430096.5563.716621974.9826129.52802578.871676.27263330738.6372810418.71201.9320.4317.278975.11766.850717.8324204.221169.48586.55572.17499078474.0126.378.3972.84651536517.6520.388220.3139156863.7818.471616.05797.641096840.322287.6919.9615.8742.114.2415.0221.58.9437111.70148.8896112.43152.192.2134.9920.33161.0444.358522.539844.661122.386929280070.9724588214.8116.2210.593.5347282.716523645213.1326.479537.735242.0841.0229580028.0627.9561.2438727.869998931009.4733.680.87041145.23438.1347122.790521.6888129918.486910525.6773156.192821.1513706085.2862188.92434752131.3737.574226.607611.533002652152.5839.37456308213.380174.68413.82524.7844.7957208.31034.8205207.2316753120000387.15078606914009.23268984517.438813095000043.5915.082966.267754372400009251814.097.9992124.8961448.886372532000208.8616.6788624800037534518210003718300029032000011595000001022700005809200002093700001438300005588200013320000219430000026081000415200000457061.39229170000012.25254.23329180000779.8287656510000781.9977161.05318667000013024000005.65160.0785.03137.9731136.8061189.326195.597144.680941.101635.1989161.66620.9984416.14961.49161.4475443.322593.633137.614148.8467.35821.0051188.6413.80334.7694.72677.191375715500197.19OpenBenchmarking.org

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphores2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh200M400M600M800M1000M226498215.44214488001.21212194044.2192019395.13800762640.11786069338.661. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipe2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh40M80M120M160M200M39461287.6042047609.4742013739.4320249488.61173499514.94159491222.341. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh6001200180024003000773.51777.85779.23373.032613.092633.59

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh400800120016002000519.82520.32521.81257.421780.241784.36

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh400800120016002000519.99519.73522.11258.561778.361786.18

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh110022003300440055001522.051521.751519.30757.485150.435175.49

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020049.7649.8749.8024.72166.73168.75

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5001000150020002500718.35715.59719.77355.892405.882429.74

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh170340510680850233.91233.34234.13114.28770.51774.41

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh160320480640800231.46231.42232.23113.66761.87764.74

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2004006008001000333.85334.27334.53168.721128.881127.79

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh120240360480600169.27168.63168.3485.49566.73569.32

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30609012015040.5740.3840.5519.88129.44131.54

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30609012015040.2540.2940.4519.81129.38131.10

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRand2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20M40M60M80M100M25697538.8025663966.0225688067.5212013602.0678673620.1478690548.491. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hash2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh10M20M30M40M50M15425278.8315326552.1415412840.217218607.1245298625.9145265797.341. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context Switching2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20M40M60M80M100M29340312.9635280554.4235971998.9817931974.92110432440.32110991931.601. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shuffle2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30K60K90K120K150K52591.7752511.0752548.2525006.73154267.34154293.331. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5010015020025070.9070.8270.2136.38220.91222.86

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400m2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020054.5968.6853.7833.50202.34201.59MIN: 50.39 / MAX: 663.91MIN: 53.81 / MAX: 3458.69MIN: 53.02 / MAX: 60.41MIN: 33.26 / MAX: 37.92MIN: 187.7 / MAX: 1161.84MIN: 191.08 / MAX: 1525.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Point2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh15K30K45K60K75K24103.7624129.6224101.4011939.4171782.9571790.061. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stress2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh110K220K330K440K550K176344.38176710.85176621.2788466.54523898.45518600.851. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Call2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30K60K90K120K150K54824.5854675.8554852.0627731.16156381.63158994.251. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Math2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh200K400K600K800K1000K314789.68314753.85315324.18173878.70989553.80990104.851. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Point2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh130K260K390K520K650K198651.88198610.93198855.75106715.85604724.84605340.531. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Add2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh40M80M120M160M200M58550931.3958570424.4158491170.7532151217.03180789739.08181626937.851. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlib2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4K8K12K16K20K5876.155875.455885.262944.5416624.0716625.571. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh3K6K9K12K15K5651.575618.595626.772661.2314854.8613153.50

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2040608010051.8651.9952.7794.8817.3117.12

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Math2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh300K600K900K1200K1500K430109.26430096.55430141.54234239.601288008.261285121.401. (CXX) g++ options: -O2 -std=gnu99 -lc

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30609012015063.3763.7163.45122.7022.4022.35

Stress-NG

Test: AVX-512 VNNI

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNI2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4M8M12M16M20M6626091.936621974.986624476.363667964.1520133541.1120123210.141. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copying2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh16K32K48K64K80K26146.7126129.5026144.8013428.6472825.5672800.741. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Math2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2M4M6M8M10M2804498.362802578.872802185.771543291.918237581.378234456.231. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sorting2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh100020003000400050001675.931676.271674.65916.744846.224850.991. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Malloc2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh160M320M480M640M800M262321226.78263330738.63263438850.64137476652.93719479964.33725705488.151. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functions2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50M100M150M200M250M72167140.0372810418.7177814243.7640991307.95215429087.61215308424.811. (CXX) g++ options: -O2 -std=gnu99 -lc

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh80160240320400201.53201.93201.51372.7271.9771.39

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh91827364520.6520.4320.5137.937.517.40

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445517.4357017.2789017.330709.8131849.5123050.08790

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragon2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5010015020025075.2875.1275.4642.76217.59207.25MIN: 73.5 / MAX: 78.24MIN: 73.42 / MAX: 78.19MIN: 73.59 / MAX: 78.22MIN: 42.48 / MAX: 43.18MIN: 211.81 / MAX: 228.26MIN: 203.29 / MAX: 214.14

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragon Obj2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020067.4866.8567.3237.99193.05172.21MIN: 65.8 / MAX: 70.02MIN: 65.41 / MAX: 70.72MIN: 65.8 / MAX: 70.31MIN: 37.71 / MAX: 38.4MIN: 174.03 / MAX: 205.21MIN: 150.53 / MAX: 183.32

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445517.8117.8317.7610.0850.4050.96

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh120240360480600204.41204.22204.35106.15497.90532.46

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Crown2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020069.4969.4969.6737.68183.40187.42MIN: 65.97 / MAX: 75.27MIN: 65.87 / MAX: 75.16MIN: 66.25 / MAX: 75.27MIN: 37.26 / MAX: 39.44MIN: 179.05 / MAX: 191.46MIN: 183.21 / MAX: 193.83

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5010015020025086.7986.5686.5348.47239.42225.83MIN: 83.33 / MAX: 93.39MIN: 83.15 / MAX: 93.4MIN: 83.4 / MAX: 92.47MIN: 48.1 / MAX: 49.28MIN: 232.82 / MAX: 253.03MIN: 221.04 / MAX: 232.51

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Crown2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020072.6572.1772.6439.38193.60194.27MIN: 68.96 / MAX: 77.69MIN: 68.85 / MAX: 77.58MIN: 69.23 / MAX: 79.15MIN: 38.86 / MAX: 40.97MIN: 188.25 / MAX: 201.2MIN: 188.82 / MAX: 203.12

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Poll2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh5M10M15M20M25M9104744.159078474.019067852.194337787.7221346079.3020251576.331. (CXX) g++ options: -O2 -std=gnu99 -lc

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445526.4326.3726.1548.9510.0210.02

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazeface2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh6121824307.208.398.155.6326.9023.63MIN: 7.05 / MAX: 7.44MIN: 8.09 / MAX: 17.41MIN: 7.89 / MAX: 14.8MIN: 5.53 / MAX: 5.95MIN: 21.88 / MAX: 899.43MIN: 21.98 / MAX: 379.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon Obj2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh408012016020072.2672.8572.7740.57193.43184.45MIN: 69.72 / MAX: 77.54MIN: 70.3 / MAX: 76.96MIN: 70.2 / MAX: 78.62MIN: 40.28 / MAX: 41.19MIN: 170.24 / MAX: 203.63MIN: 159.04 / MAX: 199.2

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILE2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh800K1600K2400K3200K4000K1312330.441536517.651465208.81857324.893761786.293745995.161. (CXX) g++ options: -O2 -std=gnu99 -lc

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445520.4020.3920.4510.8646.6646.76

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445520.3320.3120.4010.8546.6146.55

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Crypto2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh100K200K300K400K500K156553.51156863.78156859.22107643.49462528.73461785.361. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v22 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526518.6318.4718.3513.9657.6745.22MIN: 18.34 / MAX: 19.34MIN: 18.09 / MAX: 20.53MIN: 17.76 / MAX: 24.49MIN: 13.65 / MAX: 18.71MIN: 40.74 / MAX: 1797.58MIN: 40.32 / MAX: 296.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Forking2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh7K14K21K28K35K1641.771616.051615.001007.4631064.9530591.671. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Tree2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30060090012001500788.21797.64793.08410.891564.421628.911. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cache2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh200K400K600K800K1000K1095211.771096840.321135334.90776708.72334039.11361173.711. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAP2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh80016002400320040002289.802287.692299.281131.553664.343749.471. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b02 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445519.7919.9619.9214.7647.6748.76MIN: 18.88 / MAX: 151.97MIN: 19.55 / MAX: 33.09MIN: 19.72 / MAX: 21.08MIN: 14.47 / MAX: 29.12MIN: 47.05 / MAX: 112.46MIN: 47.17 / MAX: 210.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v32 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh91827364514.8715.8715.1811.6435.9637.56MIN: 14.55 / MAX: 15.42MIN: 15.57 / MAX: 16.37MIN: 14.82 / MAX: 21.88MIN: 11.48 / MAX: 15.48MIN: 34.15 / MAX: 266.64MIN: 33.74 / MAX: 351.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMA2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh102030405042.3342.1041.4918.3514.3814.461. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283513.7414.2413.6910.7029.9229.55MIN: 13.14 / MAX: 22.9MIN: 13.93 / MAX: 14.54MIN: 13.25 / MAX: 14.74MIN: 10.22 / MAX: 14.66MIN: 27.82 / MAX: 234.43MIN: 28.64 / MAX: 97.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v22 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283513.9415.0214.0211.2931.2430.89MIN: 13.14 / MAX: 22.71MIN: 14.05 / MAX: 103.51MIN: 13.46 / MAX: 22.99MIN: 10.83 / MAX: 11.91MIN: 30.27 / MAX: 71.7MIN: 29.59 / MAX: 58.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh102030405016.4421.5022.2916.0044.2742.30MIN: 16.09 / MAX: 32.24MIN: 20.83 / MAX: 30.28MIN: 21.86 / MAX: 23.6MIN: 15.86 / MAX: 20.49MIN: 40.55 / MAX: 822.5MIN: 41.82 / MAX: 83.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh481216208.93248.94378.938014.74545.46615.4481

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200111.85111.70111.7867.77182.64183.24

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh481216208.88648.88968.872514.66325.44785.4268

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200112.47112.43112.6568.16183.37184.09

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh0.79431.58862.38293.17723.97152.212.192.201.363.403.53

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh0.77851.5572.33553.1143.89252.212.212.201.373.283.46

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssd2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526525.5134.9928.4724.2258.6658.41MIN: 23.43 / MAX: 95.27MIN: 28.93 / MAX: 1349.8MIN: 28.05 / MAX: 34.83MIN: 23.8 / MAX: 28.97MIN: 55.23 / MAX: 333.73MIN: 57.55 / MAX: 98.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283520.3420.3320.3911.9028.3528.25

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh0.34650.6931.03951.3861.73251.041.041.030.651.501.54

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648044.3044.3644.7571.3530.2230.37

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh81624324022.5722.5422.3414.0133.0832.92

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648044.7444.6644.6371.8431.4530.72

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh81624324022.3522.3922.4013.9231.7932.54

Dragonflydb

Clients Per Thread: 20 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 20 - Set To Get Ratio: 1:1002 x AMD EPYC 9334 32-Core93334 rep9334 2pd7M14M21M28M35M31139658.4929280070.9729330317.3414250093.711. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 10 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 10 - Set To Get Ratio: 1:1002 x AMD EPYC 9334 32-Core93334 rep9334 2pd6M12M18M24M30M25802999.0324588214.8122585212.5611860591.651. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet182 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283515.1616.2217.4913.6529.2629.56MIN: 14.45 / MAX: 22.73MIN: 15.17 / MAX: 57.27MIN: 16.57 / MAX: 24.11MIN: 13.29 / MAX: 15.11MIN: 26.62 / MAX: 124.57MIN: 27.99 / MAX: 114.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh481216209.3910.5910.708.1315.1017.39MIN: 9 / MAX: 9.79MIN: 9.51 / MAX: 107.87MIN: 10.12 / MAX: 12.2MIN: 7.95 / MAX: 8.44MIN: 14.22 / MAX: 74.43MIN: 14.86 / MAX: 374.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2468103.55913.53473.59224.93177.38317.4589

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60120180240300280.78282.72278.18202.50135.40134.02

Dragonflydb

Clients Per Thread: 10 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 10 - Set To Get Ratio: 1:102 x AMD EPYC 9334 32-Core93334 rep9334 2pd5M10M15M20M25M22176931.9823645213.1324460221.4811686474.261. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh91827364526.5126.4826.4840.7320.6019.74

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445537.7037.7437.7424.5448.5050.60

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg162 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526536.6542.0836.9028.5756.3458.85MIN: 33.43 / MAX: 47.15MIN: 36.25 / MAX: 590.93MIN: 34.81 / MAX: 49.99MIN: 27.98 / MAX: 32.46MIN: 50.98 / MAX: 172.01MIN: 55.68 / MAX: 98.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet502 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh122436486029.6241.0230.6026.5353.6254.47MIN: 27.91 / MAX: 147.23MIN: 30.92 / MAX: 2215.16MIN: 30.17 / MAX: 37.09MIN: 26.13 / MAX: 30.95MIN: 51.72 / MAX: 288.16MIN: 51.64 / MAX: 145.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Dragonflydb

Clients Per Thread: 20 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 20 - Set To Get Ratio: 1:102 x AMD EPYC 9334 32-Core93334 rep9334 2pd7M14M21M28M35M31053489.2429580028.0628043162.3015179164.861. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh102030405021.8027.9527.4123.5541.2144.14MIN: 21.41 / MAX: 29.57MIN: 27.34 / MAX: 34.73MIN: 26.74 / MAX: 33.85MIN: 23.18 / MAX: 27.8MIN: 40.54 / MAX: 69.23MIN: 42.79 / MAX: 118.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformer2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2040608010053.7961.2466.6555.05108.7393.15MIN: 52.29 / MAX: 122.53MIN: 59.18 / MAX: 264.24MIN: 59.07 / MAX: 626.24MIN: 54.24 / MAX: 72.37MIN: 94.5 / MAX: 1869.82MIN: 88.26 / MAX: 206.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket Activity2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20K40K60K80K100K38147.9738727.8637674.679504.38110254.19113347.771. (CXX) g++ options: -O2 -std=gnu99 -lc

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metric2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh1.4M2.8M4.2M5.6M7M1012537999893994371544648639840462705771. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFD2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20040060080010001004.791009.471014.24912.6297.94115.831. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenet2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526531.0333.6833.4029.0357.7255.36MIN: 30.4 / MAX: 40.18MIN: 32.93 / MAX: 40.38MIN: 32.92 / MAX: 35.55MIN: 27.97 / MAX: 36.49MIN: 52.79 / MAX: 429.12MIN: 54.42 / MAX: 115.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh0.37110.74221.11331.48441.85550.87110.87040.86771.11891.64921.6419

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20040060080010001144.311145.231149.13890.94605.47608.16

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh481216207.53798.13477.748411.086813.847312.8286

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh306090120150132.50122.79128.9190.0872.1877.92

SPECFEM3D

Model: Layered Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Layered Halfspace2 x AMD EPYC 9334 32-Core93334 rep9334 2pd91827364521.6721.6921.5438.491. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

SPECFEM3D

Model: Mount St. Helens

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Mount St. Helens2 x AMD EPYC 9334 32-Core93334 rep9334 2pd481216208.4554735348.4869105208.32009185614.5056452531. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh36912155.64625.67735.66935.99478.58439.6974

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60120180240300156.06156.19156.28150.28256.16239.19

SPECFEM3D

Model: Water-layered Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Water-layered Halfspace2 x AMD EPYC 9334 32-Core93334 rep9334 2pd81624324021.3921.1520.8634.821. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2468105.39725.28625.30287.14568.73878.6016

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200185.02188.92188.32139.79114.38116.19

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Futex2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh1000K2000K3000K4000K5000K4717570.364752131.374644551.294022496.072951631.962880825.111. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh132639526537.1437.5737.3058.8342.0435.85

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh71421283526.9226.6126.8117.0023.7827.88

SPECFEM3D

Model: Homogeneous Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Homogeneous Halfspace2 x AMD EPYC 9334 32-Core93334 rep9334 2pd51015202511.6211.5311.6418.851. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh4080120160200127.14152.58155.11203.01197.031. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SPECFEM3D

Model: Tomographic Model

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Tomographic Model2 x AMD EPYC 9334 32-Core93334 rep9334 2pd481216209.4871457819.3745630829.41908663514.8777103461. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh51015202513.3113.3813.3020.7115.0214.56

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2040608010075.1074.6875.1548.2566.5268.61

Remhos

Test: Sample Remap Example

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap Example2 x AMD EPYC 9334 32-Core93334 rep9334 2pd51015202513.5113.8313.9620.901. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfig2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh81624324024.7424.7824.6735.2823.0623.05

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2468104.80904.79574.71597.11027.20267.1792

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50100150200250207.72208.31211.81140.46138.76139.21

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2468104.80284.82054.79427.12287.21117.1163

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50100150200250207.99207.23208.34140.20138.59140.44

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh160M320M480M640M800M7542100007531200007559700005046600006591400006528200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Laghos

Test: Sedov Blast Wave, ube_922_hex.mesh

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Sedov Blast Wave, ube_922_hex.mesh2 x AMD EPYC 9334 32-Core93334 rep9334 2pd80160240320400389.86387.15388.87263.851. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Math2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh3K6K9K12K15K14005.2914009.2314022.5010869.4914658.7515802.861. (CXX) g++ options: -O2 -std=gnu99 -lc

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writes2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60K120K180K240K300K255016268984258638230402185134190955

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh130260390520650416.17517.44560.79599.57600.761. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershaw2 x AMD EPYC 9334 32-Core93334 rep9334 2pd2000M4000M6000M8000M10000M809563000081309500008147120000115209000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tiny2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445534.6343.5940.1935.7548.0848.82MIN: 32.71 / MAX: 43.98MIN: 35.28 / MAX: 640.68MIN: 39.2 / MAX: 49.85MIN: 34.32 / MAX: 45.5MIN: 42.94 / MAX: 393.57MIN: 45.36 / MAX: 93.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh51015202515.0215.0815.0919.6414.4213.97

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648066.5466.2766.2550.9169.3371.57

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodic2 x AMD EPYC 9334 32-Core93334 rep9334 2pd1600M3200M4800M6400M8000M54411000005437240000542603000074704900001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passing2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2M4M6M8M10M9268236.409251814.099258853.696851573.207729966.177761412.611. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh36912158.00987.99928.013610.08138.03027.6734

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh306090120150124.72124.90124.6799.12124.41130.19

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh120240360480600448.73448.89451.05436.97573.36567.86

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh16M32M48M64M80M7259700072532000724800006883400055708000559230001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_time2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50100150200250204.93208.86209.61176.61161.17160.87

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 4 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4812162016.2016.6816.3014.9713.5812.911. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20M40M60M80M100M1113200008624800011133000010563000088109000880420001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed Scheduler2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh8K16K24K32K40K37887.1437534.0037702.2235640.3629932.2029481.451. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthread2 x AMD EPYC 9334 32-Core9334 2pdgh15K30K45K60K75K70405.4770476.9770043.7854906.4355328.711. (CXX) g++ options: -O2 -std=gnu99 -lc

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh11M22M33M44M55M5231500051821000524690004988400041641000410520001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh8M16M24M32M40M3717000037183000371260003519500029219000292000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60M120M180M240M300M2887300002903200002884300002717300002285200002280900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh200M400M600M800M1000M11581000001159500000115870000010738000009145700009118700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh20M40M60M80M100M1043100001022700001051700009644900083090000827490001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh120M240M360M480M600M5755100005809200005795100005493900004578200004574200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh40M80M120M160M200M2086300002093700002078100001955100001651800001653900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30M60M90M120M150M1442100001438300001448000001365000001145500001143900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh12M24M36M48M60M5415500055882000556240005276500044187000441830001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh3M6M9M12M15M1320700013320000133570001265200010576000105670001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh500M1000M1500M2000M2500M2247200000219430000022316000001778600000207660000020720000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh6M12M18M24M30M2570600026081000258850002490000020660000208370001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 5122 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh90M180M270M360M450M4139700004152000004140600003874600003312400003292100001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutex2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh100K200K300K400K500K457807.79457061.39456942.16438280.16364035.57363892.101. (CXX) g++ options: -O2 -std=gnu99 -lc

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 322 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh500M1000M1500M2000M2500M2284700000229170000022913000002045600000182760000018221000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh369121512.06012.25012.3589.8319.9011. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Atomic2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh60120180240300253.60254.23254.16236.99204.44203.491. (CXX) g++ options: -O2 -std=gnu99 -lc

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh70M140M210M280M350M3462600003291800003363200003312000002798400002772500001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2004006008001000776.91779.83779.18794.04969.24952.87

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh140M280M420M560M700M6585800006565100006743300006504100005423000005466900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2004006008001000780.60782.00781.54795.85969.88954.94

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 12 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200163.44161.05160.63199.52189.16194.861. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh40M80M120M160M200M1853900001866700001853600001742800001510100001553600001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 572 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh300M600M900M1200M1500M1293000000130240000012750000001234500000105730000010650000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 4 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh1.27132.54263.81395.08526.35655.5995.6505.6435.0534.6154.5931. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 13 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200162.86160.08163.43195.83191.67177.361. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh1.13182.26363.39544.52725.6594.9145.0305.0124.1244.2041. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200137.91137.97137.48140.58167.42166.76

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh4080120160200136.60136.81136.46139.61165.51164.66

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh50100150200250188.74189.33189.52186.65224.65223.85

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh30609012015095.7495.6095.5494.62113.02113.20

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh122436486044.4944.6844.4144.9153.1252.58

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh112233445541.3141.1041.0242.8348.8848.51

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh160320480640800635.64635.20635.65641.61756.62751.72

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh4080120160200158.71161.67159.26179.41187.681. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh61218243021.0021.0021.0321.0924.7924.68

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 12 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh110220330440550442.55416.15442.44419.85490.15485.591. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648061.4661.4961.2261.8171.8271.54

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh163248648061.4961.4561.2562.1071.7671.58

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh110220330440550462.33443.32458.52511.80507.021. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 13 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh130260390520650562.31593.63520.17545.20600.23581.071. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh306090120150142.19137.61140.17125.22124.701. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 8 - Input: Bosphorus 1080p2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh306090120150149.11148.85150.35136.07134.88134.381. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fast2 x AMD EPYC 9334 32-Core93334 rep9334 2pd2468107.3977.3587.4476.7681. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fast2 x AMD EPYC 9334 32-Core93334 rep9334 2pd51015202520.7321.0120.8819.171. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Stress-NG

Test: Cloning

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cloning2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh300600900120015001245.211188.641190.001170.311139.871209.531. (CXX) g++ options: -O2 -std=gnu99 -lc

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Faster2 x AMD EPYC 9334 32-Core93334 rep9334 2pd4812162013.7313.8013.6812.681. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Faster2 x AMD EPYC 9334 32-Core93334 rep9334 2pd81624324036.0334.7635.5833.571. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pgh2040608010089.9194.7396.1192.6494.831. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.6Encoder Mode: Preset 8 - Input: Bosphorus 4K2 x AMD EPYC 9334 32-Core93334 rep9334 2pdgh2040608010077.2277.1976.5072.3575.1573.251. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Kripke

OpenBenchmarking.orgThroughput FoM, More Is BetterKripke 1.2.62 x AMD EPYC 9334 32-Core93334 rep9334 2pd80M160M240M320M400M3915674003757155003932765003720720001. (CXX) g++ options: -O3 -fopenmp -ldl

Laghos

Test: Triple Point Problem

OpenBenchmarking.orgMajor Kernels Total Rate, More Is BetterLaghos 3.1Test: Triple Point Problem2 x AMD EPYC 9334 32-Core93334 rep9334 2pd4080120160200198.94197.19199.20195.401. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Dragonflydb

Clients Per Thread: 50 - Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 50 - Set To Get Ratio: 1:100d4M8M12M16M20M17583489.381. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients Per Thread: 50 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 1.6.2Clients Per Thread: 50 - Set To Get Ratio: 1:10d3M6M9M12M15M15253621.531. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre


Phoronix Test Suite v10.8.5