extra tests2

AMD EPYC 9334 32-Core testing with a Supermicro H13SSW (1.1 BIOS) and astdrmfb on AlmaLinux 9.2 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2310249-NE-EXTRATEST98&grs.

extra tests2ProcessorMotherboardMemoryDiskGraphicsMonitorOSKernelCompilerFile-SystemScreen Resolutionabcdefghij2 x AMD EPYC 9254 24-Core @ 2.90GHz (48 Cores / 96 Threads)Supermicro H13DSH (1.5 BIOS)24 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07astdrmfbAlmaLinux 9.25.14.0-284.25.1.el9_2.x86_64 (x86_64)GCC 11.3.1 20221121ext41024x768AMD EPYC 9124 16-Core @ 3.00GHz (16 Cores / 32 Threads)Supermicro H13SSW (1.1 BIOS)12 x 64 GB DDR5-4800MT/s HMCG94MEBRA123NAMD EPYC 9334 32-Core @ 2.70GHz (32 Cores / 64 Threads)DELL E207WFP1680x1050OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details- a: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- b: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- c: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- d: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- e: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- f: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- g: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- h: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- i: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- j: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Details- OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Details- Python 3.9.16Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

extra tests2hadoop: File Status - 50 - 1000000hadoop: Open - 100 - 1000000hadoop: Open - 50 - 1000000deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamopenvino: Handwritten English Recognition FP16-INT8 - CPUdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamonednn: IP Shapes 1D - u8s8f32 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamopenvino: Handwritten English Recognition FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeopenvino: Weld Porosity Detection FP16 - CPUdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamliquid-dsp: 96 - 256 - 32deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamopenvino: Face Detection FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamblender: Pabellon Barcelona - CPU-Onlyopenvino: Face Detection Retail FP16-INT8 - CPUblender: Classroom - CPU-Onlyblender: BMW27 - CPU-Onlyopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUblender: Fishy Cat - CPU-Onlyopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Person Detection FP32 - CPUspecfem3d: Layered Halfspaceopenvino: Person Detection FP16 - CPUblender: Barbershop - CPU-Onlydeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streambrl-cad: VGR Performance Metricembree: Pathtracer - Crownopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Vehicle Detection FP16 - CPUoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyospray: gravity_spheres_volume/dim_512/scivis/real_timeoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyospray: gravity_spheres_volume/dim_512/ao/real_timeembree: Pathtracer ISPC - Crownspecfem3d: Mount St. Helensliquid-dsp: 96 - 256 - 512ospray: gravity_spheres_volume/dim_512/pathtracer/real_timespecfem3d: Homogeneous Halfspaceopenvino: Vehicle Detection FP16-INT8 - CPUembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objopenvino: Person Vehicle Bike Detection FP16 - CPUembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Asian Dragonhadoop: File Status - 50 - 100000specfem3d: Water-layered Halfspaceopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUspecfem3d: Tomographic Modelliquid-dsp: 96 - 256 - 57openvino: Road Segmentation ADAS FP16 - CPUliquid-dsp: 64 - 256 - 512onednn: IP Shapes 1D - bf16bf16bf16 - CPUliquid-dsp: 64 - 256 - 32openvino: Face Detection FP16 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUembree: Pathtracer ISPC - Crownonednn: IP Shapes 3D - u8s8f32 - CPUbuild-linux-kernel: defconfigembree: Pathtracer - Crownhadoop: File Status - 100 - 1000000openvino: Face Detection FP16-INT8 - CPUembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer - Asian Dragon Objembree: Pathtracer - Asian Dragonopenvino: Person Detection FP16 - CPUembree: Pathtracer ISPC - Asian Dragononednn: Deconvolution Batch shapes_3d - f32 - CPUopenvino: Person Detection FP32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyopenvkl: vklBenchmarkCPU Scalaroidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyopenvkl: vklBenchmarkCPU ISPCremhos: Sample Remap Examplehadoop: Open - 100 - 100000onednn: Convolution Batch Shapes Auto - f32 - CPUhadoop: File Status - 100 - 100000onednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUliquid-dsp: 64 - 256 - 57onednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUtidb: oltp_read_write - 64tidb: oltp_read_write - 128hadoop: Create - 100 - 100000onednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUhadoop: Create - 100 - 1000000onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUcassandra: Writesonednn: IP Shapes 3D - bf16bf16bf16 - CPUopenvino: Face Detection Retail FP16 - CPUtidb: oltp_read_write - 32hadoop: Open - 50 - 100000openvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUtidb: oltp_update_non_index - 128liquid-dsp: 32 - 256 - 512openvino: Road Segmentation ADAS FP16 - CPUtidb: oltp_point_select - 64onednn: IP Shapes 1D - f32 - CPUtidb: oltp_point_select - 128onednn: Recurrent Neural Network Inference - u8s8f32 - CPUtidb: oltp_update_non_index - 64tidb: oltp_update_index - 128onednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUkripke: easywave: e2Asean Grid + BengkuluSept2007 Source - 1200tidb: oltp_update_index - 64onednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUsvt-av1: Preset 8 - Bosphorus 4Khadoop: Create - 50 - 100000easywave: e2Asean Grid + BengkuluSept2007 Source - 2400hadoop: Delete - 100 - 100000svt-av1: Preset 12 - Bosphorus 4Ktidb: oltp_point_select - 32svt-av1: Preset 13 - Bosphorus 1080ptidb: oltp_update_index - 32tidb: oltp_point_select - 1svt-av1: Preset 13 - Bosphorus 4Kospray: particle_volume/pathtracer/real_timetidb: oltp_update_non_index - 1hadoop: Create - 50 - 1000000hadoop: Delete - 50 - 100000tidb: oltp_read_write - 1tidb: oltp_update_index - 1svt-av1: Preset 12 - Bosphorus 1080ponednn: IP Shapes 3D - f32 - CPUtidb: oltp_update_non_index - 32liquid-dsp: 32 - 256 - 57tidb: oltp_update_index - 16tidb: oltp_point_select - 16easywave: e2Asean Grid + BengkuluSept2007 Source - 240hadoop: Delete - 100 - 1000000tidb: oltp_read_write - 16tidb: oltp_update_non_index - 16hadoop: Rename - 100 - 1000000hadoop: Rename - 50 - 100000svt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 4 - Bosphorus 4Khadoop: Delete - 50 - 1000000hadoop: Rename - 100 - 100000liquid-dsp: 2 - 256 - 512hadoop: Rename - 50 - 1000000nekrs: Kershawnekrs: TurboPipe Periodicsvt-av1: Preset 4 - Bosphorus 1080pliquid-dsp: 1 - 256 - 512liquid-dsp: 1 - 256 - 57deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamliquid-dsp: 2 - 256 - 32liquid-dsp: 32 - 256 - 32liquid-dsp: 8 - 256 - 512liquid-dsp: 2 - 256 - 57liquid-dsp: 4 - 256 - 512liquid-dsp: 1 - 256 - 32liquid-dsp: 16 - 256 - 512liquid-dsp: 8 - 256 - 32liquid-dsp: 16 - 256 - 32liquid-dsp: 4 - 256 - 32openvino: Age Gender Recognition Retail 0013 FP16 - CPUliquid-dsp: 16 - 256 - 57openvino: Handwritten English Recognition FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamliquid-dsp: 8 - 256 - 57openvino: Face Detection Retail FP16-INT8 - CPUdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16-INT8 - CPUliquid-dsp: 4 - 256 - 57openvino: Handwritten English Recognition FP16 - CPUdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamquantlib: Multi-Threadedquantlib: Single-Threadeddeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamopenradioss: Bumper Beamabcdefghij217391321533211261265137.01141244.6949.325839.4951218.146439.4391489.1203485.6725215.6383718.9189158.924322.25051560.0330.415776.9415.98615.95282945.26201.3925300580000068.598856.011417.070680.549837.5866.4226.2120606.3833.2286884.64283.9726.885983804282.55254.88672.463577216254.9017317.222033.170.861.8413.87391.8314.236956.087111.02476577571164000016.346815.105117732873.2460.144953.57332454.0956.485367.337852910126.9850209085882.91842.9112.3129466522559800000748.446225600002207700000393.627.3541886792213.9442.4442.2416.34642016851546419944000005.8937.87909085757407334.17461452480952.035897446082914.234.885110542581000016.02127567159242412812708790.8114364987566163.459104627510.361183614331163.013215.0961328536659107525401212422.994287351192100000125589011438331180957307870522141.2195.2039893275529279010007323911106900000676771000012.477139090005940100035.62877181000118350000010987000011749000052911000394990002160800003075400005942300001538500000.5469974000038.516.90743694300004.864.6508347.66128.2819622000030.72118.750916.26150.5897485.71750.3433.341274.3211605.0388605.75849.3653109.802749.0092111.0131194174817382210204085138.83411239.6749.166639.4681219.526339.4539489.4464488.1264215.9254717.9693159.0596321.18291546.0230.445780.4415.978515.98882986.46201.2528299540000068.661756.061403.06580.769849.0766.6426.24120728.2233.1787359.23284.9928.65210863284.22255.3672.373476851755.3925317.282028.010.861.8413.76661.8314.178356.455111.31849570971814000016.436514.460586982880.5859.912453.81352450.2656.690267.195186206929.4607611975836.27854.5112.1005959472571100000750.496109500002212100000393.2327.241161970213.6242.242.0916.79140485845871620019000005.9137.798018389099374254.16444372566612.056152046948414.034.8942962000015.9813080215972839759274642437191.3224128890827166.378106180542.611178174405166.692214.074131252119738012510427.686289141214200000675158671536950180687212973046138.3385.1499731469348277360007167911240300000675736000012.591140210005929600035.642277019000119030000010808000011401000055588000394860002161500003051100006024700001536900000.5469276000038.6617.06693669300004.854.6476347.21898.2719659000031118.948216.02150.6055487.35990.3433.379874.5553605.7307606.669349.1082109.233248.9703110.91522842521858746839955153.66441237.2947.153539.4464218.516239.4183487.0522489.1106215.647716.1404164.6131321.50821551.6330.435802.6515.987215.97782987.33201.5402299980000068.628756.021418.904180.419845.2766.7226.12123484.2833.0386789.8284.3127.490850157282.67254.72671.255476252955.4037317.332029.790.871.8213.83171.8314.139956.807811.3273597771503000016.53514.8082733652881.1459.792953.69272455.5156.932767.503865789527.0602350795840.53849.312.0409178772564900000757.386226300002206800000393.3727.4081893939213.7942.4342.1916.24340322672992720103000005.937.7978469350754.16440012704802.055963040160614.124.885286542440000015.8314996239106265462332490.4174393773475163.055516.906175654471161.495214.1361381522609058024851189431.8951254800000126816540697031373686682777101143.5455.0499014767159282270007463810826700000675417000012.617142250005751900035.682576924000118480000010914000011855000055165000394530002149100003067600006036500001536700000.5467493000038.7516.88633669900004.864.6348347.37288.2419451000030.89118.780116.02145.2562507.47860.3433.463774.5031605.9183605.876549.0173109.584749.2055111.025181818212484392783191599.2079395.6616.164813.069472.45513.1312163.5559162.850271.9189240.55290.65225955.6132108.909532.5910.472013.775.574695.570011039.6171.137106520000024.483320.03508.087224.153540.88182.997244958.0790.0332002.62106.971.614294327107.02670.87257.272829806421.4811124.12797.640.340.725.453290.725.6074722.58526.7364141182862500006.5874535.5716849081175.6724.687222.26141036.9923.873328.364363291162.4417495852564.78370.5727.3309855881120800000344.672829200001.037491059500000761.591.5582422.39220.6039555.17321.8943600601398.5223.353122.351724.84574.7127.74383.3778274.810.8478050.720.341910.7248730.7615291012.133325917161.9137410933000001.3378910.0164.415533459727579713.059916.79712961643.991641.921642.511978661.028753.114697757803521.577.727376000023.21156752.49408129492849.16334224838.516847.3824099450038.105211080.62823666.9885861798.98105708163.18998149604.986176125898161.854151.9051693721341010101479526.2161.25758262731035000000126221.65711261336480185638120882372118.9464.10711101282102246270008392110318900000793457000010.91126830005266500031.05256705400010471000009959400010565000050258000352280001938500002780300005453600001386000000.4968915000040.415.72463633100004.514.996325.87637.9318893000030.02112.249915.363.81576143.7643493.5960.3533.224273.3058606.101606.577349.0863110.111448.8729111.108132092412048192510041599.1543432.3216.139212.943372.657113.1187162.9298163.136171.9146240.23490.6576155.4634109.0938530.9910.472007.535.541075.563531039.8271.2727106510000024.472520511.4098224.13544.18182.5671.4444933.2790.3132032.06107.2470.189028506107.27670.64257.89429612521.4357123.61793.750.340.725.461530.725.620422.569426.7991434462858800006.582735.0301348891174.624.734322.15771028.6423.939328.314138910562.3251468282562.54373.6427.4598213081117800000342.812818300001.144321057500000761.161.5491122.34220.57579455.09321.9909235627398.9123.528322.291124.828274.527.82933.3843674.540.8444340.720.341900.7248730.8452949852.12576134971.9178110954000001.3386110.0664.685389360145588243.06376.8700571643.9716411639.361957981.054253.114673755248621.47.774213827348000023.321186572.56522129904851.6593388124611849.712841.07823624390038.067212710.63397567.7215861799.41598039162.60896907597.011171175976162.051151.50617087089710060432091490525.1731.2804326285103200000012567702501.65411322536784185578436082237119.3074.11411332783822252070008404110264000000793101000010.984123660005282700030.98676884600010466000009700500010548000050380000353150001960400002777800005451400001386200000.4969292000036.9815.62453579900004.514.9859325.74167.9619123000030.1112.057415.363.84421144.1013494.25750.3533.262573.2609607.913606.75549.0094109.965449.0598111.08881795332130378112210011600.5275431.9416.130713.085372.573613.0934162.8976162.929471.9401240.16420.65318255.5428109.09533.7410.482004.765.57325.555811038.4771.044106530000024.523820.01508.2088223.953548.78181.771.9644968.4390.2631951.64106.7670.542255905107.39667.87257.504629560321.5913124.3791.740.340.725.452270.725.6145422.656626.8731684552859200006.5956335.5350730011180.8524.704722.1491041.8723.935428.323770922061.2817691242539.97369.2626.9737573951120500000343.492830300001.001361057100000760.571.5728222.44070.60083455.14821.77461964637399.2423.504222.267624.88774.4327.8263.3795674.870.8506910.720.341910.7248830.7255235602.130624784691.9142210946000001.3418310.0964.315495660310593823.056746.76705371642.351636.761636.441962871.061443.144714157803521.657.674142427339000023.281190922.49714130389849.3443447024830851.494845.30823659100038.015210670.63032567.3935834397.98799404161.84797368585.3685954160.798151.781697699209699332181483521.5181.2065326695102460000012692701051.657110803361258581581633118.4864.1381111987949125199000825019976450000795579000010.736126810005287900031.02926886100010419000009944100010574000049977000352710001945000002763900005450200001385800000.4969334000037.0115.7213504500004.54.9877324.95687.9718988000029.95112.41315.383.81823143.6922494.22110.3533.275173.2163607.8171606.785249.0712110.000149.0714110.8852203666011074206540221602.5221432.216.067213.07372.687913.0596163.2282162.993771.9003239.51760.647755.4264109.2191538.0110.482006.095.575535.565391039.3770.9275106570000024.460720.05509.139224.123533.64183.2972.0145097.9990.6332008.03107.2469.955609165107.04669.09257.280829552221.5847123.41793.90.340.725.477250.725.6227822.774527.6966313712865300006.6008535.3786000211175.5824.819322.19011031.623.879628.479356179862.8109243762557.66372.2627.7464751621118200000341.362817300001.127231056200000759.921.5511822.42150.6123255.17221.83052049180398.1323.709122.255924.961974.7127.913.3815674.580.8434920.720.341910.7248930.754608292.118134878051.9127410993000001.3356410.0664.775530159944589283.054586.79709221641.41637.371631.991970921.045673.124699354644821.477.744169527407000023.421185492.51441837.5953410724574848.032847.41723717570037.950.62910867.8116068097.529102564160.32296840586.74817135161.324151.68117057270610395031951481528.5331.27918103340000012627699231.64811389536088187358576382237118.4814.14311082880386227270008481010500600000796491000011.016122560005285400031.057468678000104710000010017000010480000049556000352360001946700002774100005430500001384600000.4968207000036.9815.68923578100004.524.9787325.50757.9619075000029.72112.477915.373.82381144.1053495.60330.3533.367473.1867607.1628608.716349.0259109.903748.9837110.975942643932372912330463324.8182810.7132.004225.7096145.477825.7916326.9271327.0192144.1181488.06480.892701109.0251216.23841034.3519.823780.810.798810.78321963.9136.9614206830000047.132337.821003.5171119.36653.8699.5438.468931.3549.159615.88196.0740.329363428197.94352.4507.63457250042.8932234.181481.710.651.3810.59131.3710.852445.475715.03269371151970000012.543819.9615193482252.748.118843.50562180.8346.378554.388892592636.4458715834803.65710.6915.9894919481995500000643.85120200002.09882057500000804.580.77854345.190.3024633.94543.57212352941421.845.923443.844648.906880.7754.22031.7338181.580.4400061.380.653631.3792620.4425263161.147495952381.04119168000000.73446110.7868.2795579104180604961.78177.0973611987.837986.958993.5643245750.704553.327548664516122.57.336581639168000024.841.74203200327568.7475119137126564.12568.64935480800026.106313320.42642699.0995872068.573105263230.026138538726.889242866125223.416192.64518617341110040234801666580.1630.92628336041135290000016965872181.28411178247576237948431083056151.4375.0751134047980825648000851219145900000676127000012.23129090005144300031.489672468000117240000010444000010528000052890000371450002075900002926200005858500001458200000.5374142000039.4415.92493783300004.84.8005337.95688.4620093000030.92116.506416.273.72247146.1191495.22370.3532.752673.8802613.0546613.163948.8812109.792248.8889116781.53357.9110.810819305023829952536783327.1891815.1331.958625.6331145.647425.704326.7757327.7314144.0005486.70681.9419109.4649216.21631036.1119.833777.7510.74310.79041964.61136.684206990000047.349737.57999.4619119.426646.9199.3538.5768945.3248.6959654.98197.6639.833589788193.8351.66508.360457045843.2681233.651488.040.651.3810.58481.3710.882945.400615.19244731852014000012.498719.6196372652264.9348.190843.57362224.0846.363354.506386956537.5052638494848.42709.7315.5902378591997000000642.95123100001.243082052600000804.750.7985445.71060.30153533.86943.81162506266425.6846.087243.767448.71882.4954.18771.7349980.880.4403681.380.653631.3792220.3025555561.150128474581.0431218997000000.73509410.7468.4294261104620590321.788767.0572010985.743991.073987.3553181090.6442523.297525458139522.537.1839320000024.871801791.64478198137564.4545034636141566.178563.33435015120026.393305220.42751298.5735899768.236102041227.865138173728.538237736165227.205192.418487246410224934851656591.3190.93179335650139410000016817864711.28811469247501235418521590827149.0515.0791104368237225910000863119269890000676807000012.259133630005584100031.441172491000117290000010478000010970000052129000371410002097200002924300005838700001459200000.5373580000039.2315.98953772500004.814.8015336.76738.4619864000030.87116.890816.273.65907145.8325494.49530.3532.835473.9404612.9837613.640248.7901109.736348.89281171993365.4110.9833194174828910112515643324.6952812.7632.063925.727145.372625.769326.904327.1855144.0515487.22980.880016109.4068216.5081012.9819.843783.6510.693210.76641964.71136.5656207100000047.333937.481002.8113119.046638.2499.2938.5168895.548.8259505.78196.2639.867423777194.82351.38507.364556906643.3141233.881483.250.651.3810.5741.3710.874345.322715.09991232651944000012.510419.7255866632254.7248.095643.41612194.3646.432754.515775188037.8081130344892.27709.7515.8438953171999500000648.275110700001.949412056500000805.380.76831445.39560.30927833.93443.9335558036425.8846.023243.904348.711582.0954.14731.7350181.50.4401561.380.653631.3792220.363703701.155786849321.0433319223000000.73161810.7768.35105802580051.786917.0872754991.123988.589994.6123164850.714973.267425261728422.537.286406639327000024.671805811.75453197738563.5755030436644569.795566.38634901980025.555306380.4302799.3455934768.51997371224.406137618726.50324366228.765192.701731539560234791660584.120.93600135655136980000016972874121.24511069347414235438716189206149.4515.161135728347226378000885509242080000683536000012.175128990005571500031.502472400000116990000010422000011137000049781000371200002094900002924900005856700001457400000.5373712000039.3415.93893816600004.814.8016336.6758.4520012000031.57116.846416.273.68087145.9015494.00760.3532.808573.777614.2303612.520948.8291109.857348.8934117263.33371.6110.9038OpenBenchmarking.org

Apache Hadoop

Operation: File Status - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 50 - Files: 1000000abcdefghij500K1000K1500K2000K2500K2173913194174828425218181823209241795332203666042643919305021941748

Apache Hadoop

Operation: Open - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 1000000abcdefghij300K600K900K1200K1500K2153321738221858741248439120481913037811107420323729382995289101

Apache Hadoop

Operation: Open - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 1000000abcdefghij300K600K900K1200K1500K11261261020408683995278319251004122100165402212330462536781251564

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij110022003300440055005137.015138.835153.661599.211599.151600.531602.523324.823327.193324.70

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcdefghij300600900120015001244.691239.671237.29395.66432.32431.94432.20810.71815.13812.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabcdefghij112233445549.3349.1747.1516.1616.1416.1316.0732.0031.9632.06

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcdefghij91827364539.5039.4739.4513.0712.9413.0913.0725.7125.6325.73

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij50100150200250218.15219.53218.5272.4672.6672.5772.69145.48145.65145.37

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamabcdefghij91827364539.4439.4539.4213.1313.1213.0913.0625.7925.7025.77

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabcdefghij110220330440550489.12489.45487.05163.56162.93162.90163.23326.93326.78326.90

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamabcdefghij110220330440550485.67488.13489.11162.85163.14162.93162.99327.02327.73327.19

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabcdefghij50100150200250215.64215.93215.6571.9271.9171.9471.90144.12144.00144.05

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij160320480640800718.92717.97716.14240.55240.23240.16239.52488.06486.71487.23

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUdefghij0.43690.87381.31071.74762.18450.6522590.6576100.6531820.6477000.8927011.9419000.880016MIN: 0.57MIN: 0.57MIN: 0.57MIN: 0.57MIN: 0.79MIN: 0.87MIN: 0.781. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamabcdefghij4080120160200158.92159.06164.6155.6155.4655.5455.43109.03109.46109.41

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabcdefghij70140210280350322.25321.18321.51108.91109.09109.09109.22216.24216.22216.51

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUabcdefghij300600900120015001560.031546.021551.63532.59530.99533.74538.011034.351036.111012.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUabcdefghij71421283530.4130.4430.4310.4710.4710.4810.4819.8219.8319.841. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUabcdefghij120024003600480060005776.945780.445802.652013.772007.532004.762006.093780.803777.753783.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeabcdefghij4812162015.9860015.9785015.987205.574695.541075.573205.5755310.7988010.7430010.69320

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeabcdefghij4812162015.9528015.9888015.977805.570015.563535.555815.5653910.7832010.7904010.76640

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUabcdefghij60012001800240030002945.262986.462987.331039.611039.821038.471039.371963.901964.611964.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamabcdefghij4080120160200201.39201.25201.5471.1471.2771.0470.93136.96136.68136.57

Liquid-DSP

Threads: 96 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 32abcdefghij600M1200M1800M2400M3000M30058000002995400000299980000010652000001065100000106530000010657000002068300000206990000020710000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamabcdefghij153045607568.6068.6668.6324.4824.4724.5224.4647.1347.3547.33

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUabcdefghij132639526556.0156.0656.0220.0320.0020.0120.0537.8237.5737.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij300600900120015001417.071403.071418.90508.09511.41508.21509.141003.52999.461002.81

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlyabcdefghij5010015020025080.5480.7680.41224.15224.10223.95224.12119.30119.42119.04

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUabcdefghij2K4K6K8K10K9837.589849.079845.273540.883544.183548.783533.646653.866646.916638.241. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlyabcdefghij408012016020066.4266.6466.72182.99182.56181.70183.2999.5499.3599.29

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlyabcdefghij163248648026.2026.2426.1272.0071.4471.9672.0138.4038.5738.51

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcdefghij30K60K90K120K150K120606.38120728.22123484.2844958.0744933.2744968.4345097.9968931.3568945.3268895.501. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlyabcdefghij2040608010033.2233.1733.0390.0390.3190.2690.6349.1048.6948.82

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUabcdefghij20K40K60K80K100K86884.6487359.2386789.8032002.6232032.0631951.6432008.0359615.8859654.9859505.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUabcdefghij60120180240300283.97284.99284.31106.90107.24106.76107.24196.07197.66196.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

SPECFEM3D

Model: Layered Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Layered Halfspaceabcdefghij163248648026.8928.6527.4971.6170.1970.5469.9640.3339.8339.871. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUabcdefghij60120180240300282.55284.22282.67107.02107.27107.39107.04197.94193.80194.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlyabcdefghij140280420560700254.88255.30254.72670.87670.64667.87669.09352.40351.66351.38

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamabcdefghij150300450600750672.46672.37671.26257.27257.89257.50257.28507.63508.36507.36

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metricabcdefghij170K340K510K680K850K7721627685177625292980642961252956032955225725005704585690661. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Crownabcdefghij122436486054.9055.3955.4021.4821.4421.5921.5842.8943.2743.31MIN: 53.27 / MAX: 57.28MIN: 54.02 / MAX: 57.64MIN: 53.71 / MAX: 58.99MIN: 21.32 / MAX: 21.8MIN: 21.3 / MAX: 21.78MIN: 21.45 / MAX: 21.84MIN: 21.43 / MAX: 21.89MIN: 42.47 / MAX: 43.88MIN: 42.82 / MAX: 44.23MIN: 42.83 / MAX: 44.44

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUabcdefghij70140210280350317.22317.28317.33124.12123.61124.30123.41234.18233.65233.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUabcdefghij4008001200160020002033.172028.012029.79797.64793.75791.74793.901481.711488.041483.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlyabcdefghij0.19580.39160.58740.78320.9790.860.860.870.340.340.340.340.650.650.65

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlyabcdefghij0.4140.8281.2421.6562.071.841.841.820.720.720.720.721.381.381.38

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeabcdefghij4812162013.8739013.7666013.831705.453295.461535.452275.4772510.5913010.5848010.57400

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlyabcdefghij0.41180.82361.23541.64722.0591.831.831.830.720.720.720.721.371.371.37

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeabcdefghij4812162014.2369014.1783014.139905.607475.620405.614545.6227810.8524010.8829010.87430

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Crownabcdefghij132639526556.0956.4656.8122.5922.5722.6622.7745.4845.4045.32MIN: 54.05 / MAX: 59.82MIN: 54.53 / MAX: 59.89MIN: 55.27 / MAX: 59.91MIN: 22.39 / MAX: 22.98MIN: 22.39 / MAX: 22.93MIN: 22.45 / MAX: 22.99MIN: 22.57 / MAX: 23.16MIN: 44.92 / MAX: 46.64MIN: 44.87 / MAX: 46.45MIN: 44.74 / MAX: 46.66

SPECFEM3D

Model: Mount St. Helens

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Mount St. Helensabcdefghij71421283511.0211.3211.3326.7426.8026.8727.7015.0315.1915.101. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Liquid-DSP

Threads: 96 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 512abcdefghij150M300M450M600M750M7116400007181400007150300002862500002858800002859200002865300005197000005201400005194400001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeabcdefghij4812162016.3468016.4365016.535006.587456.582706.595636.6008512.5438012.4987012.51040

SPECFEM3D

Model: Homogeneous Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Homogeneous Halfspaceabcdefghij81624324015.1114.4614.8135.5735.0335.5435.3819.9619.6219.731. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUabcdefghij60012001800240030002873.242880.582881.141175.671174.601180.851175.582252.702264.932254.721. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragonabcdefghij132639526560.1459.9159.7924.6924.7324.7024.8248.1248.1948.10MIN: 58.97 / MAX: 62MIN: 58.66 / MAX: 61.96MIN: 58.46 / MAX: 62.03MIN: 24.62 / MAX: 24.84MIN: 24.67 / MAX: 24.86MIN: 24.63 / MAX: 24.84MIN: 24.74 / MAX: 25MIN: 47.91 / MAX: 48.91MIN: 47.96 / MAX: 48.63MIN: 47.86 / MAX: 48.8

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragon Objabcdefghij122436486053.5753.8153.6922.2622.1622.1522.1943.5143.5743.42MIN: 52.17 / MAX: 55.38MIN: 52.72 / MAX: 55.86MIN: 52.63 / MAX: 55.24MIN: 22.18 / MAX: 22.42MIN: 22.08 / MAX: 22.35MIN: 22.07 / MAX: 22.32MIN: 22.12 / MAX: 22.33MIN: 43.26 / MAX: 44.02MIN: 43.34 / MAX: 44.03MIN: 43.14 / MAX: 43.89

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUabcdefghij50010001500200025002454.092450.262455.511036.991028.641041.871031.602180.832224.082194.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon Objabcdefghij132639526556.4956.6956.9323.8723.9423.9423.8846.3846.3646.43MIN: 55.29 / MAX: 58.38MIN: 55.42 / MAX: 58.97MIN: 55.56 / MAX: 59.67MIN: 23.78 / MAX: 24.08MIN: 23.84 / MAX: 24.18MIN: 23.84 / MAX: 24.16MIN: 23.79 / MAX: 24.08MIN: 46.09 / MAX: 47.08MIN: 46.13 / MAX: 46.98MIN: 46.17 / MAX: 47.23

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragonabcdefghij153045607567.3467.2067.5028.3628.3128.3228.4854.3954.5154.52MIN: 65.61 / MAX: 70.54MIN: 65.48 / MAX: 70.41MIN: 65.64 / MAX: 71.17MIN: 28.26 / MAX: 28.59MIN: 28.21 / MAX: 28.56MIN: 28.23 / MAX: 28.55MIN: 28.37 / MAX: 28.69MIN: 54.12 / MAX: 55.15MIN: 54.22 / MAX: 55.08MIN: 54.24 / MAX: 55.1

Apache Hadoop

Operation: File Status - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 50 - Files: 100000abcdefghij200K400K600K800K1000K529101862069657895632911389105709220561798925926869565751880

SPECFEM3D

Model: Water-layered Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Water-layered Halfspaceabcdefghij142842567026.9929.4627.0662.4462.3361.2862.8136.4537.5137.811. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUabcdefghij130026003900520065005882.915836.275840.532564.782562.542539.972557.664803.654848.424892.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUabcdefghij2004006008001000842.91854.51849.30370.57373.64369.26372.26710.69709.73709.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

SPECFEM3D

Model: Tomographic Model

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Tomographic Modelabcdefghij71421283512.3112.1012.0427.3327.4626.9727.7515.9915.5915.841. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Liquid-DSP

Threads: 96 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 57abcdefghij600M1200M1800M2400M3000M25598000002571100000256490000011208000001117800000112050000011182000001995500000199700000019995000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUabcdefghij160320480640800748.44750.49757.38344.67342.81343.49341.36643.80642.90648.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512abcdefghij130M260M390M520M650M6225600006109500006226300002829200002818300002830300002817300005120200005123100005110700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.47220.94441.41661.88882.3611.037491.144321.001361.127232.098801.243081.94941MIN: 0.92MIN: 1.07MIN: 0.92MIN: 0.93MIN: 1.29MIN: 1.04MIN: 1.261. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32abcdefghij500M1000M1500M2000M2500M22077000002212100000220680000010595000001057500000105710000010562000002057500000205260000020565000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUabcdefghij2004006008001000393.60393.23393.37761.59761.16760.57759.92804.58804.75805.38MIN: 363.29 / MAX: 431.61MIN: 360.87 / MAX: 433.13MIN: 362.57 / MAX: 433.51MIN: 738.34 / MAX: 772.36MIN: 741.99 / MAX: 776.56MIN: 741.4 / MAX: 770.88MIN: 737.63 / MAX: 771.07MIN: 772.52 / MAX: 820.63MIN: 776.93 / MAX: 819.19MIN: 783.22 / MAX: 819.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUdefghij0.35390.70781.06171.41561.76951.5582401.5491101.5728201.5511800.7785430.7985400.768314MIN: 1.51MIN: 1.51MIN: 1.53MIN: 1.52MIN: 0.71MIN: 0.7MIN: 0.711. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Crowndefghij102030405022.3922.3422.4422.4245.1945.7145.40MIN: 22.2 / MAX: 22.85MIN: 22.15 / MAX: 22.75MIN: 22.25 / MAX: 22.78MIN: 22.22 / MAX: 22.85MIN: 44.65 / MAX: 46.39MIN: 45.11 / MAX: 47.49MIN: 44.88 / MAX: 46.68

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUdefghij0.13780.27560.41340.55120.6890.6039500.5757940.6008340.6123200.3024600.3015350.309278MIN: 0.53MIN: 0.52MIN: 0.53MIN: 0.53MIN: 0.27MIN: 0.28MIN: 0.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigabcdefghij122436486027.3527.2427.4155.1755.0955.1555.1733.9533.8733.93

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Crowndefghij102030405021.8921.9921.7721.8343.5743.8143.93MIN: 21.74 / MAX: 22.23MIN: 21.84 / MAX: 22.32MIN: 21.63 / MAX: 22.18MIN: 21.69 / MAX: 22.17MIN: 43.11 / MAX: 44.65MIN: 43.36 / MAX: 45.05MIN: 43.46 / MAX: 45.01

Apache Hadoop

Operation: File Status - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 100 - Files: 1000000abcdefghij500K1000K1500K2000K2500K188679216197018939396006012356271964637204918023529412506266558036

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUabcdefghij90180270360450213.94213.62213.79398.52398.91399.24398.13421.80425.68425.88MIN: 201.64 / MAX: 242.71MIN: 197.2 / MAX: 235.23MIN: 197.29 / MAX: 236.32MIN: 382.1 / MAX: 404.98MIN: 386.2 / MAX: 407.29MIN: 387.9 / MAX: 408.93MIN: 379.09 / MAX: 404.71MIN: 269.94 / MAX: 598.22MIN: 402.91 / MAX: 432.03MIN: 404.76 / MAX: 434.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon Objdefghij102030405023.3523.5323.5023.7145.9246.0946.02MIN: 23.26 / MAX: 23.57MIN: 23.43 / MAX: 23.73MIN: 23.4 / MAX: 23.74MIN: 23.61 / MAX: 23.93MIN: 45.64 / MAX: 46.53MIN: 45.82 / MAX: 46.6MIN: 45.75 / MAX: 46.57

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon Objdefghij102030405022.3522.2922.2722.2643.8443.7743.90MIN: 22.28 / MAX: 22.5MIN: 22.22 / MAX: 22.46MIN: 22.2 / MAX: 22.44MIN: 22.18 / MAX: 22.43MIN: 43.64 / MAX: 44.38MIN: 43.51 / MAX: 44.16MIN: 43.66 / MAX: 44.27

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragondefghij112233445524.8524.8324.8924.9648.9148.7248.71MIN: 24.78 / MAX: 25MIN: 24.76 / MAX: 24.96MIN: 24.81 / MAX: 25.06MIN: 24.9 / MAX: 25.13MIN: 48.64 / MAX: 49.47MIN: 48.48 / MAX: 49.3MIN: 48.45 / MAX: 49.47

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUabcdefghij2040608010042.4442.2042.4374.7174.5074.4374.7180.7782.4982.09MIN: 36.14 / MAX: 61.98MIN: 36.84 / MAX: 61.97MIN: 36.31 / MAX: 62.36MIN: 66.12 / MAX: 81.09MIN: 66.5 / MAX: 80.32MIN: 65.68 / MAX: 83.49MIN: 66.29 / MAX: 79.68MIN: 69.54 / MAX: 95.42MIN: 70.77 / MAX: 94.62MIN: 68.73 / MAX: 91.871. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragondefghij122436486027.7427.8327.8327.9154.2254.1954.15MIN: 27.64 / MAX: 27.98MIN: 27.72 / MAX: 28.1MIN: 27.73 / MAX: 28.13MIN: 27.81 / MAX: 28.17MIN: 53.93 / MAX: 54.77MIN: 53.91 / MAX: 54.97MIN: 53.87 / MAX: 54.79

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUdefghij0.76151.5232.28453.0463.80753.377823.384363.379563.381561.733811.734991.73501MIN: 3.33MIN: 3.33MIN: 3.33MIN: 3.33MIN: 1.64MIN: 1.65MIN: 1.641. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUabcdefghij2040608010042.2442.0942.1974.8174.5474.8774.5881.5880.8881.50MIN: 36.59 / MAX: 61.56MIN: 37.13 / MAX: 58.71MIN: 36.21 / MAX: 65.64MIN: 66.88 / MAX: 80.7MIN: 65.97 / MAX: 82.9MIN: 66.72 / MAX: 80.96MIN: 67.63 / MAX: 78.73MIN: 68.74 / MAX: 95.81MIN: 39.72 / MAX: 92.54MIN: 68.9 / MAX: 92.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUdefghij0.19140.38280.57420.76560.9570.8478050.8444340.8506910.8434920.4400060.4403680.440156MIN: 0.83MIN: 0.83MIN: 0.83MIN: 0.83MIN: 0.41MIN: 0.41MIN: 0.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlydefghij0.31050.6210.93151.2421.55250.720.720.720.721.381.381.38

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlydefghij0.14630.29260.43890.58520.73150.340.340.340.340.650.650.65

OpenVKL

Benchmark: vklBenchmarkCPU Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU Scalardefghij80160240320400191190191191363363363MIN: 13 / MAX: 3471MIN: 13 / MAX: 3484MIN: 13 / MAX: 3484MIN: 13 / MAX: 3483MIN: 24 / MAX: 6610MIN: 24 / MAX: 6577MIN: 24 / MAX: 6613

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlydefghij0.30830.61660.92491.23321.54150.720.720.720.721.371.371.37

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCdefghij2004006008001000487487488489926922922MIN: 36 / MAX: 6949MIN: 36 / MAX: 6956MIN: 36 / MAX: 6952MIN: 36 / MAX: 6969MIN: 67 / MAX: 12416MIN: 67 / MAX: 12374MIN: 67 / MAX: 12356

Remhos

Test: Sample Remap Example

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap Exampleabcdefghij71421283516.3516.7916.2430.7630.8530.7330.7520.4420.3020.361. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Apache Hadoop

Operation: Open - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 100000abcdefghij120K240K360K480K600K420168404858403226529101294985523560460829526316555556370370

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUdefghij0.480.961.441.922.42.133322.125702.130622.118131.147491.150121.15578MIN: 2MIN: 2.01MIN: 1.97MIN: 1.99MIN: 1.01MIN: 1MIN: 1.031. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Apache Hadoop

Operation: File Status - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 100 - Files: 100000abcdefghij200K400K600K800K1000K515464458716729927591716613497478469487805595238847458684932

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.43150.8631.29451.7262.15751.913741.917811.914221.912741.041001.043121.04333MIN: 1.88MIN: 1.88MIN: 1.88MIN: 1.88MIN: 0.94MIN: 0.94MIN: 0.941. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57abcdefghij400M800M1200M1600M2000M19944000002001900000201030000010933000001095400000109460000010993000001916800000189970000019223000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.30190.60380.90571.20761.50951.3378901.3386101.3418301.3356400.7344610.7350940.731618MIN: 1.31MIN: 1.31MIN: 1.31MIN: 1.31MIN: 0.66MIN: 0.66MIN: 0.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUabcdefghij36912155.895.915.9010.0110.0610.0910.0610.7810.7410.77MIN: 4.67 / MAX: 18.4MIN: 4.84 / MAX: 12.9MIN: 4.83 / MAX: 13.4MIN: 5.7 / MAX: 19.52MIN: 5.29 / MAX: 19.07MIN: 5.4 / MAX: 19.17MIN: 5.2 / MAX: 19.38MIN: 5.59 / MAX: 21.13MIN: 5.92 / MAX: 24.44MIN: 6 / MAX: 18.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUabcdefghij153045607537.8037.7937.7964.4164.6864.3164.7768.2768.4268.35MIN: 33.35 / MAX: 56.45MIN: 32.97 / MAX: 53.7MIN: 33.29 / MAX: 54.88MIN: 37.44 / MAX: 73.04MIN: 38.02 / MAX: 72.52MIN: 50.85 / MAX: 70.77MIN: 55.8 / MAX: 69.46MIN: 56.41 / MAX: 79.96MIN: 56.13 / MAX: 75.77MIN: 55.82 / MAX: 74.841. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

TiDB Community Server

Test: oltp_read_write - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 64abcdefghi20K40K60K80K100K790908018378469553345389354956553019557994261

TiDB Community Server

Test: oltp_read_write - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 128abdefghij20K40K60K80K100K857578909959727601456031059944104180104620105802

Apache Hadoop

Operation: Create - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 100 - Files: 100000abcdefghij13K26K39K52K65K40733374253507557971588245938258928604965903258005

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.68931.37862.06792.75723.44653.059913.063703.056743.054581.781701.788761.78691MIN: 2.96MIN: 2.97MIN: 2.97MIN: 2.97MIN: 1.64MIN: 1.65MIN: 1.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUabcdefghij2468104.174.164.166.796.806.766.797.097.057.08MIN: 3.39 / MAX: 10.07MIN: 3.42 / MAX: 11.2MIN: 3.43 / MAX: 10.26MIN: 3.8 / MAX: 15.48MIN: 4.04 / MAX: 15.37MIN: 4.04 / MAX: 15.47MIN: 3.79 / MAX: 15.41MIN: 4.43 / MAX: 16.88MIN: 4.44 / MAX: 16.57MIN: 4.35 / MAX: 16.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Apache Hadoop

Operation: Create - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 100 - Files: 1000000abcdefghij16K32K48K64K80K46145444374400171296700577053770922736117201072754

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUdefghij4008001200160020001643.991643.971642.351641.40987.84985.74991.12MIN: 1588.03MIN: 1590.89MIN: 1586.17MIN: 1589.91MIN: 952.67MIN: 949.93MIN: 954.921. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUdefghij4008001200160020001641.921641.001636.761637.37986.96991.07988.59MIN: 1584.81MIN: 1595.55MIN: 1585.98MIN: 1584.58MIN: 949.02MIN: 953.96MIN: 950.961. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUdefghij4008001200160020001642.511639.361636.441631.99993.56987.36994.61MIN: 1593.16MIN: 1581.93MIN: 1585.81MIN: 1581.62MIN: 955.42MIN: 952.16MIN: 960.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writesabcdefghij70K140K210K280K350K248095256661270480197866195798196287197092324575318109316485

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUdefghij0.23880.47760.71640.95521.1941.0287501.0542501.0614401.0456700.7045500.6442520.714970MIN: 0.96MIN: 0.97MIN: 0.98MIN: 0.98MIN: 0.66MIN: 0.61MIN: 0.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUabcdefghij0.7471.4942.2412.9883.7352.032.052.053.113.113.143.123.323.293.26MIN: 1.66 / MAX: 7.51MIN: 1.6 / MAX: 7MIN: 1.62 / MAX: 6.96MIN: 1.94 / MAX: 11.57MIN: 1.93 / MAX: 9.72MIN: 1.93 / MAX: 11.65MIN: 1.88 / MAX: 11.92MIN: 2.11 / MAX: 12.58MIN: 1.89 / MAX: 12.75MIN: 2.1 / MAX: 14.31. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

TiDB Community Server

Test: oltp_read_write - Threads: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 32abcdefghij16K32K48K64K80K58974615205963046977467374714146993754867525474252

Apache Hadoop

Operation: Open - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 100000abcdefghij140K280K420K560K700K460829469484401606578035552486578035546448645161581395617284

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUabcdefghij51015202514.2314.0314.1221.5721.4021.6521.4722.5022.5322.53MIN: 11.51 / MAX: 25.86MIN: 11.59 / MAX: 26.04MIN: 11.51 / MAX: 26.04MIN: 19.5 / MAX: 24.76MIN: 19.07 / MAX: 25.3MIN: 19.48 / MAX: 24.27MIN: 17.62 / MAX: 28.13MIN: 13.76 / MAX: 30.22MIN: 19.09 / MAX: 30.15MIN: 18.74 / MAX: 31.081. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUabcdefghij2468104.884.894.887.707.777.677.747.337.187.28MIN: 3.95 / MAX: 16.05MIN: 3.93 / MAX: 13.44MIN: 3.9 / MAX: 14.94MIN: 5.51 / MAX: 16.06MIN: 5.42 / MAX: 16.35MIN: 5.32 / MAX: 16.6MIN: 6.06 / MAX: 12.66MIN: 5.45 / MAX: 15.94MIN: 4.98 / MAX: 16.11MIN: 5.53 / MAX: 15.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

TiDB Community Server

Test: oltp_update_non_index - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 128acefghj14K28K42K56K70K51105528654213841424416956581664066

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 512abcdefghij90M180M270M360M450M4258100004296200004244000002737600002734800002733900002740700003916800003932000003932700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUabcdefghij61218243016.0215.9815.8323.2023.3223.2823.4224.8424.8724.67MIN: 12.5 / MAX: 33.94MIN: 12.74 / MAX: 33.34MIN: 12.38 / MAX: 32.97MIN: 15.1 / MAX: 31.6MIN: 19.49 / MAX: 30.99MIN: 15.73 / MAX: 30.77MIN: 20.46 / MAX: 32.43MIN: 16.93 / MAX: 33.96MIN: 17 / MAX: 33.34MIN: 20.15 / MAX: 37.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

TiDB Community Server

Test: oltp_point_select - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 64abdefgij40K80K120K160K200K127567130802115675118657119092118549180179180581

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUdefghij0.57721.15441.73162.30882.8862.494082.565222.497142.514411.742031.644781.75453MIN: 2.3MIN: 2.32MIN: 2.26MIN: 2.3MIN: 1.51MIN: 1.42MIN: 1.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

Test: oltp_point_select - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 128abcdefhij40K80K120K160K200K159242159728149962129492129904130389200327198137197738

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUdefghij2004006008001000849.16851.66849.34837.60568.75564.45563.58MIN: 806.44MIN: 809.45MIN: 805.8MIN: 796.61MIN: 546.79MIN: 545.57MIN: 543.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

Test: oltp_update_non_index - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 64abcdefghij11K22K33K44K55K41281397593910634224338813447034107511915034650304

TiDB Community Server

Test: oltp_update_index - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 128abcefghij8K16K24K32K40K270872746426546246112483024574371263614136644

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUdefghij2004006008001000838.52849.71851.49848.03564.12566.18569.80MIN: 796.3MIN: 805.98MIN: 807.97MIN: 807.34MIN: 545.13MIN: 544.56MIN: 548.081. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUdefghij2004006008001000847.38841.08845.31847.42568.65563.33566.39MIN: 806.33MIN: 798.46MIN: 803.78MIN: 806.72MIN: 547.26MIN: 544.04MIN: 542.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Kripke

OpenBenchmarking.orgThroughput FoM, More Is BetterKripke 1.2.6defghij80M160M240M320M400M2409945002362439002365910002371757003548080003501512003490198001. (CXX) g++ options: -O3 -fopenmp -ldl

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200defghij91827364538.1138.0738.0237.9526.1126.3925.561. (CXX) g++ options: -O3 -fopenmp

TiDB Community Server

Test: oltp_update_index - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 64bcdefhij7K14K21K28K35K2437123324211082127121067313323052230638

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUdefghij0.14260.28520.42780.57040.7130.6282360.6339750.6303250.6291080.4264260.4275120.430270MIN: 0.6MIN: 0.6MIN: 0.6MIN: 0.6MIN: 0.38MIN: 0.39MIN: 0.381. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 4Kabcdefghij2040608010090.8191.3290.4266.9967.7267.3967.8199.1098.5799.351. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Apache Hadoop

Operation: Create - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 100000abcdefghij13K26K39K52K65K43649412884393758617586175834360680587205899759347

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400defghij2040608010098.9899.4297.9997.5368.5768.2468.521. (CXX) g++ options: -O3 -fopenmp

Apache Hadoop

Operation: Delete - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 100 - Files: 100000abcdefghij20K40K60K80K100K875669082773475105708980399940410256410526310204197371

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4Kabcdefghij50100150200250163.46166.38163.06163.19162.61161.85160.32230.03227.87224.411. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TiDB Community Server

Test: oltp_point_select - Threads: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 32abdefghij30K60K90K120K150K10462710618098149969079736896840138538138173137618

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080pabcdefghij160320480640800510.36542.61516.91604.99597.01585.37586.75726.89728.54726.501. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TiDB Community Server

Test: oltp_update_index - Threads: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 32abcdeghij5K10K15K20K25K183611781717565176121711717135242862377324366

TiDB Community Server

Test: oltp_point_select - Threads: 1

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 1abcdefhi1300260039005200650043314405447158985976595461256165

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4Kabcdefghij50100150200250163.01166.69161.50161.85162.05160.80161.32223.42227.21228.771. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeabcdefghij50100150200250215.10214.07214.14151.91151.51151.78151.68192.65192.40192.70

TiDB Community Server

Test: oltp_update_non_index - Threads: 1

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 1abcdefghi400800120016002000132813121381169317081697170518611848

Apache Hadoop

Operation: Create - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 1000000abcdefghij16K32K48K64K80K53665521195226072134708976992072706734117246473153

Apache Hadoop

Operation: Delete - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 100000abcdefghij20K40K60K80K100K9107573801905801010101006049699310395010040210224995602

TiDB Community Server

Test: oltp_read_write - Threads: 1

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 1abcefghij7001400210028003500254025102485320932183195348034853479

TiDB Community Server

Test: oltp_update_index - Threads: 1

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 1acdefghij400800120016002000121211891479149014831481166616561660

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080pabcdefghij130260390520650422.99427.69431.90526.22525.17521.52528.53580.16591.32584.121. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUdefghij0.28810.57620.86431.15241.44051.2575801.2804301.2065301.2791800.9262830.9317930.936001MIN: 1.21MIN: 1.24MIN: 1.18MIN: 1.24MIN: 0.85MIN: 0.86MIN: 0.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

Test: oltp_update_non_index - Threads: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 32abdefhij8K16K24K32K40K2873528914262732628526695360413565035655

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 57abcdefghij300M600M900M1200M1500M11921000001214200000125480000010350000001032000000102460000010334000001352900000139410000013698000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

TiDB Community Server

Test: oltp_update_index - Threads: 16

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 16acdefghij4K8K12K16K20K125581268112622125671269212627169651681716972

TiDB Community Server

Test: oltp_point_select - Threads: 16

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 16bcefghij20K40K60K80K100K6751565406702507010569923872188647187412

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240defghij0.37280.74561.11841.49121.8641.6571.6541.6571.6481.2841.2881.2451. (CXX) g++ options: -O3 -fopenmp

Apache Hadoop

Operation: Delete - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 100 - Files: 1000000abcdefghij20K40K60K80K100K901148671597031112613113225110803113895111782114692110693

TiDB Community Server

Test: oltp_read_write - Threads: 16

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 16abcdefghij10K20K30K40K50K38331369503736836480367843612536088475764750147414

TiDB Community Server

Test: oltp_update_non_index - Threads: 16

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 16abdeghij5K10K15K20K25K1809518068185631855718735237942354123543

Apache Hadoop

Operation: Rename - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 100 - Files: 1000000abcdefghij20K40K60K80K100K73078721296682781208843608581585763843108521587161

Apache Hadoop

Operation: Rename - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 50 - Files: 100000abcdefghij20K40K60K80K100K70522730467710182372822378163382237830569082789206

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 1080pabcdefghij306090120150141.22138.34143.55118.95119.31118.49118.48151.44149.05149.451. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4Kabcdefghij1.17072.34143.51214.68285.85355.2035.1495.0494.1074.1144.1384.1435.0755.0795.1601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Apache Hadoop

Operation: Delete - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 1000000abcdefghij20K40K60K80K100K989329731490147111012113327111198110828113404110436113572

Apache Hadoop

Operation: Rename - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 100 - Files: 100000abcdefghij20K40K60K80K100K75529693486715982102838227949180386798088237283472

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 512abcdefghij6M12M18M24M30M279010002773600028227000246270002520700025199000227270002564800025910000263780001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Apache Hadoop

Operation: Rename - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 50 - Files: 1000000abcdefghij20K40K60K80K100K73239716797463883921840418250184810851218631188550

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawabcdefghij2000M4000M6000M8000M10000M11106900000112403000001082670000010318900000102640000009976450000105006000009145900000926989000092420800001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicabcdefghij2000M4000M6000M8000M10000M67677100006757360000675417000079345700007931010000795579000079649100006761270000676807000068353600001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080pabcdefghij369121512.4812.5912.6210.9110.9810.7411.0212.2312.2612.181. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512abcdefghij3M6M9M12M15M139090001402100014225000126830001236600012681000122560001290900013363000128990001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57abcdefghij13M26M39M52M65M594010005929600057519000526650005282700052879000528540005144300055841000557150001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamabcdefghij81624324035.6335.6435.6831.0530.9931.0331.0631.4931.4431.50

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 32abcdefghij17M34M51M68M85M771810007701900076924000670540006884600068861000686780007246800072491000724000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 32abcdefghij300M600M900M1200M1500M11835000001190300000118480000010471000001046600000104190000010471000001172400000117290000011699000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 512abcdefghij20M40M60M80M100M1098700001080800001091400009959400097005000994410001001700001044400001047800001042200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 57abcdefghij30M60M90M120M150M1174900001140100001185500001056500001054800001057400001048000001052800001097000001113700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 512abcdefghij12M24M36M48M60M529110005558800055165000502580005038000049977000495560005289000052129000497810001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32abcdefghij8M16M24M32M40M394990003948600039453000352280003531500035271000352360003714500037141000371200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 512abcdefghij50M100M150M200M250M2160800002161500002149100001938500001960400001945000001946700002075900002097200002094900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 32abcdefghij70M140M210M280M350M3075400003051100003067600002780300002777800002763900002774100002926200002924300002924900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 32abcdefghij130M260M390M520M650M5942300006024700006036500005453600005451400005450200005430500005858500005838700005856700001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 32abcdefghij30M60M90M120M150M1538500001536900001536700001386000001386200001385800001384600001458200001459200001457400001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUabcdefghij0.12150.2430.36450.4860.60750.540.540.540.490.490.490.490.530.530.53MIN: 0.45 / MAX: 7.64MIN: 0.45 / MAX: 7.81MIN: 0.45 / MAX: 5.03MIN: 0.3 / MAX: 9.28MIN: 0.3 / MAX: 9.07MIN: 0.3 / MAX: 8.2MIN: 0.3 / MAX: 8.84MIN: 0.31 / MAX: 10.06MIN: 0.31 / MAX: 10.06MIN: 0.31 / MAX: 7.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 57abcdefghij160M320M480M640M800M6997400006927600006749300006891500006929200006933400006820700007414200007358000007371200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcdefghij91827364538.5038.6638.7540.4036.9837.0136.9839.4439.2339.34MIN: 36.77 / MAX: 44.23MIN: 37.22 / MAX: 43.52MIN: 37.46 / MAX: 43.52MIN: 26.93 / MAX: 74.83MIN: 32.02 / MAX: 44.78MIN: 32.25 / MAX: 43.6MIN: 32.61 / MAX: 41.91MIN: 33.14 / MAX: 45.28MIN: 34.71 / MAX: 47.63MIN: 25.19 / MAX: 46.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij4812162016.9117.0716.8915.7215.6215.7215.6915.9215.9915.94

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 57abcdefghij80M160M240M320M400M3694300003669300003669900003633100003579900003504500003578100003783300003772500003816600001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUabcdefghij1.09352.1873.28054.3745.46754.864.854.864.514.514.504.524.804.814.81MIN: 4.23 / MAX: 12.81MIN: 4.25 / MAX: 12.86MIN: 4.34 / MAX: 12.27MIN: 2.98 / MAX: 13.05MIN: 2.96 / MAX: 16.06MIN: 2.98 / MAX: 13.86MIN: 2.77 / MAX: 13.57MIN: 3.23 / MAX: 14.95MIN: 3.23 / MAX: 15.04MIN: 3.23 / MAX: 14.451. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij1.12412.24823.37234.49645.62054.65084.64764.63484.99604.98594.98774.97874.80054.80154.8016

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamabcdefghij80160240320400347.66347.22347.37325.88325.74324.96325.51337.96336.77336.68

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUabcdefghij2468108.288.278.247.937.967.977.968.468.468.45MIN: 7.44 / MAX: 23.35MIN: 7.37 / MAX: 25.18MIN: 7.62 / MAX: 23.32MIN: 4.2 / MAX: 16.92MIN: 4.19 / MAX: 16.59MIN: 4.37 / MAX: 16.86MIN: 4.19 / MAX: 14.2MIN: 4.67 / MAX: 18MIN: 4.49 / MAX: 17.8MIN: 4.46 / MAX: 17.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 57abcdefghij40M80M120M160M200M1962200001965900001945100001889300001912300001898800001907500002009300001986400002001200001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUabcdefghij71421283530.7231.0030.8930.0230.1029.9529.7230.9230.8731.57MIN: 29.51 / MAX: 35.07MIN: 29.59 / MAX: 36.33MIN: 29.48 / MAX: 36.29MIN: 18.78 / MAX: 38.72MIN: 22.61 / MAX: 39.15MIN: 19.01 / MAX: 38.08MIN: 19.46 / MAX: 38.99MIN: 25.94 / MAX: 41.77MIN: 20.13 / MAX: 42.34MIN: 20.39 / MAX: 39.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamabcdefghij306090120150118.75118.95118.78112.25112.06112.41112.48116.51116.89116.85

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUabcdefghij4812162016.2616.0216.0215.3615.3615.3815.3716.2716.2716.27MIN: 14.71 / MAX: 28.14MIN: 14.41 / MAX: 30.55MIN: 14.63 / MAX: 33.79MIN: 8.08 / MAX: 24.34MIN: 8.02 / MAX: 23.81MIN: 7.99 / MAX: 24MIN: 7.99 / MAX: 23.98MIN: 8.92 / MAX: 25.52MIN: 8.5 / MAX: 25.86MIN: 8.44 / MAX: 25.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUdefghij0.86491.72982.59473.45964.32453.815763.844213.818233.823813.722473.659073.68087MIN: 3.26MIN: 3.27MIN: 3.25MIN: 3.29MIN: 2.83MIN: 2.81MIN: 2.851. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamabcdefghij306090120150150.59150.61145.26143.76144.10143.69144.11146.12145.83145.90

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabcdefghij110220330440550485.72487.36507.48493.60494.26494.22495.60495.22494.50494.01

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcdefghij0.07880.15760.23640.31520.3940.340.340.340.350.350.350.350.350.350.35MIN: 0.29 / MAX: 7.33MIN: 0.29 / MAX: 10.87MIN: 0.29 / MAX: 7.09MIN: 0.23 / MAX: 9.09MIN: 0.23 / MAX: 8.84MIN: 0.23 / MAX: 9.15MIN: 0.23 / MAX: 8.63MIN: 0.21 / MAX: 8.91MIN: 0.22 / MAX: 8.62MIN: 0.22 / MAX: 8.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij81624324033.3433.3833.4633.2233.2633.2833.3732.7532.8432.81

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabcdefghij2040608010074.3274.5674.5073.3173.2673.2273.1973.8873.9473.78

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcdefghij130260390520650605.04605.73605.92606.10607.91607.82607.16613.05612.98614.23

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamabcdefghij130260390520650605.76606.67605.88606.58606.76606.79608.72613.16613.64612.52

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamabcdefghij112233445549.3749.1149.0249.0949.0149.0749.0348.8848.7948.83

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streamabcdefghij20406080100109.80109.23109.58110.11109.97110.00109.90109.79109.74109.86

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabcdefghij112233445549.0148.9749.2148.8749.0649.0748.9848.8948.8948.89

QuantLib

Configuration: Multi-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-Threadedhij30K60K90K120K150K116781.5117199.0117263.31. (CXX) g++ options: -O3 -march=native -fPIE -pie

QuantLib

Configuration: Single-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-Threadedhij70014002100280035003357.93365.43371.61. (CXX) g++ options: -O3 -march=native -fPIE -pie

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabcdefghij20406080100111.01110.92111.03111.11111.09110.89110.98110.81110.98110.90


Phoronix Test Suite v10.8.5