extra tests2

AMD EPYC 9334 32-Core testing with a Supermicro H13SSW (1.1 BIOS) and astdrmfb on AlmaLinux 9.2 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2310249-NE-EXTRATEST98&sor&grs.

extra tests2ProcessorMotherboardMemoryDiskGraphicsMonitorOSKernelCompilerFile-SystemScreen Resolutionabcdefghij2 x AMD EPYC 9254 24-Core @ 2.90GHz (48 Cores / 96 Threads)Supermicro H13DSH (1.5 BIOS)24 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07astdrmfbAlmaLinux 9.25.14.0-284.25.1.el9_2.x86_64 (x86_64)GCC 11.3.1 20221121ext41024x768AMD EPYC 9124 16-Core @ 3.00GHz (16 Cores / 32 Threads)Supermicro H13SSW (1.1 BIOS)12 x 64 GB DDR5-4800MT/s HMCG94MEBRA123NAMD EPYC 9334 32-Core @ 2.70GHz (32 Cores / 64 Threads)DELL E207WFP1680x1050OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details- a: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- b: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- c: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113e- d: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- e: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- f: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- g: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- h: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- i: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111- j: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Details- OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Details- Python 3.9.16Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

extra tests2hadoop: File Status - 50 - 1000000hadoop: Open - 100 - 1000000hadoop: Open - 50 - 1000000deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamopenvino: Handwritten English Recognition FP16-INT8 - CPUdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamonednn: IP Shapes 1D - u8s8f32 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamopenvino: Handwritten English Recognition FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeopenvino: Weld Porosity Detection FP16 - CPUdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamliquid-dsp: 96 - 256 - 32deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamopenvino: Face Detection FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamblender: Pabellon Barcelona - CPU-Onlyopenvino: Face Detection Retail FP16-INT8 - CPUblender: Classroom - CPU-Onlyblender: BMW27 - CPU-Onlyopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUblender: Fishy Cat - CPU-Onlyopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Person Detection FP32 - CPUspecfem3d: Layered Halfspaceopenvino: Person Detection FP16 - CPUblender: Barbershop - CPU-Onlydeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streambrl-cad: VGR Performance Metricembree: Pathtracer - Crownopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Vehicle Detection FP16 - CPUoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyospray: gravity_spheres_volume/dim_512/scivis/real_timeoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyospray: gravity_spheres_volume/dim_512/ao/real_timeembree: Pathtracer ISPC - Crownspecfem3d: Mount St. Helensliquid-dsp: 96 - 256 - 512ospray: gravity_spheres_volume/dim_512/pathtracer/real_timespecfem3d: Homogeneous Halfspaceopenvino: Vehicle Detection FP16-INT8 - CPUembree: Pathtracer - Asian Dragonembree: Pathtracer - Asian Dragon Objopenvino: Person Vehicle Bike Detection FP16 - CPUembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Asian Dragonhadoop: File Status - 50 - 100000specfem3d: Water-layered Halfspaceopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUspecfem3d: Tomographic Modelliquid-dsp: 96 - 256 - 57openvino: Road Segmentation ADAS FP16 - CPUliquid-dsp: 64 - 256 - 512onednn: IP Shapes 1D - bf16bf16bf16 - CPUliquid-dsp: 64 - 256 - 32openvino: Face Detection FP16 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUembree: Pathtracer ISPC - Crownonednn: IP Shapes 3D - u8s8f32 - CPUbuild-linux-kernel: defconfigembree: Pathtracer - Crownhadoop: File Status - 100 - 1000000openvino: Face Detection FP16-INT8 - CPUembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer - Asian Dragon Objembree: Pathtracer - Asian Dragonopenvino: Person Detection FP16 - CPUembree: Pathtracer ISPC - Asian Dragononednn: Deconvolution Batch shapes_3d - f32 - CPUopenvino: Person Detection FP32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyopenvkl: vklBenchmarkCPU Scalaroidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyopenvkl: vklBenchmarkCPU ISPCremhos: Sample Remap Examplehadoop: Open - 100 - 100000onednn: Convolution Batch Shapes Auto - f32 - CPUhadoop: File Status - 100 - 100000onednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUliquid-dsp: 64 - 256 - 57onednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUtidb: oltp_read_write - 64tidb: oltp_read_write - 128hadoop: Create - 100 - 100000onednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUhadoop: Create - 100 - 1000000onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUcassandra: Writesonednn: IP Shapes 3D - bf16bf16bf16 - CPUopenvino: Face Detection Retail FP16 - CPUtidb: oltp_read_write - 32hadoop: Open - 50 - 100000openvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUtidb: oltp_update_non_index - 128liquid-dsp: 32 - 256 - 512openvino: Road Segmentation ADAS FP16 - CPUtidb: oltp_point_select - 64onednn: IP Shapes 1D - f32 - CPUtidb: oltp_point_select - 128onednn: Recurrent Neural Network Inference - u8s8f32 - CPUtidb: oltp_update_non_index - 64tidb: oltp_update_index - 128onednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUkripke: easywave: e2Asean Grid + BengkuluSept2007 Source - 1200tidb: oltp_update_index - 64onednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUsvt-av1: Preset 8 - Bosphorus 4Khadoop: Create - 50 - 100000easywave: e2Asean Grid + BengkuluSept2007 Source - 2400hadoop: Delete - 100 - 100000svt-av1: Preset 12 - Bosphorus 4Ktidb: oltp_point_select - 32svt-av1: Preset 13 - Bosphorus 1080ptidb: oltp_update_index - 32tidb: oltp_point_select - 1svt-av1: Preset 13 - Bosphorus 4Kospray: particle_volume/pathtracer/real_timetidb: oltp_update_non_index - 1hadoop: Create - 50 - 1000000hadoop: Delete - 50 - 100000tidb: oltp_read_write - 1tidb: oltp_update_index - 1svt-av1: Preset 12 - Bosphorus 1080ponednn: IP Shapes 3D - f32 - CPUtidb: oltp_update_non_index - 32liquid-dsp: 32 - 256 - 57tidb: oltp_update_index - 16tidb: oltp_point_select - 16easywave: e2Asean Grid + BengkuluSept2007 Source - 240hadoop: Delete - 100 - 1000000tidb: oltp_read_write - 16tidb: oltp_update_non_index - 16hadoop: Rename - 100 - 1000000hadoop: Rename - 50 - 100000svt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 4 - Bosphorus 4Khadoop: Delete - 50 - 1000000hadoop: Rename - 100 - 100000liquid-dsp: 2 - 256 - 512hadoop: Rename - 50 - 1000000nekrs: Kershawnekrs: TurboPipe Periodicsvt-av1: Preset 4 - Bosphorus 1080pliquid-dsp: 1 - 256 - 512liquid-dsp: 1 - 256 - 57deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamliquid-dsp: 2 - 256 - 32liquid-dsp: 32 - 256 - 32liquid-dsp: 8 - 256 - 512liquid-dsp: 2 - 256 - 57liquid-dsp: 4 - 256 - 512liquid-dsp: 1 - 256 - 32liquid-dsp: 16 - 256 - 512liquid-dsp: 8 - 256 - 32liquid-dsp: 16 - 256 - 32liquid-dsp: 4 - 256 - 32openvino: Age Gender Recognition Retail 0013 FP16 - CPUliquid-dsp: 16 - 256 - 57openvino: Handwritten English Recognition FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamliquid-dsp: 8 - 256 - 57openvino: Face Detection Retail FP16-INT8 - CPUdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16-INT8 - CPUliquid-dsp: 4 - 256 - 57openvino: Handwritten English Recognition FP16 - CPUdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamquantlib: Multi-Threadedquantlib: Single-Threadeddeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamopenradioss: Bumper Beamabcdefghij217391321533211261265137.01141244.6949.325839.4951218.146439.4391489.1203485.6725215.6383718.9189158.924322.25051560.0330.415776.9415.98615.95282945.26201.3925300580000068.598856.011417.070680.549837.5866.4226.2120606.3833.2286884.64283.9726.885983804282.55254.88672.463577216254.9017317.222033.170.861.8413.87391.8314.236956.087111.02476577571164000016.346815.105117732873.2460.144953.57332454.0956.485367.337852910126.9850209085882.91842.9112.3129466522559800000748.446225600002207700000393.627.3541886792213.9442.4442.2416.34642016851546419944000005.8937.87909085757407334.17461452480952.035897446082914.234.885110542581000016.02127567159242412812708790.8114364987566163.459104627510.361183614331163.013215.0961328536659107525401212422.994287351192100000125589011438331180957307870522141.2195.2039893275529279010007323911106900000676771000012.477139090005940100035.62877181000118350000010987000011749000052911000394990002160800003075400005942300001538500000.5469974000038.516.90743694300004.864.6508347.66128.2819622000030.72118.750916.26150.5897485.71750.3433.341274.3211605.0388605.75849.3653109.802749.0092111.0131194174817382210204085138.83411239.6749.166639.4681219.526339.4539489.4464488.1264215.9254717.9693159.0596321.18291546.0230.445780.4415.978515.98882986.46201.2528299540000068.661756.061403.06580.769849.0766.6426.24120728.2233.1787359.23284.9928.65210863284.22255.3672.373476851755.3925317.282028.010.861.8413.76661.8314.178356.455111.31849570971814000016.436514.460586982880.5859.912453.81352450.2656.690267.195186206929.4607611975836.27854.5112.1005959472571100000750.496109500002212100000393.2327.241161970213.6242.242.0916.79140485845871620019000005.9137.798018389099374254.16444372566612.056152046948414.034.8942962000015.9813080215972839759274642437191.3224128890827166.378106180542.611178174405166.692214.074131252119738012510427.686289141214200000675158671536950180687212973046138.3385.1499731469348277360007167911240300000675736000012.591140210005929600035.642277019000119030000010808000011401000055588000394860002161500003051100006024700001536900000.5469276000038.6617.06693669300004.854.6476347.21898.2719659000031118.948216.02150.6055487.35990.3433.379874.5553605.7307606.669349.1082109.233248.9703110.91522842521858746839955153.66441237.2947.153539.4464218.516239.4183487.0522489.1106215.647716.1404164.6131321.50821551.6330.435802.6515.987215.97782987.33201.5402299980000068.628756.021418.904180.419845.2766.7226.12123484.2833.0386789.8284.3127.490850157282.67254.72671.255476252955.4037317.332029.790.871.8213.83171.8314.139956.807811.3273597771503000016.53514.8082733652881.1459.792953.69272455.5156.932767.503865789527.0602350795840.53849.312.0409178772564900000757.386226300002206800000393.3727.4081893939213.7942.4342.1916.24340322672992720103000005.937.7978469350754.16440012704802.055963040160614.124.885286542440000015.8314996239106265462332490.4174393773475163.055516.906175654471161.495214.1361381522609058024851189431.8951254800000126816540697031373686682777101143.5455.0499014767159282270007463810826700000675417000012.617142250005751900035.682576924000118480000010914000011855000055165000394530002149100003067600006036500001536700000.5467493000038.7516.88633669900004.864.6348347.37288.2419451000030.89118.780116.02145.2562507.47860.3433.463774.5031605.9183605.876549.0173109.584749.2055111.025181818212484392783191599.2079395.6616.164813.069472.45513.1312163.5559162.850271.9189240.55290.65225955.6132108.909532.5910.472013.775.574695.570011039.6171.137106520000024.483320.03508.087224.153540.88182.997244958.0790.0332002.62106.971.614294327107.02670.87257.272829806421.4811124.12797.640.340.725.453290.725.6074722.58526.7364141182862500006.5874535.5716849081175.6724.687222.26141036.9923.873328.364363291162.4417495852564.78370.5727.3309855881120800000344.672829200001.037491059500000761.591.5582422.39220.6039555.17321.8943600601398.5223.353122.351724.84574.7127.74383.3778274.810.8478050.720.341910.7248730.7615291012.133325917161.9137410933000001.3378910.0164.415533459727579713.059916.79712961643.991641.921642.511978661.028753.114697757803521.577.727376000023.21156752.49408129492849.16334224838.516847.3824099450038.105211080.62823666.9885861798.98105708163.18998149604.986176125898161.854151.9051693721341010101479526.2161.25758262731035000000126221.65711261336480185638120882372118.9464.10711101282102246270008392110318900000793457000010.91126830005266500031.05256705400010471000009959400010565000050258000352280001938500002780300005453600001386000000.4968915000040.415.72463633100004.514.996325.87637.9318893000030.02112.249915.363.81576143.7643493.5960.3533.224273.3058606.101606.577349.0863110.111448.8729111.108132092412048192510041599.1543432.3216.139212.943372.657113.1187162.9298163.136171.9146240.23490.6576155.4634109.0938530.9910.472007.535.541075.563531039.8271.2727106510000024.472520511.4098224.13544.18182.5671.4444933.2790.3132032.06107.2470.189028506107.27670.64257.89429612521.4357123.61793.750.340.725.461530.725.620422.569426.7991434462858800006.582735.0301348891174.624.734322.15771028.6423.939328.314138910562.3251468282562.54373.6427.4598213081117800000342.812818300001.144321057500000761.161.5491122.34220.57579455.09321.9909235627398.9123.528322.291124.828274.527.82933.3843674.540.8444340.720.341900.7248730.8452949852.12576134971.9178110954000001.3386110.0664.685389360145588243.06376.8700571643.9716411639.361957981.054253.114673755248621.47.774213827348000023.321186572.56522129904851.6593388124611849.712841.07823624390038.067212710.63397567.7215861799.41598039162.60896907597.011171175976162.051151.50617087089710060432091490525.1731.2804326285103200000012567702501.65411322536784185578436082237119.3074.11411332783822252070008404110264000000793101000010.984123660005282700030.98676884600010466000009700500010548000050380000353150001960400002777800005451400001386200000.4969292000036.9815.62453579900004.514.9859325.74167.9619123000030.1112.057415.363.84421144.1013494.25750.3533.262573.2609607.913606.75549.0094109.965449.0598111.08881795332130378112210011600.5275431.9416.130713.085372.573613.0934162.8976162.929471.9401240.16420.65318255.5428109.09533.7410.482004.765.57325.555811038.4771.044106530000024.523820.01508.2088223.953548.78181.771.9644968.4390.2631951.64106.7670.542255905107.39667.87257.504629560321.5913124.3791.740.340.725.452270.725.6145422.656626.8731684552859200006.5956335.5350730011180.8524.704722.1491041.8723.935428.323770922061.2817691242539.97369.2626.9737573951120500000343.492830300001.001361057100000760.571.5728222.44070.60083455.14821.77461964637399.2423.504222.267624.88774.4327.8263.3795674.870.8506910.720.341910.7248830.7255235602.130624784691.9142210946000001.3418310.0964.315495660310593823.056746.76705371642.351636.761636.441962871.061443.144714157803521.657.674142427339000023.281190922.49714130389849.3443447024830851.494845.30823659100038.015210670.63032567.3935834397.98799404161.84797368585.3685954160.798151.781697699209699332181483521.5181.2065326695102460000012692701051.657110803361258581581633118.4864.1381111987949125199000825019976450000795579000010.736126810005287900031.02926886100010419000009944100010574000049977000352710001945000002763900005450200001385800000.4969334000037.0115.7213504500004.54.9877324.95687.9718988000029.95112.41315.383.81823143.6922494.22110.3533.275173.2163607.8171606.785249.0712110.000149.0714110.8852203666011074206540221602.5221432.216.067213.07372.687913.0596163.2282162.993771.9003239.51760.647755.4264109.2191538.0110.482006.095.575535.565391039.3770.9275106570000024.460720.05509.139224.123533.64183.2972.0145097.9990.6332008.03107.2469.955609165107.04669.09257.280829552221.5847123.41793.90.340.725.477250.725.6227822.774527.6966313712865300006.6008535.3786000211175.5824.819322.19011031.623.879628.479356179862.8109243762557.66372.2627.7464751621118200000341.362817300001.127231056200000759.921.5511822.42150.6123255.17221.83052049180398.1323.709122.255924.961974.7127.913.3815674.580.8434920.720.341910.7248930.754608292.118134878051.9127410993000001.3356410.0664.775530159944589283.054586.79709221641.41637.371631.991970921.045673.124699354644821.477.744169527407000023.421185492.51441837.5953410724574848.032847.41723717570037.950.62910867.8116068097.529102564160.32296840586.74817135161.324151.68117057270610395031951481528.5331.27918103340000012627699231.64811389536088187358576382237118.4814.14311082880386227270008481010500600000796491000011.016122560005285400031.057468678000104710000010017000010480000049556000352360001946700002774100005430500001384600000.4968207000036.9815.68923578100004.524.9787325.50757.9619075000029.72112.477915.373.82381144.1053495.60330.3533.367473.1867607.1628608.716349.0259109.903748.9837110.975942643932372912330463324.8182810.7132.004225.7096145.477825.7916326.9271327.0192144.1181488.06480.892701109.0251216.23841034.3519.823780.810.798810.78321963.9136.9614206830000047.132337.821003.5171119.36653.8699.5438.468931.3549.159615.88196.0740.329363428197.94352.4507.63457250042.8932234.181481.710.651.3810.59131.3710.852445.475715.03269371151970000012.543819.9615193482252.748.118843.50562180.8346.378554.388892592636.4458715834803.65710.6915.9894919481995500000643.85120200002.09882057500000804.580.77854345.190.3024633.94543.57212352941421.845.923443.844648.906880.7754.22031.7338181.580.4400061.380.653631.3792620.4425263161.147495952381.04119168000000.73446110.7868.2795579104180604961.78177.0973611987.837986.958993.5643245750.704553.327548664516122.57.336581639168000024.841.74203200327568.7475119137126564.12568.64935480800026.106313320.42642699.0995872068.573105263230.026138538726.889242866125223.416192.64518617341110040234801666580.1630.92628336041135290000016965872181.28411178247576237948431083056151.4375.0751134047980825648000851219145900000676127000012.23129090005144300031.489672468000117240000010444000010528000052890000371450002075900002926200005858500001458200000.5374142000039.4415.92493783300004.84.8005337.95688.4620093000030.92116.506416.273.72247146.1191495.22370.3532.752673.8802613.0546613.163948.8812109.792248.8889116781.53357.9110.810819305023829952536783327.1891815.1331.958625.6331145.647425.704326.7757327.7314144.0005486.70681.9419109.4649216.21631036.1119.833777.7510.74310.79041964.61136.684206990000047.349737.57999.4619119.426646.9199.3538.5768945.3248.6959654.98197.6639.833589788193.8351.66508.360457045843.2681233.651488.040.651.3810.58481.3710.882945.400615.19244731852014000012.498719.6196372652264.9348.190843.57362224.0846.363354.506386956537.5052638494848.42709.7315.5902378591997000000642.95123100001.243082052600000804.750.7985445.71060.30153533.86943.81162506266425.6846.087243.767448.71882.4954.18771.7349980.880.4403681.380.653631.3792220.3025555561.150128474581.0431218997000000.73509410.7468.4294261104620590321.788767.0572010985.743991.073987.3553181090.6442523.297525458139522.537.1839320000024.871801791.64478198137564.4545034636141566.178563.33435015120026.393305220.42751298.5735899768.236102041227.865138173728.538237736165227.205192.418487246410224934851656591.3190.93179335650139410000016817864711.28811469247501235418521590827149.0515.0791104368237225910000863119269890000676807000012.259133630005584100031.441172491000117290000010478000010970000052129000371410002097200002924300005838700001459200000.5373580000039.2315.98953772500004.814.8015336.76738.4619864000030.87116.890816.273.65907145.8325494.49530.3532.835473.9404612.9837613.640248.7901109.736348.89281171993365.4110.9833194174828910112515643324.6952812.7632.063925.727145.372625.769326.904327.1855144.0515487.22980.880016109.4068216.5081012.9819.843783.6510.693210.76641964.71136.5656207100000047.333937.481002.8113119.046638.2499.2938.5168895.548.8259505.78196.2639.867423777194.82351.38507.364556906643.3141233.881483.250.651.3810.5741.3710.874345.322715.09991232651944000012.510419.7255866632254.7248.095643.41612194.3646.432754.515775188037.8081130344892.27709.7515.8438953171999500000648.275110700001.949412056500000805.380.76831445.39560.30927833.93443.9335558036425.8846.023243.904348.711582.0954.14731.7350181.50.4401561.380.653631.3792220.363703701.155786849321.0433319223000000.73161810.7768.35105802580051.786917.0872754991.123988.589994.6123164850.714973.267425261728422.537.286406639327000024.671805811.75453197738563.5755030436644569.795566.38634901980025.555306380.4302799.3455934768.51997371224.406137618726.50324366228.765192.701731539560234791660584.120.93600135655136980000016972874121.24511069347414235438716189206149.4515.161135728347226378000885509242080000683536000012.175128990005571500031.502472400000116990000010422000011137000049781000371200002094900002924900005856700001457400000.5373712000039.3415.93893816600004.814.8016336.6758.4520012000031.57116.846416.273.68087145.9015494.00760.3532.808573.777614.2303612.520948.8291109.857348.8934117263.33371.6110.9038OpenBenchmarking.org

Apache Hadoop

Operation: File Status - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 50 - Files: 1000000agjbidfhec500K1000K1500K2000K2500K2173913203666019417481941748193050218181821795332426439320924284252

Apache Hadoop

Operation: Open - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 1000000fdegihjacb300K600K900K1200K1500K1303781124843912048191107420382995323729289101215332185874173822

Apache Hadoop

Operation: Open - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 1000000jhfabcgdie300K600K900K1200K1500K12515641233046122100111261261020408683995654022278319253678251004

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamcbaihjgfde110022003300440055005153.665138.835137.013327.193324.823324.701602.521600.531599.211599.15

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcijhegfd300600900120015001244.691239.671237.29815.13812.76810.71432.32432.20431.94395.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabcjhidefg112233445549.3349.1747.1532.0632.0031.9616.1616.1416.1316.07

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcjhifgde91827364539.5039.4739.4525.7325.7125.6313.0913.0713.0712.94

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streambcaihjgefd50100150200250219.53218.52218.15145.65145.48145.3772.6972.6672.5772.46

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streambachjidefg91827364539.4539.4439.4225.7925.7725.7013.1313.1213.0913.06

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streambachjidgef110220330440550489.45489.12487.05326.93326.90326.78163.56163.23162.93162.90

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamcbaijhegfd110220330440550489.11488.13485.67327.73327.19327.02163.14162.99162.93162.85

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streambcahjifdeg50100150200250215.93215.65215.64144.12144.05144.0071.9471.9271.9171.90

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamabchjidefg160320480640800718.92717.97716.14488.06487.23486.71240.55240.23240.16239.52

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUgdfejhi0.43690.87381.31071.74762.18450.6477000.6522590.6531820.6576100.8800160.8927011.941900MIN: 0.57MIN: 0.57MIN: 0.57MIN: 0.57MIN: 0.78MIN: 0.79MIN: 0.871. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamcbaijhdfeg4080120160200164.61159.06158.92109.46109.41109.0355.6155.5455.4655.43

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamacbjhigefd70140210280350322.25321.51321.18216.51216.24216.22109.22109.09109.09108.91

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUacbihjgfde300600900120015001560.031551.631546.021036.111034.351012.98538.01533.74532.59530.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUbcajihgfed71421283530.4430.4330.4119.8419.8319.8210.4810.4810.4710.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUcbajhidegf120024003600480060005802.655780.445776.943783.653780.803777.752013.772007.532006.092004.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timecabhijgdfe4812162015.9872015.9860015.9785010.7988010.7430010.693205.575535.574695.573205.54107

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timebcaihjdgef4812162015.9888015.9778015.9528010.7904010.7832010.766405.570015.565395.563535.55581

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUcbajihedgf60012001800240030002987.332986.462945.261964.711964.611963.901039.821039.611039.371038.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamcabhijedfg4080120160200201.54201.39201.25136.96136.68136.5771.2771.1471.0470.93

Liquid-DSP

Threads: 96 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 32acbjihgfde600M1200M1800M2400M3000M30058000002999800000299540000020710000002069900000206830000010657000001065300000106520000010651000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streambcaijhfdeg153045607568.6668.6368.6047.3547.3347.1324.5224.4824.4724.46

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUbcahijgdfe132639526556.0656.0256.0137.8237.5737.4820.0520.0320.0120.001. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamcabhjiegfd300600900120015001418.901417.071403.071003.521002.81999.46511.41509.14508.21508.09

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Pabellon Barcelona - Compute: CPU-Onlycabjhifegd5010015020025080.4180.5480.76119.04119.30119.42223.95224.10224.12224.15

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUbcahijfedg2K4K6K8K10K9849.079845.279837.586653.866646.916638.243548.783544.183540.883533.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Classroom - Compute: CPU-Onlyabcjihfedg408012016020066.4266.6466.7299.2999.3599.54181.70182.56182.99183.29

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: BMW27 - Compute: CPU-Onlycabhjiefdg163248648026.1226.2026.2438.4038.5138.5771.4471.9672.0072.01

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUcbaihjgfde30K60K90K120K150K123484.28120728.22120606.3868945.3268931.3568895.5045097.9944968.4344958.0744933.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Fishy Cat - Compute: CPU-Onlycbaijhdfeg2040608010033.0333.1733.2248.6948.8249.1090.0390.2690.3190.63

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUbacihjegdf20K40K60K80K100K87359.2386884.6486789.8059654.9859615.8859505.7832032.0632008.0332002.6231951.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUbcaijhgedf60120180240300284.99284.31283.97197.66196.26196.07107.24107.24106.90106.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

SPECFEM3D

Model: Layered Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Layered Halfspaceacbijhgefd163248648026.8927.4928.6539.8339.8740.3369.9670.1970.5471.611. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUbcahjifegd60120180240300284.22282.67282.55197.94194.82193.80107.39107.27107.04107.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.6Blend File: Barbershop - Compute: CPU-Onlycabjihfged140280420560700254.72254.88255.30351.38351.66352.40667.87669.09670.64670.87

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamabcihjefgd150300450600750672.46672.37671.26508.36507.63507.36257.89257.50257.28257.27

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metricabchijdefg170K340K510K680K850K7721627685177625295725005704585690662980642961252956032955221. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Crowncbajihfgde122436486055.4055.3954.9043.3143.2742.8921.5921.5821.4821.44MIN: 53.71 / MAX: 58.99MIN: 54.02 / MAX: 57.64MIN: 53.27 / MAX: 57.28MIN: 42.83 / MAX: 44.44MIN: 42.82 / MAX: 44.23MIN: 42.47 / MAX: 43.88MIN: 21.45 / MAX: 21.84MIN: 21.43 / MAX: 21.89MIN: 21.32 / MAX: 21.8MIN: 21.3 / MAX: 21.78

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUcbahjifdeg70140210280350317.33317.28317.22234.18233.88233.65124.30124.12123.61123.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUacbijhdgef4008001200160020002033.172029.792028.011488.041483.251481.71797.64793.90793.75791.741. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlycbajihgfed0.19580.39160.58740.78320.9790.870.860.860.650.650.650.340.340.340.34

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlybacjihgfed0.4140.8281.2421.6562.071.841.841.821.381.381.380.720.720.720.72

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeacbhijgedf4812162013.8739013.8317013.7666010.5913010.5848010.574005.477255.461535.453295.45227

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.0Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlycbajihgfed0.41180.82361.23541.64722.0591.831.831.831.371.371.370.720.720.720.72

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeabcijhgefd4812162014.2369014.1783014.1399010.8829010.8743010.852405.622785.620405.614545.60747

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Crowncbahijgfde132639526556.8156.4656.0945.4845.4045.3222.7722.6622.5922.57MIN: 55.27 / MAX: 59.91MIN: 54.53 / MAX: 59.89MIN: 54.05 / MAX: 59.82MIN: 44.92 / MAX: 46.64MIN: 44.87 / MAX: 46.45MIN: 44.74 / MAX: 46.66MIN: 22.57 / MAX: 23.16MIN: 22.45 / MAX: 22.99MIN: 22.39 / MAX: 22.98MIN: 22.39 / MAX: 22.93

SPECFEM3D

Model: Mount St. Helens

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Mount St. Helensabchjidefg71421283511.0211.3211.3315.0315.1015.1926.7426.8026.8727.701. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Liquid-DSP

Threads: 96 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 512bcaihjgdfe150M300M450M600M750M7181400007150300007116400005201400005197000005194400002865300002862500002859200002858800001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timecbahjigfde4812162016.5350016.4365016.3468012.5438012.5104012.498706.600856.595636.587456.58270

SPECFEM3D

Model: Homogeneous Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Homogeneous Halfspacebcaijhegfd81624324014.4614.8115.1119.6219.7319.9635.0335.3835.5435.571. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUcbaijhfdge60012001800240030002881.142880.582873.242264.932254.722252.701180.851175.671175.581174.601. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragonabcihjgefd132639526560.1459.9159.7948.1948.1248.1024.8224.7324.7024.69MIN: 58.97 / MAX: 62MIN: 58.66 / MAX: 61.96MIN: 58.46 / MAX: 62.03MIN: 47.96 / MAX: 48.63MIN: 47.91 / MAX: 48.91MIN: 47.86 / MAX: 48.8MIN: 24.74 / MAX: 25MIN: 24.67 / MAX: 24.86MIN: 24.63 / MAX: 24.84MIN: 24.62 / MAX: 24.84

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer - Model: Asian Dragon Objbcaihjdgef122436486053.8153.6953.5743.5743.5143.4222.2622.1922.1622.15MIN: 52.72 / MAX: 55.86MIN: 52.63 / MAX: 55.24MIN: 52.17 / MAX: 55.38MIN: 43.34 / MAX: 44.03MIN: 43.26 / MAX: 44.02MIN: 43.14 / MAX: 43.89MIN: 22.18 / MAX: 22.42MIN: 22.12 / MAX: 22.33MIN: 22.08 / MAX: 22.35MIN: 22.07 / MAX: 22.32

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUcabijhfdge50010001500200025002455.512454.092450.262224.082194.362180.831041.871036.991031.601028.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragon Objcbajhiefgd132639526556.9356.6956.4946.4346.3846.3623.9423.9423.8823.87MIN: 55.56 / MAX: 59.67MIN: 55.42 / MAX: 58.97MIN: 55.29 / MAX: 58.38MIN: 46.17 / MAX: 47.23MIN: 46.09 / MAX: 47.08MIN: 46.13 / MAX: 46.98MIN: 23.84 / MAX: 24.18MIN: 23.84 / MAX: 24.16MIN: 23.79 / MAX: 24.08MIN: 23.78 / MAX: 24.08

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.1Binary: Pathtracer ISPC - Model: Asian Dragoncabjihgdfe153045607567.5067.3467.2054.5254.5154.3928.4828.3628.3228.31MIN: 65.64 / MAX: 71.17MIN: 65.61 / MAX: 70.54MIN: 65.48 / MAX: 70.41MIN: 54.24 / MAX: 55.1MIN: 54.22 / MAX: 55.08MIN: 54.12 / MAX: 55.15MIN: 28.37 / MAX: 28.69MIN: 28.26 / MAX: 28.59MIN: 28.23 / MAX: 28.55MIN: 28.21 / MAX: 28.56

Apache Hadoop

Operation: File Status - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 50 - Files: 100000hibjfcdgae200K400K600K800K1000K925926869565862069751880709220657895632911561798529101389105

SPECFEM3D

Model: Water-layered Halfspace

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Water-layered Halfspaceacbhijfedg142842567026.9927.0629.4636.4537.5137.8161.2862.3362.4462.811. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUacbjihdegf130026003900520065005882.915840.535836.274892.274848.424803.652564.782562.542557.662539.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUbcahjiegdf2004006008001000854.51849.30842.91710.69709.75709.73373.64372.26370.57369.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

SPECFEM3D

Model: Tomographic Model

OpenBenchmarking.orgSeconds, Fewer Is BetterSPECFEM3D 4.0Model: Tomographic Modelcbaijhfdeg71421283512.0412.1012.3115.5915.8415.9926.9727.3327.4627.751. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi

Liquid-DSP

Threads: 96 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 96 - Buffer Length: 256 - Filter Length: 57bcajihdfge600M1200M1800M2400M3000M25711000002564900000255980000019995000001997000000199550000011208000001120500000111820000011178000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUcbajhidfeg160320480640800757.38750.49748.44648.27643.80642.90344.67343.49342.81341.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512cabihjfdeg130M260M390M520M650M6226300006225600006109500005123100005120200005110700002830300002829200002818300002817300001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUfdgeijh0.47220.94441.41661.88882.3611.001361.037491.127231.144321.243081.949412.09880MIN: 0.92MIN: 0.92MIN: 0.93MIN: 1.07MIN: 1.04MIN: 1.26MIN: 1.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32bachjidefg500M1000M1500M2000M2500M22121000002207700000220680000020575000002056500000205260000010595000001057500000105710000010562000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16 - Device: CPUbcagfedhij2004006008001000393.23393.37393.60759.92760.57761.16761.59804.58804.75805.38MIN: 360.87 / MAX: 433.13MIN: 362.57 / MAX: 433.51MIN: 363.29 / MAX: 431.61MIN: 737.63 / MAX: 771.07MIN: 741.4 / MAX: 770.88MIN: 741.99 / MAX: 776.56MIN: 738.34 / MAX: 772.36MIN: 772.52 / MAX: 820.63MIN: 776.93 / MAX: 819.19MIN: 783.22 / MAX: 819.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUjhiegdf0.35390.70781.06171.41561.76950.7683140.7785430.7985401.5491101.5511801.5582401.572820MIN: 0.71MIN: 0.71MIN: 0.7MIN: 1.51MIN: 1.52MIN: 1.51MIN: 1.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Crownijhfgde102030405045.7145.4045.1922.4422.4222.3922.34MIN: 45.11 / MAX: 47.49MIN: 44.88 / MAX: 46.68MIN: 44.65 / MAX: 46.39MIN: 22.25 / MAX: 22.78MIN: 22.22 / MAX: 22.85MIN: 22.2 / MAX: 22.85MIN: 22.15 / MAX: 22.75

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUihjefdg0.13780.27560.41340.55120.6890.3015350.3024600.3092780.5757940.6008340.6039500.612320MIN: 0.28MIN: 0.27MIN: 0.28MIN: 0.52MIN: 0.53MIN: 0.53MIN: 0.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigbacijhefgd122436486027.2427.3527.4133.8733.9333.9555.0955.1555.1755.17

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Crownjihedgf102030405043.9343.8143.5721.9921.8921.8321.77MIN: 43.46 / MAX: 45.01MIN: 43.36 / MAX: 45.05MIN: 43.11 / MAX: 44.65MIN: 21.84 / MAX: 22.32MIN: 21.74 / MAX: 22.23MIN: 21.69 / MAX: 22.17MIN: 21.63 / MAX: 22.18

Apache Hadoop

Operation: File Status - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 100 - Files: 1000000ihgfcadjeb500K1000K1500K2000K2500K250626623529412049180196463718939391886792600601558036235627161970

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection FP16-INT8 - Device: CPUbcagdefhij90180270360450213.62213.79213.94398.13398.52398.91399.24421.80425.68425.88MIN: 197.2 / MAX: 235.23MIN: 197.29 / MAX: 236.32MIN: 201.64 / MAX: 242.71MIN: 379.09 / MAX: 404.71MIN: 382.1 / MAX: 404.98MIN: 386.2 / MAX: 407.29MIN: 387.9 / MAX: 408.93MIN: 269.94 / MAX: 598.22MIN: 402.91 / MAX: 432.03MIN: 404.76 / MAX: 434.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon Objijhgefd102030405046.0946.0245.9223.7123.5323.5023.35MIN: 45.82 / MAX: 46.6MIN: 45.75 / MAX: 46.57MIN: 45.64 / MAX: 46.53MIN: 23.61 / MAX: 23.93MIN: 23.43 / MAX: 23.73MIN: 23.4 / MAX: 23.74MIN: 23.26 / MAX: 23.57

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon Objjhidefg102030405043.9043.8443.7722.3522.2922.2722.26MIN: 43.66 / MAX: 44.27MIN: 43.64 / MAX: 44.38MIN: 43.51 / MAX: 44.16MIN: 22.28 / MAX: 22.5MIN: 22.22 / MAX: 22.46MIN: 22.2 / MAX: 22.44MIN: 22.18 / MAX: 22.43

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragonhijgfde112233445548.9148.7248.7124.9624.8924.8524.83MIN: 48.64 / MAX: 49.47MIN: 48.48 / MAX: 49.3MIN: 48.45 / MAX: 49.47MIN: 24.9 / MAX: 25.13MIN: 24.81 / MAX: 25.06MIN: 24.78 / MAX: 25MIN: 24.76 / MAX: 24.96

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP16 - Device: CPUbcafedghji2040608010042.2042.4342.4474.4374.5074.7174.7180.7782.0982.49MIN: 36.84 / MAX: 61.97MIN: 36.31 / MAX: 62.36MIN: 36.14 / MAX: 61.98MIN: 65.68 / MAX: 83.49MIN: 66.5 / MAX: 80.32MIN: 66.12 / MAX: 81.09MIN: 66.29 / MAX: 79.68MIN: 69.54 / MAX: 95.42MIN: 68.73 / MAX: 91.87MIN: 70.77 / MAX: 94.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragonhijgefd122436486054.2254.1954.1527.9127.8327.8327.74MIN: 53.93 / MAX: 54.77MIN: 53.91 / MAX: 54.97MIN: 53.87 / MAX: 54.79MIN: 27.81 / MAX: 28.17MIN: 27.72 / MAX: 28.1MIN: 27.73 / MAX: 28.13MIN: 27.64 / MAX: 27.98

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUhijdfge0.76151.5232.28453.0463.80751.733811.734991.735013.377823.379563.381563.38436MIN: 1.64MIN: 1.65MIN: 1.64MIN: 3.33MIN: 3.33MIN: 3.33MIN: 3.331. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Detection FP32 - Device: CPUbcaegdfijh2040608010042.0942.1942.2474.5474.5874.8174.8780.8881.5081.58MIN: 37.13 / MAX: 58.71MIN: 36.21 / MAX: 65.64MIN: 36.59 / MAX: 61.56MIN: 65.97 / MAX: 82.9MIN: 67.63 / MAX: 78.73MIN: 66.88 / MAX: 80.7MIN: 66.72 / MAX: 80.96MIN: 39.72 / MAX: 92.54MIN: 68.9 / MAX: 92.66MIN: 68.74 / MAX: 95.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUhjigedf0.19140.38280.57420.76560.9570.4400060.4401560.4403680.8434920.8444340.8478050.850691MIN: 0.41MIN: 0.41MIN: 0.41MIN: 0.83MIN: 0.83MIN: 0.83MIN: 0.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlyjihgfed0.31050.6210.93151.2421.55251.381.381.380.720.720.720.72

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlyjihgfed0.14630.29260.43890.58520.73150.650.650.650.340.340.340.34

OpenVKL

Benchmark: vklBenchmarkCPU Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU Scalarjihgfde80160240320400363363363191191191190MIN: 24 / MAX: 6613MIN: 24 / MAX: 6577MIN: 24 / MAX: 6610MIN: 13 / MAX: 3483MIN: 13 / MAX: 3484MIN: 13 / MAX: 3471MIN: 13 / MAX: 3484

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlyjihgfed0.30830.61660.92491.23321.54151.371.371.370.720.720.720.72

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPChjigfed2004006008001000926922922489488487487MIN: 67 / MAX: 12416MIN: 67 / MAX: 12356MIN: 67 / MAX: 12374MIN: 36 / MAX: 6969MIN: 36 / MAX: 6952MIN: 36 / MAX: 6956MIN: 36 / MAX: 6949

Remhos

Test: Sample Remap Example

OpenBenchmarking.orgSeconds, Fewer Is BetterRemhos 1.0Test: Sample Remap Examplecabijhfgde71421283516.2416.3516.7920.3020.3620.4430.7330.7530.7630.851. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi

Apache Hadoop

Operation: Open - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 100 - Files: 100000idhfgabcje120K240K360K480K600K555556529101526316523560460829420168404858403226370370294985

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUhijgefd0.480.961.441.922.41.147491.150121.155782.118132.125702.130622.13332MIN: 1.01MIN: 1MIN: 1.03MIN: 1.99MIN: 2.01MIN: 1.97MIN: 21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Apache Hadoop

Operation: File Status - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: File Status - Threads: 100 - Files: 100000icjehdagfb200K400K600K800K1000K847458729927684932613497595238591716515464487805478469458716

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUhijgdfe0.43150.8631.29451.7262.15751.041001.043121.043331.912741.913741.914221.91781MIN: 0.94MIN: 0.94MIN: 0.94MIN: 1.88MIN: 1.88MIN: 1.88MIN: 1.881. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57cbajhigefd400M800M1200M1600M2000M20103000002001900000199440000019223000001916800000189970000010993000001095400000109460000010933000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUjhigdef0.30190.60380.90571.20761.50950.7316180.7344610.7350941.3356401.3378901.3386101.341830MIN: 0.66MIN: 0.66MIN: 0.66MIN: 1.31MIN: 1.31MIN: 1.31MIN: 1.311. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16 - Device: CPUacbdegfijh36912155.895.905.9110.0110.0610.0610.0910.7410.7710.78MIN: 4.67 / MAX: 18.4MIN: 4.83 / MAX: 13.4MIN: 4.84 / MAX: 12.9MIN: 5.7 / MAX: 19.52MIN: 5.29 / MAX: 19.07MIN: 5.2 / MAX: 19.38MIN: 5.4 / MAX: 19.17MIN: 5.92 / MAX: 24.44MIN: 6 / MAX: 18.16MIN: 5.59 / MAX: 21.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Machine Translation EN To DE FP16 - Device: CPUbcafdeghji153045607537.7937.7937.8064.3164.4164.6864.7768.2768.3568.42MIN: 32.97 / MAX: 53.7MIN: 33.29 / MAX: 54.88MIN: 33.35 / MAX: 56.45MIN: 50.85 / MAX: 70.77MIN: 37.44 / MAX: 73.04MIN: 38.02 / MAX: 72.52MIN: 55.8 / MAX: 69.46MIN: 56.41 / MAX: 79.96MIN: 55.82 / MAX: 74.84MIN: 56.13 / MAX: 75.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

TiDB Community Server

Test: oltp_read_write - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 64hibacdgfe20K40K60K80K100K955799426180183790907846955334553015495653893

TiDB Community Server

Test: oltp_read_write - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 128jihbafegd20K40K60K80K100K105802104620104180890998575760310601455994459727

Apache Hadoop

Operation: Create - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 100 - Files: 100000hfigejdabc13K26K39K52K65K60496593825903258928588245800557971407333742535075

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUhjigfde0.68931.37862.06792.75723.44651.781701.786911.788763.054583.056743.059913.06370MIN: 1.64MIN: 1.66MIN: 1.65MIN: 2.97MIN: 2.97MIN: 2.96MIN: 2.971. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Vehicle Detection FP16-INT8 - Device: CPUbcafdgeijh2468104.164.164.176.766.796.796.807.057.087.09MIN: 3.42 / MAX: 11.2MIN: 3.43 / MAX: 10.26MIN: 3.39 / MAX: 10.07MIN: 4.04 / MAX: 15.47MIN: 3.8 / MAX: 15.48MIN: 3.79 / MAX: 15.41MIN: 4.04 / MAX: 15.37MIN: 4.44 / MAX: 16.57MIN: 4.35 / MAX: 16.86MIN: 4.43 / MAX: 16.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Apache Hadoop

Operation: Create - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 100 - Files: 1000000hjidgfeabc16K32K48K64K80K73611727547201071296709227053770057461454443744001

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUihjgfed400800120016002000985.74987.84991.121641.401642.351643.971643.99MIN: 949.93MIN: 952.67MIN: 954.92MIN: 1589.91MIN: 1586.17MIN: 1590.89MIN: 1588.031. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUhjifged400800120016002000986.96988.59991.071636.761637.371641.001641.92MIN: 949.02MIN: 950.96MIN: 953.96MIN: 1585.98MIN: 1584.58MIN: 1595.55MIN: 1584.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUihjgfed400800120016002000987.36993.56994.611631.991636.441639.361642.51MIN: 952.16MIN: 955.42MIN: 960.2MIN: 1581.62MIN: 1585.81MIN: 1581.93MIN: 1593.161. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writeshijcbadgfe70K140K210K280K350K324575318109316485270480256661248095197866197092196287195798

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUihjdgef0.23880.47760.71640.95521.1940.6442520.7045500.7149701.0287501.0456701.0542501.061440MIN: 0.61MIN: 0.66MIN: 0.67MIN: 0.96MIN: 0.98MIN: 0.97MIN: 0.981. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16 - Device: CPUabcdegfjih0.7471.4942.2412.9883.7352.032.052.053.113.113.123.143.263.293.32MIN: 1.66 / MAX: 7.51MIN: 1.6 / MAX: 7MIN: 1.62 / MAX: 6.96MIN: 1.94 / MAX: 11.57MIN: 1.93 / MAX: 9.72MIN: 1.88 / MAX: 11.92MIN: 1.93 / MAX: 11.65MIN: 2.1 / MAX: 14.3MIN: 1.89 / MAX: 12.75MIN: 2.11 / MAX: 12.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

TiDB Community Server

Test: oltp_read_write - Threads: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 32hijbcafgde16K32K48K64K80K75486752547425261520596305897447141469934697746737

Apache Hadoop

Operation: Open - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Open - Threads: 50 - Files: 100000hjifdegbac140K280K420K560K700K645161617284581395578035578035552486546448469484460829401606

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16-INT8 - Device: CPUbcaegdfhij51015202514.0314.1214.2321.4021.4721.5721.6522.5022.5322.53MIN: 11.59 / MAX: 26.04MIN: 11.51 / MAX: 26.04MIN: 11.51 / MAX: 25.86MIN: 19.07 / MAX: 25.3MIN: 17.62 / MAX: 28.13MIN: 19.5 / MAX: 24.76MIN: 19.48 / MAX: 24.27MIN: 13.76 / MAX: 30.22MIN: 19.09 / MAX: 30.15MIN: 18.74 / MAX: 31.081. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Person Vehicle Bike Detection FP16 - Device: CPUacbijhfdge2468104.884.884.897.187.287.337.677.707.747.77MIN: 3.95 / MAX: 16.05MIN: 3.9 / MAX: 14.94MIN: 3.93 / MAX: 13.44MIN: 4.98 / MAX: 16.11MIN: 5.53 / MAX: 15.78MIN: 5.45 / MAX: 15.94MIN: 5.32 / MAX: 16.6MIN: 5.51 / MAX: 16.06MIN: 6.06 / MAX: 12.66MIN: 5.42 / MAX: 16.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

TiDB Community Server

Test: oltp_update_non_index - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 128hjcaegf14K28K42K56K70K65816640665286551105421384169541424

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 512bacjihgdef90M180M270M360M450M4296200004258100004244000003932700003932000003916800002740700002737600002734800002733900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Road Segmentation ADAS FP16 - Device: CPUcbadfegjhi61218243015.8315.9816.0223.2023.2823.3223.4224.6724.8424.87MIN: 12.38 / MAX: 32.97MIN: 12.74 / MAX: 33.34MIN: 12.5 / MAX: 33.94MIN: 15.1 / MAX: 31.6MIN: 15.73 / MAX: 30.77MIN: 19.49 / MAX: 30.99MIN: 20.46 / MAX: 32.43MIN: 20.15 / MAX: 37.89MIN: 16.93 / MAX: 33.96MIN: 17 / MAX: 33.341. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

TiDB Community Server

Test: oltp_point_select - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 64jibafegd40K80K120K160K200K180581180179130802127567119092118657118549115675

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUihjdfge0.57721.15441.73162.30882.8861.644781.742031.754532.494082.497142.514412.56522MIN: 1.42MIN: 1.51MIN: 1.52MIN: 2.3MIN: 2.26MIN: 2.3MIN: 2.321. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

Test: oltp_point_select - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 128hijbacfed40K80K120K160K200K200327198137197738159728159242149962130389129904129492

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUjihgdfe2004006008001000563.58564.45568.75837.60849.16849.34851.66MIN: 543.65MIN: 545.57MIN: 546.79MIN: 796.61MIN: 806.44MIN: 805.8MIN: 809.451. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

Test: oltp_update_non_index - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 64hijabcfdge11K22K33K44K55K51191503465030441281397593910634470342243410733881

TiDB Community Server

Test: oltp_update_index - Threads: 128

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 128hjibacfeg8K16K24K32K40K371263664436141274642708726546248302461124574

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUhijdgef2004006008001000564.12566.18569.80838.52848.03849.71851.49MIN: 545.13MIN: 544.56MIN: 548.08MIN: 796.3MIN: 807.34MIN: 805.98MIN: 807.971. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUijhefdg2004006008001000563.33566.39568.65841.08845.31847.38847.42MIN: 544.04MIN: 542.7MIN: 547.26MIN: 798.46MIN: 803.78MIN: 806.33MIN: 806.721. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Kripke

OpenBenchmarking.orgThroughput FoM, More Is BetterKripke 1.2.6hijdgfe80M160M240M320M400M3548080003501512003490198002409945002371757002365910002362439001. (CXX) g++ options: -O3 -fopenmp -ldl

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200jhigfed91827364525.5626.1126.3937.9538.0238.0738.111. (CXX) g++ options: -O3 -fopenmp

TiDB Community Server

Test: oltp_update_index - Threads: 64

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 64hjibcedf7K14K21K28K35K3133230638305222437123324212712110821067

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUhijdgfe0.14260.28520.42780.57040.7130.4264260.4275120.4302700.6282360.6291080.6303250.633975MIN: 0.38MIN: 0.39MIN: 0.38MIN: 0.6MIN: 0.6MIN: 0.6MIN: 0.61. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 4Kjhibacgefd2040608010099.3599.1098.5791.3290.8190.4267.8167.7267.3966.991. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Apache Hadoop

Operation: Create - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 100000gjihedfcab13K26K39K52K65K60680593475899758720586175861758343439374364941288

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400ijhgfde2040608010068.2468.5268.5797.5397.9998.9899.421. (CXX) g++ options: -O3 -fopenmp

Apache Hadoop

Operation: Delete - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 100 - Files: 100000dhgifejbac20K40K60K80K100K105708105263102564102041994049803997371908278756673475

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4Khijbadcefg50100150200250230.03227.87224.41166.38163.46163.19163.06162.61161.85160.321. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TiDB Community Server

Test: oltp_point_select - Threads: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 32hijbadfeg30K60K90K120K150K13853813817313761810618010462798149973689690796840

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080pihjdegfbca160320480640800728.54726.89726.50604.99597.01586.75585.37542.61516.91510.361. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TiDB Community Server

Test: oltp_update_index - Threads: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 32jhiabdcge5K10K15K20K25K243662428623773183611781717612175651713517117

TiDB Community Server

Test: oltp_point_select - Threads: 1

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 1ihefdcba1300260039005200650061656125597659545898447144054331

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4Kjihbaedcgf50100150200250228.77227.21223.42166.69163.01162.05161.85161.50161.32160.801. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeacbjhidfge50100150200250215.10214.14214.07192.70192.65192.40151.91151.78151.68151.51

TiDB Community Server

Test: oltp_update_non_index - Threads: 1

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 1hiegfdcab400800120016002000186118481708170516971693138113281312

Apache Hadoop

Operation: Create - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 50 - Files: 1000000hjgidefacb16K32K48K64K80K73411731537270672464721347089769920536655226052119

Apache Hadoop

Operation: Delete - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 100000gidehfjacb20K40K60K80K100K1039501022491010101006041004029699395602910759058073801

TiDB Community Server

Test: oltp_read_write - Threads: 1

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 1ihjfegabc7001400210028003500348534803479321832093195254025102485

TiDB Community Server

Test: oltp_update_index - Threads: 1

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 1hjiefgdac400800120016002000166616601656149014831481147912121189

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080pijhgdefcba130260390520650591.32584.12580.16528.53526.22525.17521.52431.90427.69422.991. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUhijfdge0.28810.57620.86431.15241.44050.9262830.9317930.9360011.2065301.2575801.2791801.280430MIN: 0.85MIN: 0.86MIN: 0.86MIN: 1.18MIN: 1.21MIN: 1.24MIN: 1.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TiDB Community Server

Test: oltp_update_non_index - Threads: 32

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 32hjibafed8K16K24K32K40K3604135655356502891428735266952628526273

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 57ijhcbadgef300M600M900M1200M1500M13941000001369800000135290000012548000001214200000119210000010350000001033400000103200000010246000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

TiDB Community Server

Test: oltp_update_index - Threads: 16

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_index - Threads: 16jhifcgdea4K8K12K16K20K169721696516817126921268112627126221256712558

TiDB Community Server

Test: oltp_point_select - Threads: 16

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_point_select - Threads: 16jhiefgbc20K40K60K80K100K8741287218864717025070105699236751565406

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240jhigedf0.37280.74561.11841.49121.8641.2451.2841.2881.6481.6541.6571.6571. (CXX) g++ options: -O3 -fopenmp

Apache Hadoop

Operation: Delete - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 100 - Files: 1000000igedhfjcab20K40K60K80K100K114692113895113225112613111782110803110693970319011486715

TiDB Community Server

Test: oltp_read_write - Threads: 16

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_read_write - Threads: 16hijacbedfg10K20K30K40K50K47576475014741438331373683695036784364803612536088

TiDB Community Server

Test: oltp_update_non_index - Threads: 16

OpenBenchmarking.orgQueries Per Second, More Is BetterTiDB Community Server 7.3Test: oltp_update_non_index - Threads: 16hjigdeab5K10K15K20K25K2379423543235411873518563185571809518068

Apache Hadoop

Operation: Rename - Threads: 100 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 100 - Files: 1000000jfgiehdabc20K40K60K80K100K87161858158576385215843608431081208730787212966827

Apache Hadoop

Operation: Rename - Threads: 50 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 50 - Files: 100000ijhdgefcba20K40K60K80K100K90827892068305682372822378223781633771017304670522

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 1080phjicabedfg306090120150151.44149.45149.05143.55141.22138.34119.31118.95118.49118.481. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4Kajbihcgfed1.17072.34143.51214.68285.85355.2035.1605.1495.0795.0755.0494.1434.1384.1144.1071. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Apache Hadoop

Operation: Delete - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Delete - Threads: 50 - Files: 1000000jhefdgiabc20K40K60K80K100K113572113404113327111198111012110828110436989329731490147

Apache Hadoop

Operation: Rename - Threads: 100 - Files: 100000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 100 - Files: 100000ejidghfabc20K40K60K80K100K83822834728237282102803867980879491755296934867159

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 512cabjihefdg6M12M18M24M30M282270002790100027736000263780002591000025648000252070002519900024627000227270001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Apache Hadoop

Operation: Rename - Threads: 50 - Files: 1000000

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Rename - Threads: 50 - Files: 1000000jihgedfcab20K40K60K80K100K88550863118512184810840418392182501746387323971679

nekRS

Input: Kershaw

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: Kershawbacgdefijh2000M4000M6000M8000M10000M11240300000111069000001082670000010500600000103189000001026400000099764500009269890000924208000091459000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgflops/rank, More Is BetternekRS 23.0Input: TurboPipe Periodicgfdejiahbc2000M4000M6000M8000M10000M79649100007955790000793457000079310100006835360000676807000067677100006761270000675736000067541700001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080pcbaihjgedf369121512.6212.5912.4812.2612.2312.1811.0210.9810.9110.741. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 512cbaihjdfeg3M6M9M12M15M142250001402100013909000133630001290900012899000126830001268100012366000122560001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 57abcijfgedh13M26M39M52M65M594010005929600057519000558410005571500052879000528540005282700052665000514430001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamefdgihjabc81624324030.9931.0331.0531.0631.4431.4931.5035.6335.6435.68

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 32abcihjfegd17M34M51M68M85M771810007701900076924000724910007246800072400000688610006884600068678000670540001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 32bcaihjgdef300M600M900M1200M1500M11903000001184800000118350000011729000001172400000116990000010471000001047100000104660000010419000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 512acbihjgdfe20M40M60M80M100M1098700001091400001080800001047800001044400001042200001001700009959400099441000970050001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 2 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 2 - Buffer Length: 256 - Filter Length: 57cabjifdehg30M60M90M120M150M1185500001174900001140100001113700001097000001057400001056500001054800001052800001048000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 512bcahiedfjg12M24M36M48M60M555880005516500052911000528900005212900050380000502580004997700049781000495560001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 1 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 1 - Buffer Length: 256 - Filter Length: 32abchijefgd8M16M24M32M40M394990003948600039453000371450003714100037120000353150003527100035236000352280001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 512

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 512bacijhegfd50M100M150M200M250M2161500002160800002149100002097200002094900002075900001960400001946700001945000001938500001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 32acbhjidegf70M140M210M280M350M3075400003067600003051100002926200002924900002924300002780300002777800002774100002763900001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 32cbahjidefg130M260M390M520M650M6036500006024700005942300005858500005856700005838700005453600005451400005450200005430500001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 32

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 32abcihjedfg30M60M90M120M150M1538500001536900001536700001459200001458200001457400001386200001386000001385800001384600001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUdefghijabc0.12150.2430.36450.4860.60750.490.490.490.490.530.530.530.540.540.54MIN: 0.3 / MAX: 9.28MIN: 0.3 / MAX: 9.07MIN: 0.3 / MAX: 8.2MIN: 0.3 / MAX: 8.84MIN: 0.31 / MAX: 10.06MIN: 0.31 / MAX: 10.06MIN: 0.31 / MAX: 7.18MIN: 0.45 / MAX: 7.64MIN: 0.45 / MAX: 7.81MIN: 0.45 / MAX: 5.031. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 16 - Buffer Length: 256 - Filter Length: 57hjiafebdgc160M320M480M640M800M7414200007371200007358000006997400006933400006929200006927600006891500006820700006749300001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16-INT8 - Device: CPUegfabcijhd91827364536.9836.9837.0138.5038.6638.7539.2339.3439.4440.40MIN: 32.02 / MAX: 44.78MIN: 32.61 / MAX: 41.91MIN: 32.25 / MAX: 43.6MIN: 36.77 / MAX: 44.23MIN: 37.22 / MAX: 43.52MIN: 37.46 / MAX: 43.52MIN: 34.71 / MAX: 47.63MIN: 25.19 / MAX: 46.89MIN: 33.14 / MAX: 45.28MIN: 26.93 / MAX: 74.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamegfdhjicab4812162015.6215.6915.7215.7215.9215.9415.9916.8916.9117.07

Liquid-DSP

Threads: 8 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 8 - Buffer Length: 256 - Filter Length: 57jhiacbdegf80M160M240M320M400M3816600003783300003772500003694300003669900003669300003633100003579900003578100003504500001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Face Detection Retail FP16-INT8 - Device: CPUfdeghijbac1.09352.1873.28054.3745.46754.504.514.514.524.804.814.814.854.864.86MIN: 2.98 / MAX: 13.86MIN: 2.98 / MAX: 13.05MIN: 2.96 / MAX: 16.06MIN: 2.77 / MAX: 13.57MIN: 3.23 / MAX: 14.95MIN: 3.23 / MAX: 15.04MIN: 3.23 / MAX: 14.45MIN: 4.25 / MAX: 12.86MIN: 4.23 / MAX: 12.81MIN: 4.34 / MAX: 12.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamcbahijgefd1.12412.24823.37234.49645.62054.63484.64764.65084.80054.80154.80164.97874.98594.98774.9960

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamfgedjihbca80160240320400324.96325.51325.74325.88336.68336.77337.96347.22347.37347.66

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16-INT8 - Device: CPUdegfcbajhi2468107.937.967.967.978.248.278.288.458.468.46MIN: 4.2 / MAX: 16.92MIN: 4.19 / MAX: 16.59MIN: 4.19 / MAX: 14.2MIN: 4.37 / MAX: 16.86MIN: 7.62 / MAX: 23.32MIN: 7.37 / MAX: 25.18MIN: 7.44 / MAX: 23.35MIN: 4.46 / MAX: 17.31MIN: 4.67 / MAX: 18MIN: 4.49 / MAX: 17.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Liquid-DSP

Threads: 4 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 4 - Buffer Length: 256 - Filter Length: 57hjibacegfd40M80M120M160M200M2009300002001200001986400001965900001962200001945100001912300001907500001898800001889300001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Handwritten English Recognition FP16 - Device: CPUgfdeaichbj71421283529.7229.9530.0230.1030.7230.8730.8930.9231.0031.57MIN: 19.46 / MAX: 38.99MIN: 19.01 / MAX: 38.08MIN: 18.78 / MAX: 38.72MIN: 22.61 / MAX: 39.15MIN: 29.51 / MAX: 35.07MIN: 20.13 / MAX: 42.34MIN: 29.48 / MAX: 36.29MIN: 25.94 / MAX: 41.77MIN: 29.59 / MAX: 36.33MIN: 20.39 / MAX: 39.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamedfghjiacb306090120150112.06112.25112.41112.48116.51116.85116.89118.75118.78118.95

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Weld Porosity Detection FP16 - Device: CPUdegfbcahij4812162015.3615.3615.3715.3816.0216.0216.2616.2716.2716.27MIN: 8.08 / MAX: 24.34MIN: 8.02 / MAX: 23.81MIN: 7.99 / MAX: 23.98MIN: 7.99 / MAX: 24MIN: 14.41 / MAX: 30.55MIN: 14.63 / MAX: 33.79MIN: 14.71 / MAX: 28.14MIN: 8.92 / MAX: 25.52MIN: 8.5 / MAX: 25.86MIN: 8.44 / MAX: 25.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUijhdfge0.86491.72982.59473.45964.32453.659073.680873.722473.815763.818233.823813.84421MIN: 2.81MIN: 2.85MIN: 2.83MIN: 3.26MIN: 3.25MIN: 3.29MIN: 3.271. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamfdegcijhab306090120150143.69143.76144.10144.11145.26145.83145.90146.12150.59150.61

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabdjfeihgc110220330440550485.72487.36493.60494.01494.22494.26494.50495.22495.60507.48

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.1Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcdefghij0.07880.15760.23640.31520.3940.340.340.340.350.350.350.350.350.350.35MIN: 0.29 / MAX: 7.33MIN: 0.29 / MAX: 10.87MIN: 0.29 / MAX: 7.09MIN: 0.23 / MAX: 9.09MIN: 0.23 / MAX: 8.84MIN: 0.23 / MAX: 9.15MIN: 0.23 / MAX: 8.63MIN: 0.21 / MAX: 8.91MIN: 0.22 / MAX: 8.62MIN: 0.22 / MAX: 8.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamhjidefagbc81624324032.7532.8132.8433.2233.2633.2833.3433.3733.3833.46

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamgfedjhiacb2040608010073.1973.2273.2673.3173.7873.8873.9474.3274.5074.56

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcdgfeihj130260390520650605.04605.73605.92606.10607.16607.82607.91612.98613.05614.23

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamacdbefgjhi130260390520650605.76605.88606.58606.67606.76606.79608.72612.52613.16613.64

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamijhecgfdba112233445548.7948.8348.8849.0149.0249.0349.0749.0949.1149.37

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streambcihajgefd20406080100109.23109.58109.74109.79109.80109.86109.90109.97110.00110.11

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamdhijbgaefc112233445548.8748.8948.8948.8948.9748.9849.0149.0649.0749.21

QuantLib

Configuration: Multi-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-Threadedjih30K60K90K120K150K117263.3117199.0116781.51. (CXX) g++ options: -O3 -march=native -fPIE -pie

QuantLib

Configuration: Single-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-Threadedjih70014002100280035003371.63365.43357.91. (CXX) g++ options: -O3 -march=native -fPIE -pie

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.5Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamhfjbgiaced20406080100110.81110.89110.90110.92110.98110.98111.01111.03111.09111.11


Phoronix Test Suite v10.8.4