Xeon Gold Cascade Lake Refresh LTS Linux Benchmarks

Intel Xeon Gold 6226R testing with a Supermicro X11SPL-F v1.02 (3.1 BIOS) and ASPEED on Ubuntu 20.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2212171-PTS-XEONGOLD08&sro&gru.

Xeon Gold Cascade Lake Refresh LTS Linux BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionLinux 5.10.130Linux 5.15.83Linux 6.1Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads)Supermicro X11SPL-F v1.02 (3.1 BIOS)Intel Sky Lake-E DMI3 Registers192GB280GB INTEL SSDPED1D280GAASPEEDVE2282 x Intel I210Ubuntu 20.105.10.130-0510130-generic (x86_64)GNOME Shell 3.38.1X Server 1.20.9GCC 10.3.0ext41920x10805.15.83-051583-generic (x86_64)6.1.0-phx (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102Python Details- Python 3.8.10Security Details- Linux 5.10.130: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 5.15.83: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 6.1: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Xeon Gold Cascade Lake Refresh LTS Linux Benchmarksminibude: OpenMP - BM1minibude: OpenMP - BM2stress-ng: MMAPstress-ng: NUMAstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Forkingstress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: x86_64 RdRandstress-ng: Memory Copyingstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMnekrs: TurboPipe Periodicopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUnatron: Spaceshipaom-av1: Speed 6 Two-Pass - Bosphorus 4Kaom-av1: Speed 8 Realtime - Bosphorus 4Kaom-av1: Speed 9 Realtime - Bosphorus 4Kaom-av1: Speed 10 Realtime - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pminibude: OpenMP - BM1minibude: OpenMP - BM2xmrig: Monero - 1Mxmrig: Wownero - 1Mtensorflow: CPU - 16 - AlexNettensorflow: CPU - 32 - AlexNettensorflow: CPU - 64 - AlexNettensorflow: CPU - 256 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 256 - ResNet-50deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamgraphics-magick: Swirlgraphics-magick: Rotategraphics-magick: Sharpengraphics-magick: Enhancedgraphics-magick: Resizinggraphics-magick: Noise-Gaussiangraphics-magick: HWB Color Spaceaircrack-ng: cpuminer-opt: Magicpuminer-opt: x25xcpuminer-opt: scryptcpuminer-opt: Deepcoincpuminer-opt: Ringcoincpuminer-opt: Blake-2 Scpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: Myriad-Groestlcpuminer-opt: LBC, LBRY Creditscpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: Triple SHA-256, Onecoinblosc: blosclz shuffleblosc: blosclz bitshufflecompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingjpegxl: PNG - 80jpegxl: PNG - 90jpegxl: JPEG - 80jpegxl: JPEG - 90jpegxl: PNG - 100jpegxl: JPEG - 100jpegxl-decode: 1jpegxl-decode: Allwebp: Defaultwebp: Quality 100webp: Quality 100, Losslesswebp: Quality 100, Highest Compressionwebp: Quality 100, Lossless, Highest Compressionastcenc: Fastastcenc: Mediumastcenc: Thoroughastcenc: Exhaustivelammps: 20k Atomslammps: Rhodopsin Proteinrocksdb: Rand Fillrocksdb: Rand Readrocksdb: Update Randrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While Writingrocksdb: Read Rand Write Randdragonflydb: 50 - 1:1dragonflydb: 50 - 1:5dragonflydb: 50 - 5:1dragonflydb: 200 - 1:1dragonflydb: 200 - 1:5dragonflydb: 200 - 5:1clickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cacheclickhouse: 100M Rows Web Analytics Dataset, Second Runclickhouse: 100M Rows Web Analytics Dataset, Third Runstargate: 44100 - 512stargate: 96000 - 512stargate: 192000 - 512stargate: 44100 - 1024stargate: 480000 - 512stargate: 96000 - 1024stargate: 192000 - 1024stargate: 480000 - 1024srsran: OFDM_Testspacy: en_core_web_lgspacy: en_core_web_trfpgbench: 100 - 100 - Read Onlypgbench: 100 - 250 - Read Onlypgbench: 100 - 500 - Read Onlypgbench: 100 - 100 - Read Writepgbench: 100 - 250 - Read Writepgbench: 100 - 500 - Read Writesrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMbrl-cad: VGR Performance Metricctx-clock: Context Switch Timeonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 2 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 2 - 4K - 16 - Path Tracerospray-studio: 2 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracerospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 2 - 1080p - 1 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Tracerospray-studio: 1 - 1080p - 16 - Path Tracerospray-studio: 1 - 1080p - 32 - Path Tracerospray-studio: 2 - 1080p - 16 - Path Tracerospray-studio: 2 - 1080p - 32 - Path Tracerospray-studio: 3 - 1080p - 16 - Path Tracerospray-studio: 3 - 1080p - 32 - Path Tracerpgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 250 - Read Write - Average Latencypgbench: 100 - 500 - Read Write - Average Latencymnn: nasnetmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Bumper Beamopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containeravifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessavifenc: 10, Losslessbuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-nodejs: Time To Compilebuild-php: Time To Compilebuild-python: Defaultbuild-python: Released Build, PGO + LTO Optimizedprimesieve: 1e12primesieve: 1e13y-cruncher: 1By-cruncher: 500Mbuild-erlang: Time To Compileencode-flac: WAV To FLACblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyencodec: 3 kbpsencodec: 6 kbpsencodec: 24 kbpsencodec: 1.5 kbpsnumenta-nab: KNN CADnumenta-nab: Relative Entropynumenta-nab: Windowed Gaussiannumenta-nab: Earthgecko Skylinenumenta-nab: Bayesian Changepointnumenta-nab: Contextual Anomaly Detector OSELinux 5.10.130Linux 5.15.83Linux 6.121.21121.389390.20358.051498828.701008.628606774.99223731.7018742.6722392194.2856719.5136489.15241610.68116.3334273.523214994.8355915.3655351.58252390.564201.0210160.915500706.76911917.94194.366490812.35279.8279.8303.4307.098.6706497666675.883.313.25272.0919.11969.33625.5064.821991.75485.3615259.8631167.813.611.7037.8848.0548.342.47534.519126.497120.7947.04695.493415.136423.649530.266534.7386794.59492.2166.55211.25243.30278.63114.4137.68121.7240.23125.7941.90130.2143.5010.52109.599655.423343.761286.656775.2616219.3569132.6485108.547573.603955.543338.443810.54039.6153502757199315133333597650605.559374.94640.06491.90144972833.0911491036572.81135103173639682021883031591315238.110158.9106357864327.707.587.457.300.540.5338.17208.7914.379.001.273.070.48193.131572.15959.32250.937110.42710.65998319965094239625695120425521646431008992132608978963.311047699.23989148.97971725.251021149.38918617.37205.76212.60212.423.9095522.5378911.5362554.3858933.7269332.9996111.8892684.199568122000000113142446465422413949370238536564767638503117.3123.3126.9131.065.91677711542.296363.101440.4966131.252714.291534.706993.306064.158690.5406540.8514551613.12909.6321621.84911.8160.9563990.3132387055724286331214672342161244282399351465832846991778182621782840965271291726682334786780160.2150.6041.3501.8645.24412.98614.9102.0912.59210.1484.8923.8552.67822.73314.545.564.955.664.917.062.3811.5726.958.095.4614.2023.6017.1318.83160.277.021357.372400.022436.3029.37417.718.2425.53123.348.0216.471.040.50758.0277104.1622144.241022.839692.214213.268936.43907.526573.675913.5771144.006226.0011752.8319103.996038.53511188.28208241.485511598.6991152.4196.21256.43159.75443.72145.01270.5176.68911.3766.63797.24670.169907.748453.61365.32519.449383.51414.443174.72224.44911.34591.56021.110106.13318.28144.251145.90373.7429.14129.49534.16228.208185.33015.8039.070114.81341.39255.73421.17021.317381.23335.582364278.75879.679013626.15225144.3318733.1020930090.9660087.3632758.89285766.99128.3134238.773314461.3855890.2355415.01252393.884129.3417786.172284154.16916397.13194.888257907.06282.7282.0310.0307.998.6709236333335.883.303.25272.8019.15957.08623.3664.281993.58485.1915258.5631007.383.611.7737.8647.6648.332.48334.818127.534122.9786.98595.043418.022425.263529.240532.9246829.89531.3166.90211.47242.73279.05115.1538.09122.1840.41126.2942.05130.4043.4110.45399.614155.584942.901386.940275.0401219.0088134.1326108.337772.055254.433237.760210.43399.6111499731199314132133195750607.738373.55641.61489.83145002812.3411505836594.18134833176109666321849331391715998.610555.7108058867357.717.547.407.250.540.5337.90209.1814.409.021.283.090.48193.024472.12199.32670.937510.41410.639982848652336496166261193837234969304327921293591123953.551186278.251068662.911060251.051117321.90993337.90204.26209.58215.023.9725912.5790451.5670494.4310983.7903213.0635111.9896804.270897122633333112362416515273475175426428562304592233824118.3123.9128.0131.666.01668521792.293853.085610.4972481.251744.311784.708343.296334.203430.5404520.8465431611.14912.0661614.87908.1880.9616820.3160057046724686281214862341421245562403111465702848531778182621762841765242292066681734801779970.1940.5261.1731.7795.44414.78314.8802.0712.5379.8504.8973.7522.63922.43814.715.534.955.594.856.992.2911.4627.698.055.4814.2123.8916.8518.67161.236.911356.352401.742441.6729.29416.958.3425.62124.348.0116.461.030.5759.3525104.0054143.806523.313991.986013.308936.49737.440873.821613.8679146.950526.4774760.8374104.037638.235781186.39843242.254871611.5943151.8296.31256.19159.15445.17144.70971.0656.74911.4256.66697.56870.488911.083453.30765.14319.493383.96214.429174.65824.56211.36691.75421.098106.38317.07144.341144.82373.5428.66029.53033.91728.349182.65715.8139.018115.52941.43355.65921.42221.552310.22256.612433807.14667.827375258.06225639.3218727.6115989079.7753632.6732918.80284966.04115.5934059.433315660.8855875.1855344.32252372.294181.8016990.752054658.64916843.52194.3014896082.79280.2280.3307.4305.598.3704815000005.893.283.23267.6219.17957.41620.6163.961992.23491.2415144.3230632.463.611.6536.1045.4145.972.46034.723126.763121.5967.02495.151409.127419.750535.565538.7906767.39527.7166.31211.06242.34279.22116.1638.01123.1940.32126.4942.06130.4743.3710.40979.539355.436643.320286.883275.2635218.6936132.5077108.744371.885254.272637.211510.38329.6532491668197311129932287250609.276373.45638.64491.85144202800.6211375506571.66134320174779601021723731572315256.110161.3106968866807.367.207.086.940.530.5236.37181.5414.388.951.273.080.48192.991772.09729.31030.936810.39910.608935285653371755944851134991218454298539221335281130454.031180450.091074996.431046604.151099078.40979549.43198.51204.43212.923.8172682.4971641.5200404.3113823.7188123.0125851.9288144.208880120733333112312341523788487468467167543654522336109117.1123.3127.2130.365.91683342002.297083.094330.4967761.248714.286184.980673.312444.180960.5414300.8318661614.07909.1471618.86913.9430.9634000.3139757048724586331230002343711263412404301466922842351779182421732847965894291656783734779798040.1910.5131.0701.8395.52813.84715.1222.0832.6069.9324.9693.8312.64022.78914.455.574.955.634.897.042.3611.4826.527.855.4613.8323.3516.7618.70160.396.961357.102415.312451.1029.86416.168.3325.73124.978.0216.271.040.51764.7425104.8348144.211423.071892.046213.269136.53927.535973.545613.9013147.380426.8656763.3064103.582338.361993186.93467242.923071607.4012153.2396.30255.89160.27446.66145.03671.2016.79811.5806.90999.42072.558934.265459.75365.96419.777385.514.424174.97724.45511.29493.73921.376106.46318.71144.291145.18374.1730.42632.01736.32130.493180.51915.5259.073115.83141.93655.815OpenBenchmarking.org

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 321.2121.1721.421. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 321.3921.3221.551. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAPLinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 0.74, N = 3SE +/- 0.56, N = 3SE +/- 2.76, N = 3390.20381.23310.221. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMALinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 2.82, N = 3SE +/- 0.90, N = 3SE +/- 1.78, N = 3358.05335.58256.611. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: FutexLinux 5.10.130Linux 5.15.83Linux 6.1500K1000K1500K2000K2500KSE +/- 33488.35, N = 15SE +/- 32600.02, N = 3SE +/- 9882.04, N = 31498828.702364278.752433807.141. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MEMFDLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 0.88, N = 3SE +/- 0.39, N = 3SE +/- 0.28, N = 31008.62879.67667.821. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MutexLinux 5.10.130Linux 5.15.83Linux 6.12M4M6M8M10MSE +/- 10182.54, N = 3SE +/- 112044.15, N = 15SE +/- 24065.62, N = 38606774.999013626.157375258.061. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: AtomicLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 1447.49, N = 3SE +/- 1620.65, N = 3SE +/- 3644.44, N = 3223731.70225144.33225639.321. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CryptoLinux 5.10.130Linux 5.15.83Linux 6.14K8K12K16K20KSE +/- 47.41, N = 3SE +/- 83.58, N = 3SE +/- 66.53, N = 318742.6718733.1018727.611. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MallocLinux 5.10.130Linux 5.15.83Linux 6.15M10M15M20M25MSE +/- 90978.10, N = 3SE +/- 130302.14, N = 3SE +/- 91731.80, N = 322392194.2820930090.9615989079.771. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: ForkingLinux 5.10.130Linux 5.15.83Linux 6.113K26K39K52K65KSE +/- 175.99, N = 3SE +/- 184.20, N = 3SE +/- 386.64, N = 356719.5160087.3653632.671. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringLinux 5.10.130Linux 5.15.83Linux 6.18K16K24K32K40KSE +/- 401.23, N = 3SE +/- 501.84, N = 3SE +/- 240.39, N = 336489.1532758.8932918.801. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILELinux 5.10.130Linux 5.15.83Linux 6.160K120K180K240K300KSE +/- 2449.06, N = 3SE +/- 2143.98, N = 3SE +/- 1947.11, N = 3241610.68285766.99284966.041. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU CacheLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 2.89, N = 15SE +/- 6.07, N = 12SE +/- 2.00, N = 15116.33128.31115.591. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU StressLinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 248.24, N = 14SE +/- 3.47, N = 3SE +/- 27.28, N = 334273.5234238.7734059.431. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SemaphoresLinux 5.10.130Linux 5.15.83Linux 6.1700K1400K2100K2800K3500KSE +/- 159.78, N = 3SE +/- 1860.75, N = 3SE +/- 1806.60, N = 33214994.833314461.383315660.881. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Matrix MathLinux 5.10.130Linux 5.15.83Linux 6.112K24K36K48K60KSE +/- 476.25, N = 3SE +/- 503.37, N = 3SE +/- 647.24, N = 355915.3655890.2355875.181. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Vector MathLinux 5.10.130Linux 5.15.83Linux 6.112K24K36K48K60KSE +/- 337.57, N = 3SE +/- 330.15, N = 3SE +/- 321.30, N = 355351.5855415.0155344.321. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: x86_64 RdRandLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 0.71, N = 3SE +/- 1.57, N = 3SE +/- 12.63, N = 3252390.56252393.88252372.291. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Memory CopyingLinux 5.10.130Linux 5.15.83Linux 6.19001800270036004500SE +/- 31.35, N = 3SE +/- 42.48, N = 3SE +/- 29.72, N = 34201.024129.344181.801. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Socket ActivityLinux 5.10.130Linux 5.15.83Linux 6.14K8K12K16K20KSE +/- 302.66, N = 15SE +/- 80.02, N = 3SE +/- 112.51, N = 310160.9117786.1716990.751. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Context SwitchingLinux 5.10.130Linux 5.15.83Linux 6.11.2M2.4M3.6M4.8M6MSE +/- 72191.04, N = 3SE +/- 7040.94, N = 3SE +/- 3492.53, N = 35500706.762284154.162054658.641. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc C String FunctionsLinux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 6508.49, N = 3SE +/- 3709.52, N = 3SE +/- 8664.27, N = 3911917.94916397.13916843.521. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc Qsort Data SortingLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 1.58, N = 3SE +/- 1.18, N = 3SE +/- 1.25, N = 3194.36194.88194.301. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: System V Message PassingLinux 5.10.130Linux 5.15.83Linux 6.13M6M9M12M15MSE +/- 23387.52, N = 3SE +/- 4399.60, N = 3SE +/- 26770.64, N = 36490812.358257907.0614896082.791. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 3279.8282.7280.21. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3279.8282.0280.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 1.79, N = 3SE +/- 0.22, N = 3SE +/- 0.35, N = 3303.4310.0307.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 0.25, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3307.0307.9305.51. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.35, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 398.698.698.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicLinux 5.10.130Linux 5.15.83Linux 6.115000M30000M45000M60000M75000MSE +/- 144216808.24, N = 3SE +/- 219477639.96, N = 3SE +/- 48731133.10, N = 37064976666770923633333704815000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -pthread -lmpi_cxx -lmpi

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.11.32532.65063.97595.30126.6265SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 35.885.885.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.74481.48962.23442.97923.724SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 33.313.303.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.73131.46262.19392.92523.6565SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.253.253.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 1.08, N = 3SE +/- 0.06, N = 3SE +/- 1.20, N = 3272.09272.80267.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 319.1119.1519.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 5.71, N = 3SE +/- 1.74, N = 3SE +/- 0.69, N = 3969.33957.08957.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1140280420560700SE +/- 0.68, N = 3SE +/- 0.90, N = 3SE +/- 1.31, N = 3625.50623.36620.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.11428425670SE +/- 0.70, N = 3SE +/- 0.24, N = 3SE +/- 0.40, N = 364.8264.2863.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1400800120016002000SE +/- 1.36, N = 3SE +/- 0.98, N = 3SE +/- 1.06, N = 31991.751993.581992.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1110220330440550SE +/- 4.00, N = 13SE +/- 4.62, N = 3SE +/- 4.29, N = 11485.36485.19491.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.13K6K9K12K15KSE +/- 110.56, N = 3SE +/- 108.60, N = 3SE +/- 96.54, N = 315259.8615258.5615144.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 85.59, N = 3SE +/- 38.88, N = 3SE +/- 16.23, N = 331167.8131007.3830632.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Natron

Input: Spaceship

OpenBenchmarking.orgFPS, More Is BetterNatron 2.4.3Input: SpaceshipLinux 5.10.130Linux 5.15.83Linux 6.10.811.622.433.244.05SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.63.63.6

AOM AV1

Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 311.7011.7711.651. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

AOM AV1

Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 337.8837.8636.101. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

AOM AV1

Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.11122334455SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 348.0547.6645.411. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

AOM AV1

Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.11122334455SE +/- 0.10, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 348.3448.3345.971. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.10.55871.11741.67612.23482.7935SE +/- 0.003, N = 3SE +/- 0.005, N = 3SE +/- 0.005, N = 32.4752.4832.4601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1816243240SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.20, N = 334.5234.8234.721. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.46, N = 3SE +/- 0.62, N = 3SE +/- 0.29, N = 3126.50127.53126.761. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.69, N = 3SE +/- 0.32, N = 3SE +/- 0.62, N = 3120.79122.98121.601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.057, N = 3SE +/- 0.016, N = 3SE +/- 0.044, N = 37.0466.9857.0241. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080pLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.40, N = 3SE +/- 0.30, N = 3SE +/- 0.46, N = 395.4995.0495.151. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080pLinux 5.10.130Linux 5.15.83Linux 6.190180270360450SE +/- 0.88, N = 3SE +/- 0.85, N = 3SE +/- 2.62, N = 3415.14418.02409.131. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080pLinux 5.10.130Linux 5.15.83Linux 6.190180270360450SE +/- 0.82, N = 3SE +/- 1.29, N = 3SE +/- 1.64, N = 3423.65425.26419.751. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 5.10.130Linux 5.15.83Linux 6.1120240360480600SE +/- 0.13, N = 3SE +/- 0.39, N = 3SE +/- 0.30, N = 3530.27529.24535.571. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 5.10.130Linux 5.15.83Linux 6.1120240360480600SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3534.74532.92538.791. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MLinux 5.10.130Linux 5.15.83Linux 6.115003000450060007500SE +/- 3.14, N = 3SE +/- 23.74, N = 3SE +/- 54.19, N = 36794.56829.86767.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 67.20, N = 3SE +/- 34.41, N = 3SE +/- 49.24, N = 39492.29531.39527.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.44, N = 3SE +/- 0.13, N = 3SE +/- 0.22, N = 3166.55166.90166.31

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.47, N = 3SE +/- 0.13, N = 3SE +/- 0.28, N = 3211.25211.47211.06

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.06, N = 3SE +/- 0.39, N = 3SE +/- 0.27, N = 3243.30242.73242.34

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.53, N = 3SE +/- 0.66, N = 3SE +/- 0.40, N = 3278.63279.05279.22

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3114.41115.15116.16

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 337.6838.0938.01

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3121.72122.18123.19

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 340.2340.4140.32

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3125.79126.29126.49

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 341.9042.0542.06

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3130.21130.40130.47

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 343.5043.4143.37

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 310.5210.4510.41

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.0301, N = 3SE +/- 0.0357, N = 3SE +/- 0.0848, N = 39.59969.61419.5393

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.11224364860SE +/- 0.15, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 355.4255.5855.44

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.26, N = 3SE +/- 0.47, N = 7SE +/- 0.21, N = 343.7642.9043.32

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.12, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 386.6686.9486.88

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 375.2675.0475.26

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.10, N = 3SE +/- 0.45, N = 3SE +/- 0.45, N = 3219.36219.01218.69

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 1.67, N = 3SE +/- 0.54, N = 3SE +/- 2.16, N = 3132.65134.13132.51

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.05, N = 3SE +/- 0.53, N = 3SE +/- 0.47, N = 3108.55108.34108.74

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.65, N = 3SE +/- 0.33, N = 3SE +/- 0.51, N = 373.6072.0671.89

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.11224364860SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.16, N = 355.5454.4354.27

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.15, N = 3SE +/- 0.41, N = 3SE +/- 0.31, N = 338.4437.7637.21

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 310.5410.4310.38

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.0549, N = 3SE +/- 0.0282, N = 3SE +/- 0.0209, N = 39.61539.61119.6532

GraphicsMagick

Operation: Swirl

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SwirlLinux 5.10.130Linux 5.15.83Linux 6.1110220330440550SE +/- 2.40, N = 3SE +/- 1.53, N = 3SE +/- 1.53, N = 35024994911. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: RotateLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 9.97, N = 5SE +/- 1.76, N = 3SE +/- 5.43, N = 157577316681. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SharpenLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 1.33, N = 3SE +/- 1.20, N = 3SE +/- 1.33, N = 31991991971. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Enhanced

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: EnhancedLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 33153143111. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: ResizingLinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 7.42, N = 3SE +/- 2.73, N = 3SE +/- 2.91, N = 31333132112991. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: Noise-GaussianLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 1.76, N = 33353313221. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: HWB Color SpaceLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 1.53, N = 3SE +/- 1.67, N = 39769578721. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Aircrack-ng

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7Linux 5.10.130Linux 5.15.83Linux 6.111K22K33K44K55KSE +/- 129.98, N = 3SE +/- 118.77, N = 3SE +/- 144.43, N = 350605.5650607.7450609.281. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -lbsd -pthread

Cpuminer-Opt

Algorithm: Magi

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: MagiLinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 4.81, N = 3SE +/- 4.11, N = 3SE +/- 4.81, N = 3374.94373.55373.451. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: x25x

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xLinux 5.10.130Linux 5.15.83Linux 6.1140280420560700SE +/- 0.20, N = 3SE +/- 1.51, N = 3SE +/- 0.34, N = 3640.06641.61638.641. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: scrypt

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptLinux 5.10.130Linux 5.15.83Linux 6.1110220330440550SE +/- 3.92, N = 3SE +/- 5.31, N = 3SE +/- 2.46, N = 3491.90489.83491.851. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Deepcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinLinux 5.10.130Linux 5.15.83Linux 6.13K6K9K12K15KSE +/- 46.67, N = 3SE +/- 50.00, N = 31449714500144201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Ringcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: RingcoinLinux 5.10.130Linux 5.15.83Linux 6.16001200180024003000SE +/- 27.91, N = 3SE +/- 0.80, N = 3SE +/- 1.62, N = 32833.092812.342800.621. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Blake-2 S

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Blake-2 SLinux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 6874.21, N = 3SE +/- 10686.26, N = 3SE +/- 3289.87, N = 31149103115058311375501. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinLinux 5.10.130Linux 5.15.83Linux 6.114002800420056007000SE +/- 2.21, N = 3SE +/- 11.67, N = 3SE +/- 2.16, N = 36572.816594.186571.661. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 169.54, N = 3SE +/- 3.33, N = 3SE +/- 283.78, N = 31351031348331343201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Myriad-Groestl

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Myriad-GroestlLinux 5.10.130Linux 5.15.83Linux 6.14K8K12K16K20KSE +/- 286.72, N = 3SE +/- 185.02, N = 3SE +/- 135.32, N = 31736317610174771. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 656.84, N = 3SE +/- 167.46, N = 3SE +/- 615.39, N = 39682096663960101. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 820.33, N = 3SE +/- 6.67, N = 3SE +/- 258.61, N = 32188302184932172371. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinLinux 5.10.130Linux 5.15.83Linux 6.170K140K210K280K350KSE +/- 2642.36, N = 3SE +/- 661.12, N = 3SE +/- 2222.66, N = 33159133139173157231. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

C-Blosc

Test: blosclz shuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz shuffleLinux 5.10.130Linux 5.15.83Linux 6.13K6K9K12K15KSE +/- 62.87, N = 3SE +/- 51.78, N = 3SE +/- 27.75, N = 315238.115998.615256.11. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

C-Blosc

Test: blosclz bitshuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz bitshuffleLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 20.30, N = 3SE +/- 12.20, N = 3SE +/- 25.18, N = 310158.910555.710161.31. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 95.64, N = 3SE +/- 364.72, N = 3SE +/- 526.57, N = 31063571080581069681. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 259.98, N = 3SE +/- 150.80, N = 3SE +/- 264.89, N = 38643286735866801. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

JPEG XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 80Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.707.717.361. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 37.587.547.201. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 37.457.407.081. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.307.256.941. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100Linux 5.10.130Linux 5.15.83Linux 6.10.12150.2430.36450.4860.6075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.540.540.531. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100Linux 5.10.130Linux 5.15.83Linux 6.10.11930.23860.35790.47720.5965SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.530.530.521. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL Decoding libjxl

CPU Threads: 1

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 1Linux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 338.1737.9036.37

JPEG XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: AllLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 1.38, N = 3SE +/- 0.37, N = 3SE +/- 2.09, N = 3208.79209.18181.54

WebP Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: DefaultLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 314.3714.4014.381. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

WebP Image Encode

Encode Settings: Quality 100

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100Linux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 39.009.028.951. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

WebP Image Encode

Encode Settings: Quality 100, Lossless

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, LosslessLinux 5.10.130Linux 5.15.83Linux 6.10.2880.5760.8641.1521.44SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.271.281.271. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

WebP Image Encode

Encode Settings: Quality 100, Highest Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionLinux 5.10.130Linux 5.15.83Linux 6.10.69531.39062.08592.78123.4765SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.073.093.081. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

WebP Image Encode

Encode Settings: Quality 100, Lossless, Highest Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionLinux 5.10.130Linux 5.15.83Linux 6.10.1080.2160.3240.4320.54SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.480.480.481. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

ASTC Encoder

Preset: Fast

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: FastLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3193.13193.02192.991. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: MediumLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 372.1672.1272.101. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.0023, N = 3SE +/- 0.0055, N = 3SE +/- 0.0088, N = 39.32259.32679.31031. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ExhaustiveLinux 5.10.130Linux 5.15.83Linux 6.10.21090.42180.63270.84361.0545SE +/- 0.0001, N = 3SE +/- 0.0001, N = 3SE +/- 0.0006, N = 30.93710.93750.93681. (CXX) g++ options: -O3 -flto -pthread

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 310.4310.4110.401. (CXX) g++ options: -O3 -pthread -lm -ldl

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6610.6410.611. (CXX) g++ options: -O3 -pthread -lm -ldl

Facebook RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random FillLinux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 10947.16, N = 3SE +/- 11892.65, N = 3SE +/- 2558.50, N = 39831999828489352851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Facebook RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random ReadLinux 5.10.130Linux 5.15.83Linux 6.114M28M42M56M70MSE +/- 547664.44, N = 3SE +/- 139131.71, N = 3SE +/- 360247.64, N = 36509423965233649653371751. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Facebook RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Update RandomLinux 5.10.130Linux 5.15.83Linux 6.1130K260K390K520K650KSE +/- 3662.51, N = 3SE +/- 1069.98, N = 3SE +/- 2022.46, N = 36256956166265944851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Facebook RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Sequential FillLinux 5.10.130Linux 5.15.83Linux 6.1300K600K900K1200K1500KSE +/- 10501.31, N = 3SE +/- 3547.16, N = 3SE +/- 11595.14, N = 31204255119383711349911. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Facebook RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random Fill SyncLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 254.19, N = 3SE +/- 684.45, N = 3SE +/- 160.74, N = 32164642349692184541. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Facebook RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read While WritingLinux 5.10.130Linux 5.15.83Linux 6.1700K1400K2100K2800K3500KSE +/- 49813.03, N = 3SE +/- 29968.88, N = 3SE +/- 14227.22, N = 33100899304327929853921. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Facebook RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read Random Write RandomLinux 5.10.130Linux 5.15.83Linux 6.1500K1000K1500K2000K2500KSE +/- 16550.67, N = 3SE +/- 8919.50, N = 3SE +/- 10651.17, N = 32132608212935921335281. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 19609.96, N = 13SE +/- 643.98, N = 3SE +/- 1471.72, N = 3978963.311123953.551130454.031. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:5Linux 5.10.130Linux 5.15.83Linux 6.1300K600K900K1200K1500KSE +/- 872.80, N = 3SE +/- 1515.54, N = 3SE +/- 1580.99, N = 31047699.231186278.251180450.091. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 50 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 8046.26, N = 3SE +/- 3987.52, N = 3SE +/- 741.75, N = 3989148.971068662.911074996.431. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 1890.11, N = 3SE +/- 1111.75, N = 3SE +/- 6338.63, N = 3971725.251060251.051046604.151. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:5Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 515.57, N = 3SE +/- 3993.93, N = 3SE +/- 797.47, N = 31021149.381117321.901099078.401. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Dragonflydb

Clients: 200 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 4444.49, N = 3SE +/- 845.72, N = 3SE +/- 1905.52, N = 3918617.37993337.90979549.431. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

ClickHouse

100M Rows Web Analytics Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold CacheLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 1.55, N = 15SE +/- 1.58, N = 14SE +/- 0.88, N = 3205.76204.26198.51MIN: 22.01 / MAX: 20000MIN: 22.52 / MAX: 20000MIN: 22.14 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

ClickHouse

100M Rows Web Analytics Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second RunLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.88, N = 15SE +/- 1.25, N = 14SE +/- 4.28, N = 3212.60209.58204.43MIN: 22.96 / MAX: 20000MIN: 22.65 / MAX: 20000MIN: 22.33 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

ClickHouse

100M Rows Web Analytics Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third RunLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 1.01, N = 15SE +/- 0.78, N = 14SE +/- 1.08, N = 3212.42215.02212.92MIN: 22.81 / MAX: 20000MIN: 22.68 / MAX: 20000MIN: 22.26 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 512Linux 5.10.130Linux 5.15.83Linux 6.10.89381.78762.68143.57524.469SE +/- 0.028488, N = 3SE +/- 0.017996, N = 3SE +/- 0.063340, N = 33.9095523.9725913.8172681. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 512Linux 5.10.130Linux 5.15.83Linux 6.10.58031.16061.74092.32122.9015SE +/- 0.035214, N = 3SE +/- 0.013088, N = 3SE +/- 0.031971, N = 32.5378912.5790452.4971641. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 512Linux 5.10.130Linux 5.15.83Linux 6.10.35260.70521.05781.41041.763SE +/- 0.008212, N = 3SE +/- 0.017482, N = 3SE +/- 0.006196, N = 31.5362551.5670491.5200401. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 1024Linux 5.10.130Linux 5.15.83Linux 6.10.9971.9942.9913.9884.985SE +/- 0.002245, N = 3SE +/- 0.011431, N = 3SE +/- 0.047576, N = 34.3858934.4310984.3113821. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 512Linux 5.10.130Linux 5.15.83Linux 6.10.85281.70562.55843.41124.264SE +/- 0.019070, N = 3SE +/- 0.052597, N = 3SE +/- 0.044488, N = 33.7269333.7903213.7188121. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 1024Linux 5.10.130Linux 5.15.83Linux 6.10.68931.37862.06792.75723.4465SE +/- 0.016716, N = 3SE +/- 0.004654, N = 3SE +/- 0.021684, N = 32.9996113.0635113.0125851. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024Linux 5.10.130Linux 5.15.83Linux 6.10.44770.89541.34311.79082.2385SE +/- 0.016352, N = 3SE +/- 0.011134, N = 3SE +/- 0.012895, N = 31.8892681.9896801.9288141. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 1024Linux 5.10.130Linux 5.15.83Linux 6.10.9611.9222.8833.8444.805SE +/- 0.030220, N = 3SE +/- 0.015411, N = 3SE +/- 0.017869, N = 34.1995684.2708974.2088801. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

srsRAN

Test: OFDM_Test

OpenBenchmarking.orgSamples / Second, More Is BettersrsRAN 22.04.1Test: OFDM_TestLinux 5.10.130Linux 5.15.83Linux 6.130M60M90M120M150MSE +/- 251661.15, N = 3SE +/- 352766.84, N = 3SE +/- 417665.47, N = 31220000001226333331207333331. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

spaCy

Model: en_core_web_lg

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 15.62, N = 3SE +/- 10.74, N = 3SE +/- 18.76, N = 3113141123611231

spaCy

Model: en_core_web_trf

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfLinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 9.87, N = 3SE +/- 6.33, N = 3SE +/- 7.51, N = 3244624162341

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read OnlyLinux 5.10.130Linux 5.15.83Linux 6.1110K220K330K440K550KSE +/- 1779.96, N = 3SE +/- 92.73, N = 3SE +/- 1990.45, N = 34654225152735237881. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read OnlyLinux 5.10.130Linux 5.15.83Linux 6.1100K200K300K400K500KSE +/- 2810.03, N = 3SE +/- 286.86, N = 3SE +/- 5532.44, N = 34139494751754874681. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read OnlyLinux 5.10.130Linux 5.15.83Linux 6.1100K200K300K400K500KSE +/- 956.06, N = 3SE +/- 666.01, N = 3SE +/- 757.53, N = 33702384264284671671. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read WriteLinux 5.10.130Linux 5.15.83Linux 6.112K24K36K48K60KSE +/- 146.53, N = 3SE +/- 125.21, N = 3SE +/- 90.59, N = 35365656230543651. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read WriteLinux 5.10.130Linux 5.15.83Linux 6.110K20K30K40K50KSE +/- 132.15, N = 3SE +/- 31.67, N = 3SE +/- 71.67, N = 34767645922452231. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read WriteLinux 5.10.130Linux 5.15.83Linux 6.18K16K24K32K40KSE +/- 59.40, N = 3SE +/- 99.01, N = 3SE +/- 91.02, N = 33850333824361091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.27, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3117.3118.3117.11. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3123.3123.9123.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3126.9128.0127.21. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.09, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 3131.0131.6130.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 5.10.130Linux 5.15.83Linux 6.11530456075SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 365.966.065.91. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.32.6VGR Performance MetricLinux 5.10.130Linux 5.15.83Linux 6.140K80K120K160K200K1677711668521683341. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -pthread -ldl -lm

ctx_clock

Context Switch Time

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.67, N = 3154179200

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.51681.03361.55042.06722.584SE +/- 0.00305, N = 3SE +/- 0.00109, N = 3SE +/- 0.00145, N = 32.296362.293852.29708MIN: 2.22MIN: 2.19MIN: 2.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.69781.39562.09342.79123.489SE +/- 0.00480, N = 3SE +/- 0.01196, N = 3SE +/- 0.00478, N = 33.101443.085613.09433MIN: 3.06MIN: 3.05MIN: 3.061. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.11190.22380.33570.44760.5595SE +/- 0.000232, N = 3SE +/- 0.000206, N = 3SE +/- 0.000335, N = 30.4966130.4972480.496776MIN: 0.48MIN: 0.48MIN: 0.481. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.28190.56380.84571.12761.4095SE +/- 0.00257, N = 3SE +/- 0.00241, N = 3SE +/- 0.00376, N = 31.252711.251741.24871MIN: 1.22MIN: 1.22MIN: 1.211. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.97021.94042.91063.88084.851SE +/- 0.00912, N = 3SE +/- 0.01348, N = 3SE +/- 0.00632, N = 34.291534.311784.28618MIN: 4.25MIN: 4.24MIN: 4.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.11.12072.24143.36214.48285.6035SE +/- 0.01724, N = 3SE +/- 0.01367, N = 3SE +/- 0.02580, N = 34.706994.708344.98067MIN: 4.43MIN: 4.4MIN: 4.621. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.74531.49062.23592.98123.7265SE +/- 0.00465, N = 3SE +/- 0.00438, N = 3SE +/- 0.00768, N = 33.306063.296333.31244MIN: 3.27MIN: 3.27MIN: 3.261. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.94581.89162.83743.78324.729SE +/- 0.01257, N = 3SE +/- 0.00929, N = 3SE +/- 0.00677, N = 34.158694.203434.18096MIN: 4.09MIN: 4.13MIN: 4.131. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.12180.24360.36540.48720.609SE +/- 0.000704, N = 3SE +/- 0.000263, N = 3SE +/- 0.000200, N = 30.5406540.5404520.541430MIN: 0.53MIN: 0.53MIN: 0.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.19160.38320.57480.76640.958SE +/- 0.006451, N = 3SE +/- 0.010105, N = 3SE +/- 0.003867, N = 30.8514550.8465430.831866MIN: 0.83MIN: 0.82MIN: 0.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 0.83, N = 3SE +/- 0.39, N = 3SE +/- 0.44, N = 31613.121611.141614.07MIN: 1608.28MIN: 1608.25MIN: 1609.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 2.14, N = 3SE +/- 1.01, N = 3SE +/- 1.41, N = 3909.63912.07909.15MIN: 903.56MIN: 908.55MIN: 904.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 2.14, N = 3SE +/- 3.87, N = 3SE +/- 1.70, N = 31621.841614.871618.86MIN: 1617.11MIN: 1607.67MIN: 1614.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 1.27, N = 3SE +/- 0.73, N = 3SE +/- 2.67, N = 3911.82908.19913.94MIN: 907.5MIN: 904.52MIN: 907.081. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.21680.43360.65040.86721.084SE +/- 0.001517, N = 3SE +/- 0.003629, N = 3SE +/- 0.002932, N = 30.9563990.9616820.963400MIN: 0.93MIN: 0.93MIN: 0.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.07110.14220.21330.28440.3555SE +/- 0.000694, N = 3SE +/- 0.001833, N = 3SE +/- 0.000082, N = 30.3132380.3160050.313975MIN: 0.3MIN: 0.3MIN: 0.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.115003000450060007500SE +/- 10.90, N = 3SE +/- 1.45, N = 37055704670481. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.116003200480064008000SE +/- 2.33, N = 3SE +/- 3.79, N = 3SE +/- 2.52, N = 37242724672451. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 5.51, N = 3SE +/- 9.45, N = 38633862886331. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 26.43, N = 3SE +/- 135.52, N = 3SE +/- 1530.19, N = 51214671214861230001. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 254.40, N = 3SE +/- 19.15, N = 3SE +/- 262.34, N = 32342162341422343711. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 68.75, N = 3SE +/- 104.41, N = 3SE +/- 1877.65, N = 31244281245561263411. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 103.12, N = 3SE +/- 62.00, N = 3SE +/- 131.54, N = 32399352403112404301. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 58.33, N = 3SE +/- 69.67, N = 3SE +/- 27.67, N = 31465831465701466921. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.160K120K180K240K300KSE +/- 239.39, N = 3SE +/- 192.14, N = 3SE +/- 92.98, N = 32846992848532842351. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.1400800120016002000SE +/- 0.67, N = 3SE +/- 1.33, N = 3SE +/- 0.58, N = 31778177817791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.1400800120016002000SE +/- 1.15, N = 3SE +/- 0.67, N = 3SE +/- 1.00, N = 31826182618241. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 0.67, N = 3SE +/- 0.58, N = 32178217621731. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.16K12K18K24K30KSE +/- 8.11, N = 3SE +/- 21.40, N = 3SE +/- 9.70, N = 32840928417284791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.114K28K42K56K70KSE +/- 37.27, N = 3SE +/- 20.81, N = 3SE +/- 527.74, N = 36527165242658941. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.16K12K18K24K30KSE +/- 28.26, N = 3SE +/- 5.24, N = 32917229206291651. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.115K30K45K60K75KSE +/- 35.09, N = 3SE +/- 44.92, N = 3SE +/- 539.86, N = 146682366817678371. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 21.06, N = 3SE +/- 4.51, N = 3SE +/- 5.29, N = 33478634801347791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 96.91, N = 3SE +/- 75.54, N = 3SE +/- 964.72, N = 67801677997798041. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.04840.09680.14520.19360.242SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.2150.1940.1911. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.13590.27180.40770.54360.6795SE +/- 0.004, N = 3SE +/- 0.000, N = 3SE +/- 0.006, N = 30.6040.5260.5131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.30380.60760.91141.21521.519SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 31.3501.1731.0701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.41940.83881.25821.67762.097SE +/- 0.005, N = 3SE +/- 0.004, N = 3SE +/- 0.003, N = 31.8641.7791.8391. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.11.24382.48763.73144.97526.219SE +/- 0.015, N = 3SE +/- 0.004, N = 3SE +/- 0.009, N = 35.2445.4445.5281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 312.9914.7813.851. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

Mobile Neural Network

Model: nasnet

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: nasnetLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.15, N = 914.9114.8815.12MIN: 14.46 / MAX: 28.47MIN: 14.51 / MAX: 33.86MIN: 14.55 / MAX: 29.561. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3Linux 5.10.130Linux 5.15.83Linux 6.10.47050.9411.41151.8822.3525SE +/- 0.010, N = 3SE +/- 0.009, N = 3SE +/- 0.009, N = 92.0912.0712.083MIN: 1.99 / MAX: 3.26MIN: 1.99 / MAX: 4.73MIN: 1.98 / MAX: 6.071. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1Linux 5.10.130Linux 5.15.83Linux 6.10.58641.17281.75922.34562.932SE +/- 0.020, N = 3SE +/- 0.015, N = 3SE +/- 0.012, N = 92.5922.5372.606MIN: 2.48 / MAX: 5.22MIN: 2.47 / MAX: 4.14MIN: 2.49 / MAX: 16.461. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50Linux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.099, N = 3SE +/- 0.025, N = 3SE +/- 0.037, N = 910.1489.8509.932MIN: 9.88 / MAX: 23.7MIN: 9.74 / MAX: 31.53MIN: 9.74 / MAX: 23.921. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0Linux 5.10.130Linux 5.15.83Linux 6.11.1182.2363.3544.4725.59SE +/- 0.043, N = 3SE +/- 0.009, N = 3SE +/- 0.019, N = 94.8924.8974.969MIN: 4.79 / MAX: 17.74MIN: 4.84 / MAX: 18.25MIN: 4.87 / MAX: 7.191. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: MobileNetV2_224Linux 5.10.130Linux 5.15.83Linux 6.10.86741.73482.60223.46964.337SE +/- 0.007, N = 3SE +/- 0.020, N = 3SE +/- 0.020, N = 93.8553.7523.831MIN: 3.65 / MAX: 16.53MIN: 3.56 / MAX: 17.6MIN: 3.59 / MAX: 5.871. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenet-v1-1.0Linux 5.10.130Linux 5.15.83Linux 6.10.60261.20521.80782.41043.013SE +/- 0.044, N = 3SE +/- 0.047, N = 3SE +/- 0.028, N = 92.6782.6392.640MIN: 2.4 / MAX: 5.22MIN: 2.38 / MAX: 3.73MIN: 2.36 / MAX: 16.91. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3Linux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.36, N = 3SE +/- 0.38, N = 3SE +/- 0.32, N = 922.7322.4422.79MIN: 22.05 / MAX: 36.04MIN: 21.58 / MAX: 36.88MIN: 21.59 / MAX: 102.891. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mobilenetLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.03, N = 3SE +/- 0.18, N = 6SE +/- 0.01, N = 314.5414.7114.45MIN: 14.37 / MAX: 17.06MIN: 14.26 / MAX: 15.75MIN: 14.31 / MAX: 15.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v2-v2 - Model: mobilenet-v2Linux 5.10.130Linux 5.15.83Linux 6.11.25332.50663.75995.01326.2665SE +/- 0.01, N = 3SE +/- 0.01, N = 6SE +/- 0.01, N = 35.565.535.57MIN: 5.44 / MAX: 6.03MIN: 5.41 / MAX: 10.99MIN: 5.49 / MAX: 6.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v3-v3 - Model: mobilenet-v3Linux 5.10.130Linux 5.15.83Linux 6.11.11382.22763.34144.45525.569SE +/- 0.01, N = 3SE +/- 0.04, N = 6SE +/- 0.01, N = 34.954.954.95MIN: 4.85 / MAX: 5.91MIN: 4.8 / MAX: 63.45MIN: 4.86 / MAX: 5.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: shufflenet-v2Linux 5.10.130Linux 5.15.83Linux 6.11.27352.5473.82055.0946.3675SE +/- 0.02, N = 3SE +/- 0.01, N = 6SE +/- 0.01, N = 35.665.595.63MIN: 5.54 / MAX: 17.07MIN: 5.48 / MAX: 6.6MIN: 5.53 / MAX: 6.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetLinux 5.10.130Linux 5.15.83Linux 6.11.10482.20963.31444.41925.524SE +/- 0.03, N = 3SE +/- 0.00, N = 6SE +/- 0.01, N = 34.914.854.89MIN: 4.74 / MAX: 16.51MIN: 4.72 / MAX: 7.62MIN: 4.81 / MAX: 5.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.02, N = 3SE +/- 0.01, N = 6SE +/- 0.01, N = 37.066.997.04MIN: 6.92 / MAX: 7.42MIN: 6.89 / MAX: 8.15MIN: 6.92 / MAX: 7.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceLinux 5.10.130Linux 5.15.83Linux 6.10.53551.0711.60652.1422.6775SE +/- 0.01, N = 3SE +/- 0.00, N = 6SE +/- 0.01, N = 32.382.292.36MIN: 2.2 / MAX: 2.75MIN: 2.23 / MAX: 3.1MIN: 2.3 / MAX: 2.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.05, N = 3SE +/- 0.02, N = 6SE +/- 0.02, N = 311.5711.4611.48MIN: 11.39 / MAX: 11.86MIN: 11.27 / MAX: 12.43MIN: 11.33 / MAX: 12.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vgg16Linux 5.10.130Linux 5.15.83Linux 6.1714212835SE +/- 0.13, N = 3SE +/- 1.00, N = 6SE +/- 0.10, N = 326.9527.6926.52MIN: 26.65 / MAX: 27.51MIN: 26.21 / MAX: 33.47MIN: 26.22 / MAX: 27.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet18Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.04, N = 3SE +/- 0.22, N = 6SE +/- 0.01, N = 38.098.057.85MIN: 7.89 / MAX: 9.29MIN: 7.68 / MAX: 9.97MIN: 7.74 / MAX: 10.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: alexnetLinux 5.10.130Linux 5.15.83Linux 6.11.2332.4663.6994.9326.165SE +/- 0.01, N = 3SE +/- 0.08, N = 6SE +/- 0.01, N = 35.465.485.46MIN: 5.35 / MAX: 5.85MIN: 5.3 / MAX: 6.07MIN: 5.35 / MAX: 9.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50Linux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.05, N = 3SE +/- 0.34, N = 6SE +/- 0.13, N = 314.2014.2113.83MIN: 13.99 / MAX: 15.03MIN: 13.45 / MAX: 157.72MIN: 13.51 / MAX: 26.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: yolov4-tinyLinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.07, N = 3SE +/- 0.39, N = 6SE +/- 0.09, N = 323.6023.8923.35MIN: 23.16 / MAX: 27.3MIN: 22.91 / MAX: 31.78MIN: 23.01 / MAX: 26.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: squeezenet_ssdLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.12, N = 3SE +/- 0.12, N = 6SE +/- 0.14, N = 317.1316.8516.76MIN: 16.75 / MAX: 17.86MIN: 16.41 / MAX: 19.23MIN: 16.41 / MAX: 17.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mLinux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.15, N = 3SE +/- 0.02, N = 6SE +/- 0.03, N = 318.8318.6718.70MIN: 18.43 / MAX: 58.94MIN: 18.39 / MAX: 21.55MIN: 18.43 / MAX: 19.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.96, N = 3SE +/- 0.40, N = 6SE +/- 0.61, N = 3160.27161.23160.39MIN: 158.5 / MAX: 166.42MIN: 158.43 / MAX: 179.56MIN: 158.59 / MAX: 172.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetLinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.03, N = 3SE +/- 0.02, N = 6SE +/- 0.02, N = 37.026.916.96MIN: 6.87 / MAX: 7.89MIN: 6.78 / MAX: 7.67MIN: 6.86 / MAX: 7.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 7.68, N = 3SE +/- 8.21, N = 3SE +/- 5.43, N = 31357.371356.351357.10MIN: 1303.04 / MAX: 1429.1MIN: 1238.64 / MAX: 1424.43MIN: 1311.47 / MAX: 1435.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 6.79, N = 3SE +/- 6.63, N = 3SE +/- 4.48, N = 32400.022401.742415.31MIN: 1971.05 / MAX: 2519.43MIN: 2074.14 / MAX: 2532.54MIN: 2186.01 / MAX: 2533.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 6.93, N = 3SE +/- 9.26, N = 3SE +/- 5.75, N = 32436.302441.672451.10MIN: 2086.23 / MAX: 2572.2MIN: 2123.66 / MAX: 2621.99MIN: 2080.43 / MAX: 2583.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1714212835SE +/- 0.12, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 329.3729.2929.86MIN: 11.56 / MAX: 50.23MIN: 13.39 / MAX: 49.34MIN: 11.2 / MAX: 55.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.190180270360450SE +/- 0.17, N = 3SE +/- 0.53, N = 3SE +/- 0.59, N = 3417.71416.95416.16MIN: 260.74 / MAX: 433.77MIN: 240.72 / MAX: 434.4MIN: 211.14 / MAX: 443.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.248.348.33MIN: 4.42 / MAX: 23.84MIN: 4.49 / MAX: 23.48MIN: 4.48 / MAX: 25.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 325.5325.6225.73MIN: 13.67 / MAX: 47.14MIN: 14.62 / MAX: 46.69MIN: 14.41 / MAX: 47.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 1.34, N = 3SE +/- 0.46, N = 3SE +/- 0.78, N = 3123.34124.34124.97MIN: 64 / MAX: 136.84MIN: 64.41 / MAX: 139.86MIN: 64.13 / MAX: 142.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 38.028.018.02MIN: 4.07 / MAX: 22.04MIN: 5.89 / MAX: 26.32MIN: 6 / MAX: 25.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.14, N = 13SE +/- 0.16, N = 3SE +/- 0.15, N = 1116.4716.4616.27MIN: 7.86 / MAX: 36.14MIN: 9.28 / MAX: 33.36MIN: 7.67 / MAX: 36.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.2340.4680.7020.9361.17SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 31.041.031.04MIN: 0.61 / MAX: 17.55MIN: 0.61 / MAX: 17.94MIN: 0.61 / MAX: 17.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.11480.22960.34440.45920.574SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.500.500.51MIN: 0.31 / MAX: 16.57MIN: 0.31 / MAX: 28.92MIN: 0.32 / MAX: 15.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 1.03, N = 3SE +/- 2.20, N = 3SE +/- 4.45, N = 3758.03759.35764.74

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.33, N = 3SE +/- 0.39, N = 3SE +/- 0.93, N = 3104.16104.01104.83

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.43, N = 3SE +/- 0.31, N = 3SE +/- 0.38, N = 3144.24143.81144.21

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.14, N = 3SE +/- 0.27, N = 7SE +/- 0.11, N = 322.8423.3123.07

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 392.2191.9992.05

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 313.2713.3113.27

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1816243240SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 336.4436.5036.54

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.0949, N = 3SE +/- 0.0304, N = 3SE +/- 0.1212, N = 37.52657.44087.5359

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.04, N = 3SE +/- 0.36, N = 3SE +/- 0.32, N = 373.6873.8273.55

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 313.5813.8713.90

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.30, N = 3SE +/- 0.74, N = 3SE +/- 0.43, N = 3144.01146.95147.38

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.10, N = 3SE +/- 0.29, N = 3SE +/- 0.23, N = 326.0026.4826.87

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 2.25, N = 3SE +/- 1.90, N = 3SE +/- 2.74, N = 3752.83760.84763.31

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.59, N = 3SE +/- 0.31, N = 3SE +/- 0.22, N = 3104.00104.04103.58

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeLinux 5.10.130Linux 5.15.83Linux 6.191827364538.5438.2438.361. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeLinux 5.10.130Linux 5.15.83Linux 6.14080120160200188.28186.40186.931. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeLinux 5.10.130Linux 5.15.83Linux 6.150100150200250241.49242.25242.921. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeLinux 5.10.130Linux 5.15.83Linux 6.1300600900120015001598.701611.591607.401. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.17, N = 3152.41151.82153.23

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestLinux 5.10.130Linux 5.15.83Linux 6.120406080100SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 396.2196.3196.30

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.38, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 3256.43256.19255.89

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.08, N = 3SE +/- 0.22, N = 3SE +/- 0.29, N = 3159.75159.15160.27

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerLinux 5.10.130Linux 5.15.83Linux 6.1100