nov 2022

Intel Core i9-10980XE testing with a ASRock X299 Steel Legend (P1.30 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2211186-PTS-NOV2022026&grs.

nov 2022ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionabcdIntel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads)ASRock X299 Steel Legend (P1.30 BIOS)Intel Sky Lake-E DMI3 Registers32GBSamsung SSD 970 PRO 512GBllvmpipeRealtek ALC1220Intel I219-V + Intel I211Ubuntu 22.045.19.0-051900rc7-generic (x86_64)GNOME Shell 42.2X Server 1.21.1.34.5 Mesa 22.0.1 (LLVM 13.0.1 256 bits)1.2.204GCC 11.2.0ext41024x768GCC 11.3.0OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- a: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - b: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - c: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - d: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x5003302Java Details- a: OpenJDK Runtime Environment (build 11.0.16+8-post-Ubuntu-0ubuntu122.04)Python Details- a: Python 3.10.4- b: Python 3.10.6- c: Python 3.10.6- d: Python 3.10.6Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

nov 2022openradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containeropenradioss: Bird Strike on Windshieldxmrig: Monero - 1Mopenradioss: Cell Phone Drop Testopenradioss: Bumper Beamminibude: OpenMP - BM1minibude: OpenMP - BM1stress-ng: CPU Cachestress-ng: Futexstream: Copystream: Addnekrs: TurboPipe Periodicjpegxl: PNG - 80xmrig: Wownero - 1Mencodec: 6 kbpsdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streammemtier-benchmark: Redis - 500 - 1:10nginx: 1000minibude: OpenMP - BM2minibude: OpenMP - BM2deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamstress-ng: Context Switchingstress-ng: Socket Activitynginx: 100memtier-benchmark: Redis - 100 - 10:1encodec: 1.5 kbpsmemtier-benchmark: Redis - 500 - 10:1nginx: 500jpegxl-decode: Allnginx: 200deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streammemtier-benchmark: Redis - 50 - 1:10avifenc: 6stress-ng: Glibc C String Functionsdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamencodec: 24 kbpsdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamstress-ng: Forkingstress-ng: Glibc Qsort Data Sortingencodec: 3 kbpsstress-ng: Atomicstress-ng: Mallocdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamstress-ng: NUMAdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamavifenc: 10, Losslessdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streammemtier-benchmark: Redis - 100 - 1:10jpegxl: JPEG - 100stress-ng: CPU Stressmemtier-benchmark: Redis - 50 - 10:1jpegxl-decode: 1deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamstress-ng: Mutexdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamjpegxl: PNG - 90jpegxl: JPEG - 90jpegxl: JPEG - 80ffmpeg: libx264 - Liveffmpeg: libx264 - Livedeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamstream: Scalestream: Triadavifenc: 0encode-flac: WAV To FLACstress-ng: System V Message Passingffmpeg: libx265 - Liveffmpeg: libx265 - Livestress-ng: MMAPdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamavifenc: 2avifenc: 6, Losslessffmpeg: libx265 - Video On Demandstress-ng: IO_uringffmpeg: libx265 - Video On Demandffmpeg: libx265 - Uploaddeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamffmpeg: libx265 - Uploadstress-ng: Memory Copyingffmpeg: libx264 - Video On Demandffmpeg: libx264 - Video On Demandstress-ng: Matrix Mathffmpeg: libx265 - Platformffmpeg: libx264 - Platformffmpeg: libx264 - Platformffmpeg: libx265 - Platformffmpeg: libx264 - Uploadffmpeg: libx264 - Uploaddeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamstress-ng: SENDFILEstress-ng: Semaphoresstress-ng: Vector Mathstress-ng: Cryptostress-ng: MEMFDstress-ng: x86_64 RdRandjpegxl: PNG - 100nginx: 1abcd149.83448.58255.074275.190.93139.3824.683617.076109.182231018.8954645.337445.2547515000008.349295.130.5187.9767125.19682273405.11112607.63635.7125.42812.613679.224920.533948.67591739148.711439.27116720.151847508.4727.8691828688.06122013.05203.07123826.5924.080741.51212181532.695.6071074665.66104.426186.154833.334739.439512.170563382.24248.3728.15214752.1328814221.6635.8614250.7944172.6455377.0770.63295.208127.36072164438.130.6240568.071815526.6539.1352.00610848178.73137.347165.5168.217.898.0328.40177.81747.416512.040734792.337200.9129.2219.1287428020.3742.14119.843422508381.8411.419187.56465.1189.04718.298275.62414.185731532268.83073945111.448387.34029.392290.48182.6941.4691688.34415.60182.54404106441.5018.2311.15226.53902440281.78112.2128329744.473620967.3671473.9723419.38935.33183704.450.63255.33753.75356.243255.7116.56177.7119.961499.02594.891930709.945846141999.6489354000007.428332.628.7687.6208131.02712288186.35119359.88603.65424.14613.077676.416321.27646.97871663783.2811951.95121173.351810183.5927.1451840366.78125819.87202.6127371.9323.934841.76552166285.45.7461101201.72106.894984.167532.931755.736411.908162600.72251.727.879218695.728268669.7136.5362246.1822175.3446379.9571.81875.295125.28022191856.430.6240511.291838853.5939.0951.277310967231.03139.243464.62468.17.797.9328.49177.26754.357511.9334950.337485.8130.1219.2457488095.7442.25119.52382.2911.376487.892665.5669.09618.288269.74414.40269.00728410111.432287.46379.392287.21183.0841.3891556.77414.28183.0541.3818.2811.12227.09104600281.780712.2137329996.233620168.5571453.123416.93935.2183724.640.63151.02450.51255.454256.190.88139.0224.706617.65698.981970562.4251121.737162.1552423000008.289252.827.6787.3757135.37432379306.57118980.62637.53525.50112.908277.419221.736345.9861760166.5711462.16120856.04179451026.8191878888.87126262.61206.19127466.6323.610142.33872170271.655.6851083790.67105.806885.034433.152754.938411.920862414.8252.2728.445218902.5128541098.8536.2631248.0349175.5005379.2571.54065.233125.76662156150.890.6140451.171840001.0338.8151.27110981744.56139.157364.66498.177.86828.75175.65755.450211.912734548.937127.1129.72319.3067488945.4542.39119.14380.3911.446887.351765.4149.0418.208236.75416.09270.0611.441587.39229.352284.45182.6641.4791394.53414.552063499182.70788772241.4618.2711.13226.8281.645112.233329952.093621541.371479.9523420.58935.2183701.750.63150.49448.89255.184257.190.93139.424.78619.48990.122221622.750621.737150.9551821000008.269194.629.037.3166136.45342228918.2118768.65639.63625.58513.35974.810221.466946.56151742819.2311510.02121546.391777635.3927.7511898579.75125975.65199.49127354.9324.269441.1892220594.725.6771093501.76106.247584.681932.599755.519411.911662026.77253.6727.957215083.5528366995.3136.0832249.2601175.7366373.5271.70835.295125.47272165890.80.6141106.491811176.6138.5251.199311003558.74138.963664.75478.177.867.9828.42177.70756.503311.896134556.937103.9128.85319.2787478133.1442.06120.07379.4611.456387.280465.3299.05918.288248.78414.35269.3311.397687.72859.382282.41182.4541.5291594.4414.939431741182.51204851541.5018.2611.13226.9681.778712.2139329754.553622252.2171454.7923425.43935.17183700.680.63OpenBenchmarking.org

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal Installationabcd60120180240300149.83255.33151.02150.49

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop Containerabcd160320480640800448.58753.75450.51448.89

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on Windshieldabcd80160240320400255.07356.24255.45255.18

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1Mabcd90018002700360045004275.13255.74256.14257.11. (CXX) g++ options: -march=znver3 -O3 -fexceptions -fno-rtti -maes -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop Testabcd30609012015090.93116.5690.8890.93

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper Beamabcd4080120160200139.38177.71139.02139.40

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1abcd61218243024.6819.9624.7124.781. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1abcd130260390520650617.08499.03617.66619.491. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU Cacheabcd20406080100109.1894.8998.9890.121. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Futexabcd500K1000K1500K2000K2500K2231018.891930709.941970562.422221622.701. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stream

Type: Copy

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Copyabcd13K26K39K52K65K54645.358461.051121.750621.71. (CC) gcc options: -march=znver3 -O3 -march=native -fopenmp

Stream

Type: Add

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Addabcd9K18K27K36K45K37445.241999.637162.137150.91. (CC) gcc options: -march=znver3 -O3 -march=native -fopenmp

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe Periodicabcd12000M24000M36000M48000M60000M547515000004893540000055242300000551821000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi

JPEG XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 80abcd2468108.347.428.288.261. (CXX) g++ options: -march=znver3 -O3 -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1Mabcd2K4K6K8K10K9295.18332.69252.89194.61. (CXX) g++ options: -march=znver3 -O3 -fexceptions -fno-rtti -maes -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

EnCodec

Target Bandwidth: 6 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbpsabcd71421283530.5228.7727.6829.03

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamabcd2468107.97677.62087.37577.3166

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamabcd306090120150125.20131.03135.37136.45

memtier_benchmark

Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:10abcd500K1000K1500K2000K2500K2273405.112288186.352379306.572228918.201. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

nginx

Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000abcd30K60K90K120K150K112607.63119359.88118980.62118768.651. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2abcd140280420560700635.71603.65637.54639.641. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2abcd61218243025.4324.1525.5025.591. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streamabcd369121512.6113.0812.9113.36

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streamabcd2040608010079.2276.4277.4274.81

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Streamabcd51015202520.5321.2821.7421.47

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Streamabcd112233445548.6846.9845.9946.56

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Context Switchingabcd400K800K1200K1600K2000K1739148.701663783.281760166.571742819.231. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Socket Activityabcd3K6K9K12K15K11439.2711951.9511462.1611510.021. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

nginx

Connections: 100

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 100abcd30K60K90K120K150K116720.15121173.35120856.04121546.391. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 10:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 10:1abcd400K800K1200K1600K2000K1847508.471810183.591794510.001777635.391. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

EnCodec

Target Bandwidth: 1.5 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbpsabcd71421283527.8727.1526.8227.75

memtier_benchmark

Protocol: Redis - Clients: 500 - Set To Get Ratio: 10:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 500 - Set To Get Ratio: 10:1abcd400K800K1200K1600K2000K1828688.061840366.781878888.871898579.751. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500abcd30K60K90K120K150K122013.05125819.87126262.61125975.651. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

JPEG XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: Allabcd50100150200250203.07202.60206.19199.49

nginx

Connections: 200

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 200abcd30K60K90K120K150K123826.59127371.93127466.63127354.931. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Streamabcd61218243024.0823.9323.6124.27

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Streamabcd102030405041.5141.7742.3441.19

memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10abcd500K1000K1500K2000K2500K2181532.692166285.402170271.652220594.721. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6abcd1.29292.58583.87875.17166.46455.6075.7465.6855.6771. (CXX) g++ options: -O3 -fPIC -march=znver3 -lm

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc C String Functionsabcd200K400K600K800K1000K1074665.661101201.721083790.671093501.761. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabcd20406080100104.43106.89105.81106.25

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabcd2040608010086.1584.1785.0384.68

EnCodec

Target Bandwidth: 24 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbpsabcd81624324033.3332.9333.1532.60

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamabcd160320480640800739.44755.74754.94755.52

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamabcd369121512.1711.9111.9211.91

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Forkingabcd14K28K42K56K70K63382.2462600.7262414.8062026.771. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc Qsort Data Sortingabcd60120180240300248.37251.70252.27253.671. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

EnCodec

Target Bandwidth: 3 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbpsabcd71421283528.1527.8828.4527.96

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Atomicabcd50K100K150K200K250K214752.13218695.70218902.51215083.551. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Mallocabcd6M12M18M24M30M28814221.6628268669.7128541098.8528366995.311. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabcd81624324035.8636.5436.2636.08

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabcd50100150200250250.79246.18248.03249.26

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamabcd4080120160200172.65175.34175.50175.74

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMAabcd80160240320400377.07379.95379.25373.521. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabcd163248648070.6371.8271.5471.71

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, Losslessabcd1.19142.38283.57424.76565.9575.2085.2955.2335.2951. (CXX) g++ options: -O3 -fPIC -march=znver3 -lm

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabcd306090120150127.36125.28125.77125.47

memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10abcd500K1000K1500K2000K2500K2164438.132191856.432156150.892165890.801. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100abcd0.13950.2790.41850.5580.69750.620.620.610.611. (CXX) g++ options: -march=znver3 -O3 -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU Stressabcd9K18K27K36K45K40568.0740511.2940451.1741106.491. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 10:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 10:1abcd400K800K1200K1600K2000K1815526.651838853.591840001.031811176.611. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

JPEG XL Decoding libjxl

CPU Threads: 1

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 1abcd91827364539.1339.0938.8138.52

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamabcd122436486052.0151.2851.2751.20

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Mutexabcd2M4M6M8M10M10848178.7310967231.0310981744.5611003558.741. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamabcd306090120150137.35139.24139.16138.96

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamabcd153045607565.5264.6264.6664.75

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90abcd2468108.218.108.178.171. (CXX) g++ options: -march=znver3 -O3 -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90abcd2468107.897.797.867.861. (CXX) g++ options: -march=znver3 -O3 -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80abcd2468108.037.938.007.981. (CXX) g++ options: -march=znver3 -O3 -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

FFmpeg

Encoder: libx264 - Scenario: Live

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 5.1.2Encoder: libx264 - Scenario: Liveabcd71421283528.4028.4928.7528.421. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 5.1.2Encoder: libx264 - Scenario: Liveabcd4080120160200177.81177.26175.65177.701. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcd160320480640800747.42754.36755.45756.50

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabcd369121512.0411.9311.9111.90

Stream

Type: Scale

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Scaleabcd7K14K21K28K35K34792.334950.334548.934556.91. (CC) gcc options: -march=znver3 -O3 -march=native -fopenmp

Stream

Type: Triad

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Triadabcd8K16K24K32K40K37200.937485.837127.137103.91. (CC) gcc options: -march=znver3 -O3 -march=native -fopenmp

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0abcd306090120150129.22130.12129.72128.851. (CXX) g++ options: -O3 -fPIC -march=znver3 -lm

FLAC Audio Encoding

WAV To FLAC

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4WAV To FLACabcd51015202519.1319.2519.3119.281. (CXX) g++ options: -O3 -march=znver3 -fvisibility=hidden -logg -lm

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: System V Message Passingabcd1.6M3.2M4.8M6.4M8M7428020.377488095.747488945.457478133.141. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

FFmpeg

Encoder: libx265 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 5.1.2Encoder: libx265 - Scenario: Liveabcd102030405042.1442.2542.3942.061. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Live

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 5.1.2Encoder: libx265 - Scenario: Liveabcd306090120150119.84119.52119.14120.071. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAPabcd80160240320400381.84382.29380.39379.461. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamabcd369121511.4211.3811.4511.46

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamabcd2040608010087.5687.8987.3587.28

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2abcd153045607565.1265.5765.4165.331. (CXX) g++ options: -O3 -fPIC -march=znver3 -lm

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, Losslessabcd36912159.0479.0969.0409.0591. (CXX) g++ options: -O3 -fPIC -march=znver3 -lm

FFmpeg

Encoder: libx265 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 5.1.2Encoder: libx265 - Scenario: Video On Demandabcd51015202518.2918.2818.2018.281. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringabcd2K4K6K8K10K8275.628269.748236.758248.781. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

FFmpeg

Encoder: libx265 - Scenario: Video On Demand

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 5.1.2Encoder: libx265 - Scenario: Video On Demandabcd90180270360450414.19414.40416.09414.351. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Upload

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 5.1.2Encoder: libx265 - Scenario: Uploadabcd60120180240300268.83269.01270.06269.331. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamabcd369121511.4511.4311.4411.40

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamabcd2040608010087.3487.4687.3987.73

FFmpeg

Encoder: libx265 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 5.1.2Encoder: libx265 - Scenario: Uploadabcd36912159.399.399.359.381. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Memory Copyingabcd50010001500200025002290.482287.212284.452282.411. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

FFmpeg

Encoder: libx264 - Scenario: Video On Demand

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 5.1.2Encoder: libx264 - Scenario: Video On Demandabcd4080120160200182.69183.08182.66182.451. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 5.1.2Encoder: libx264 - Scenario: Video On Demandabcd91827364541.4641.3841.4741.521. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Matrix Mathabcd20K40K60K80K100K91688.3491556.7791394.5391594.401. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

FFmpeg

Encoder: libx265 - Scenario: Platform

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 5.1.2Encoder: libx265 - Scenario: Platformabcd90180270360450415.60414.28414.55414.941. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Platform

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 5.1.2Encoder: libx264 - Scenario: Platformabcd4080120160200182.54183.05182.71182.511. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 5.1.2Encoder: libx264 - Scenario: Platformabcd91827364541.5041.3841.4641.501. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx265 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 5.1.2Encoder: libx265 - Scenario: Platformabcd4812162018.2318.2818.2718.261. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 5.1.2Encoder: libx264 - Scenario: Uploadabcd369121511.1511.1211.1311.131. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Upload

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 5.1.2Encoder: libx264 - Scenario: Uploadabcd50100150200250226.54227.09226.82226.961. (CXX) g++ options: -march=znver3 -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Streamabcd2040608010081.7881.7881.6581.78

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Streamabcd369121512.2112.2112.2312.21

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILEabcd70K140K210K280K350K329744.47329996.23329952.09329754.551. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Semaphoresabcd800K1600K2400K3200K4000K3620967.363620168.553621541.303622252.211. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Vector Mathabcd15K30K45K60K75K71473.9771453.1071479.9571454.791. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Cryptoabcd5K10K15K20K25K23419.3823416.9323420.5823425.431. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MEMFDabcd2004006008001000935.33935.20935.20935.171. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: x86_64 RdRandabcd40K80K120K160K200K183704.45183724.64183701.75183700.681. (CC) gcc options: -march=znver3 -O3 -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lmd -lrt -lsctp -lz -pthread

JPEG XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100abcd0.14180.28360.42540.56720.7090.630.630.630.631. (CXX) g++ options: -march=znver3 -O3 -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

Phoronix Test Suite v10.8.4