Intel Xeon Platinum 8490H 1P vs. 2P Benchmarks

Sapphire Rapids launch day benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2301101-PTS-SPREXTRA34.

Intel Xeon Platinum 8490H 1P vs. 2P BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionXeon Platinum 8490HXeon Platinum 8490H 2PIntel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads)Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)Intel Device 1bce512GB3841GB Micron_9300_MTFDHAL3T8TDPASPEEDVGA HDMI4 x Intel E810-C for QSFPUbuntu 22.106.0.0-060000rc3daily20220904-generic (x86_64)GNOME ShellX Server 1.21.1.31.3.211GCC 12.2.0ext41920x10802 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads)1008GB3841GB Micron_9300_MTFDHAL3T8TDP + 960GB INTEL SSDSC2KG964 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-TOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Wbc0TK/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Wbc0TK/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0Java Details- OpenJDK Runtime Environment (build 11.0.16+8-post-Ubuntu-0ubuntu1)Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Intel Xeon Platinum 8490H 1P vs. 2P Benchmarksgromacs: MPI CPU - water_GMX50_barenamd: ATPase Simulation - 327,506 Atomsgraph500: 26graph500: 26graph500: 26graph500: 26hpcg: wrf: conus 2.5kmrelion: Basic - CPUamg: incompact3d: input.i3d 193 Cells Per Directionincompact3d: X3D-benchmarking input.i3dlulesh: pennant: leblancbigpennant: sedovbigmt-dgemm: Sustained Floating-Point Ratenwchem: C240 Buckyballnpb: BT.Cnpb: EP.Cnpb: EP.Dnpb: FT.Cnpb: LU.Cnpb: SP.Bnpb: SP.Cnpb: IS.Dnpb: MG.Cnpb: CG.Crodinia: OpenMP LavaMDopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUaskap: tConvolve MPI - Degriddingaskap: tConvolve MPI - Griddinglczero: Eigenonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUbuild-llvm: Ninjabuild-llvm: Unix Makefilesbuild-gem5: Time To Compilebuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-mesa: Time To Compilebuild-mplayer: Time To Compilebuild-nodejs: Time To Compilebuild2: Time To Compiledacapobench: Jythoncompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingcompress-zstd: 19 - Compression Speedcompress-zstd: 19, Long Mode - Decompression Speedblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyblender: Barbershop - CPU-Onlyc-ray: Total Time - 4K, 16 Rays Per Pixelpovray: Trace Timeembree: Pathtracer - Asian Dragonembree: Pathtracer - Crownembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownoidn: RT.hdr_alb_nrm.3840x2160oidn: RT.ldr_alb_nrm.3840x2160oidn: RTLightmap.hdr.4096x4096ospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 2 - 4K - 1 - Path Tracerospray-studio: 2 - 4K - 16 - Path Tracerospray-studio: 2 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracerluxcorerender: DLSC - CPUluxcorerender: Orange Juice - CPUgraphics-magick: Enhancedgraphics-magick: Sharpenastcenc: Mediumastcenc: Thoroughastcenc: Exhaustiveetcpak: Multi-Threaded - ETC2ebizzy: node-express-loadtest: simdjson: PartialTweetssimdjson: LargeRandsimdjson: Kostyasimdjson: DistinctUserIDsimdjson: TopTweetbrl-cad: VGR Performance Metricpybench: Total For Average Test Timespyperformance: crypto_pyaespyperformance: django_templatepyperformance: json_loadspyperformance: regex_compilenumpy: phpbench: PHP Benchmark Suitesrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMsrsran: OFDM_Testliquid-dsp: 32 - 256 - 57liquid-dsp: 64 - 256 - 57liquid-dsp: 128 - 256 - 57liquid-dsp: 256 - 256 - 57pjsip: OPTIONS, Statelessquantlib: openssl: RSA4096openssl: RSA4096openssl: SHA256xmrig: Monero - 1Mxmrig: Wownero - 1Msysbench: CPUm-queens: Time To Solvecoremark: CoreMark Size 666 - Iterations Per Secondasmfish: 1024 Hash Memory, 26 Depthtachyon: Total Timeopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamopenradioss: Bird Strike on Windshieldopenradioss: Cell Phone Drop Testopenradioss: Bumper Beamopenradioss: INIVOL and Fluid Structure Interaction Drop Containeropenvino: Face Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUcompress-zstd: 19 - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P8.5810.290761040570000107366000032323100045085600032.077011881.128402.132161697166712.8350466352.79410625990.5165.20626916.3063422.4115943851.6179308.216988.767832.0868514.71135606.00111530.9471661.252812.2084251.8533480.7642.64070.58424.67150.8782929.060.6291377.530.5725.551167.8325.531169.1516703.647839.517.523266.121892.8515.833656.9416.37448.5966.6617623.921469.3105130.6363940.4925161.10812155.921216.613174.41642.13331.646263.28824.62711.745174.86759.714255737874129124889.93003.525.5267.6836.0588.96277.9910.6679.80969.459357.266583.208463.81752.632.641.2519.610224.11691603256855132616272609552081193130888675188.4612.891132692287.817942.02754.07226573.6732951024119025.601.303.496.536.7782904677179.034.918.7132458.09947570144.1152.1132.4144.9132.388.31607000002254333333339870000034680333333583066667340413167.914735.9979532.16296477137727397.835200.5155262.7014.7852162643.67844813044717025.826231.75810642.688031149.14298418.902550.6457790.5194510.28181253.831418.5696218.3873137.3177103.82179.6255447.960566.9457279.45953.5734769.779338.941527.713336.077547.445484.543911.8188192.9925155.4013121.25218.2415318.932593.998627.665036.140047.2877130.1732.3881.34152.91396.763.5818.352857.451.9373.0405.0365.2403.8629.5855630.225815.1270.258491022520000106569000037465600051261000061.75226577.818209.01030800703336.30612000197.56733246081.2222.56953511.2982745.7138153760.7334076.7612397.4315397.23109091.04263945.03185110.02151124.553606.51167584.2858234.4926.516197.81151.49376.67152169.330.45121729.470.8140.14744.6540.08745.8645149.7522725.255.166038.493801.487.887533.4915.90719.2241.5134531.142175.0119760.4356540.2679390.744021105.732181.016164.02136.65823.566156.11422.7509.350125.27054.545266455768255675592.22841.414.0535.9020.0147.14150.545.5356.655106.249384.9362122.368391.30754.224.252.0136.448142.3755857136282731687813844276511031163733275910.3616.6817591161492.938278.97638.06296955.4835066751108615.681.283.496.536.80437414577078.834.718.7132455.27951782144.4152.4133.7145.4132.888.41603666672234066667427990000062762000006629166667342823167.828605.01891795.012231400362046050.461104.8310297.607.6484299941.22912823090109013.317632.86526529.21841155.85613192.689660.4317880.2621140.26416052.600319.0029426.8408140.3803103.24469.6785877.371568.3153281.81553.54341499.500439.966126.282738.042992.155782.949212.0464364.7952164.178895.041310.5177594.0229100.765026.554937.649592.1671141.6726.8281.73112.02318.002.6119.852713.450.6371.4407.4364.7402.7647.8241646.4008OpenBenchmarking.org

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2022.1Implementation: MPI CPU - Input: water_GMX50_bareXeon Platinum 8490HXeon Platinum 8490H 2P48121620SE +/- 0.006, N = 3SE +/- 0.045, N = 38.58115.1271. (CXX) g++ options: -O3

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsXeon Platinum 8490HXeon Platinum 8490H 2P0.06540.13080.19620.26160.327SE +/- 0.00022, N = 3SE +/- 0.00249, N = 30.290760.25849

Graph500

Scale: 26

OpenBenchmarking.orgbfs median_TEPS, More Is BetterGraph500 3.0Scale: 26Xeon Platinum 8490HXeon Platinum 8490H 2P200M400M600M800M1000M104057000010225200001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Graph500

Scale: 26

OpenBenchmarking.orgbfs max_TEPS, More Is BetterGraph500 3.0Scale: 26Xeon Platinum 8490HXeon Platinum 8490H 2P200M400M600M800M1000M107366000010656900001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Graph500

Scale: 26

OpenBenchmarking.orgsssp median_TEPS, More Is BetterGraph500 3.0Scale: 26Xeon Platinum 8490HXeon Platinum 8490H 2P80M160M240M320M400M3232310003746560001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Graph500

Scale: 26

OpenBenchmarking.orgsssp max_TEPS, More Is BetterGraph500 3.0Scale: 26Xeon Platinum 8490HXeon Platinum 8490H 2P110M220M330M440M550M4508560005126100001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

High Performance Conjugate Gradient

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1Xeon Platinum 8490HXeon Platinum 8490H 2P1428425670SE +/- 0.00, N = 3SE +/- 0.68, N = 1232.0861.751. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

WRF

Input: conus 2.5km

OpenBenchmarking.orgSeconds, Fewer Is BetterWRF 4.2.2Input: conus 2.5kmXeon Platinum 8490HXeon Platinum 8490H 2P3K6K9K12K15K11881.136577.821. (F9X) gfortran options: -O2 -ftree-vectorize -funroll-loops -ffree-form -fconvert=big-endian -frecord-marker=4 -fallow-invalid-boz -lesmf_time -lwrfio_nf -lnetcdff -lnetcdf -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

RELION

Test: Basic - Device: CPU

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 3.1.1Test: Basic - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P90180270360450SE +/- 4.31, N = 3SE +/- 1.79, N = 8402.13209.011. (CXX) g++ options: -fopenmp -std=c++0x -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -lmpi_cxx -lmpi

Algebraic Multi-Grid Benchmark

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2Xeon Platinum 8490HXeon Platinum 8490H 2P700M1400M2100M2800M3500MSE +/- 775406.63, N = 3SE +/- 2176637.03, N = 3161697166730800703331. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi

Xcompact3d Incompact3d

Input: input.i3d 193 Cells Per Direction

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per DirectionXeon Platinum 8490HXeon Platinum 8490H 2P3691215SE +/- 0.00718141, N = 4SE +/- 0.01534019, N = 612.835046606.306120001. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

Xcompact3d Incompact3d

Input: X3D-benchmarking input.i3d

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dXeon Platinum 8490HXeon Platinum 8490H 2P80160240320400SE +/- 4.13, N = 4SE +/- 2.44, N = 3352.79197.571. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

LULESH

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3Xeon Platinum 8490HXeon Platinum 8490H 2P10K20K30K40K50KSE +/- 39.15, N = 6SE +/- 96.62, N = 525990.5246081.221. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi

Pennant

Test: leblancbig

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: leblancbigXeon Platinum 8490HXeon Platinum 8490H 2P1.17142.34283.51424.68565.857SE +/- 0.034026, N = 7SE +/- 0.020631, N = 95.2062692.5695351. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

Pennant

Test: sedovbig

OpenBenchmarking.orgHydro Cycle Time - Seconds, Fewer Is BetterPennant 1.0.1Test: sedovbigXeon Platinum 8490HXeon Platinum 8490H 2P48121620SE +/- 0.02, N = 3SE +/- 0.01, N = 416.3111.301. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi

ACES DGEMM

Sustained Floating-Point Rate

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateXeon Platinum 8490HXeon Platinum 8490H 2P1020304050SE +/- 0.19, N = 5SE +/- 0.30, N = 722.4145.711. (CC) gcc options: -O3 -march=native -fopenmp

NWChem

Input: C240 Buckyball

OpenBenchmarking.orgSeconds, Fewer Is BetterNWChem 7.0.2Input: C240 BuckyballXeon Platinum 8490HXeon Platinum 8490H 2P80016002400320040003851.63760.71. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2

NAS Parallel Benchmarks

Test / Class: BT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.CXeon Platinum 8490HXeon Platinum 8490H 2P70K140K210K280K350KSE +/- 335.77, N = 3SE +/- 231.33, N = 5179308.21334076.761. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.CXeon Platinum 8490HXeon Platinum 8490H 2P3K6K9K12K15KSE +/- 62.59, N = 15SE +/- 70.37, N = 126988.7612397.431. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: EP.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.DXeon Platinum 8490HXeon Platinum 8490H 2P3K6K9K12K15KSE +/- 26.92, N = 3SE +/- 28.18, N = 57832.0815397.231. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: FT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.CXeon Platinum 8490HXeon Platinum 8490H 2P20K40K60K80K100KSE +/- 518.21, N = 6SE +/- 969.11, N = 1568514.71109091.041. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.CXeon Platinum 8490HXeon Platinum 8490H 2P60K120K180K240K300KSE +/- 179.86, N = 4SE +/- 192.74, N = 5135606.00263945.031. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: SP.B

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.BXeon Platinum 8490HXeon Platinum 8490H 2P40K80K120K160K200KSE +/- 226.33, N = 8SE +/- 740.00, N = 10111530.94185110.021. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: SP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.CXeon Platinum 8490HXeon Platinum 8490H 2P30K60K90K120K150KSE +/- 179.87, N = 3SE +/- 391.00, N = 571661.25151124.551. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: IS.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.DXeon Platinum 8490HXeon Platinum 8490H 2P8001600240032004000SE +/- 19.69, N = 4SE +/- 33.07, N = 72812.203606.511. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: MG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.CXeon Platinum 8490HXeon Platinum 8490H 2P40K80K120K160K200KSE +/- 121.29, N = 10SE +/- 1087.50, N = 1584251.85167584.281. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

NAS Parallel Benchmarks

Test / Class: CG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.CXeon Platinum 8490HXeon Platinum 8490H 2P12K24K36K48K60KSE +/- 132.41, N = 7SE +/- 173.40, N = 933480.7658234.491. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.4

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDXeon Platinum 8490HXeon Platinum 8490H 2P1020304050SE +/- 0.06, N = 3SE +/- 0.11, N = 342.6426.521. (CXX) g++ options: -O2 -lOpenCL

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P4080120160200SE +/- 0.05, N = 3SE +/- 0.12, N = 370.58197.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P90180270360450SE +/- 0.29, N = 3SE +/- 0.09, N = 3424.67151.49MIN: 324.89 / MAX: 491.29MIN: 123.14 / MAX: 273.71. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P80160240320400SE +/- 0.45, N = 3SE +/- 0.66, N = 3150.87376.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P30K60K90K120K150KSE +/- 111.96, N = 3SE +/- 667.44, N = 382929.06152169.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P0.13950.2790.41850.5580.6975SE +/- 0.00, N = 3SE +/- 0.00, N = 30.620.45MIN: 0.31 / MAX: 23.57MIN: 0.33 / MAX: 78.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P30K60K90K120K150KSE +/- 1248.62, N = 13SE +/- 1999.64, N = 1291377.53121729.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P0.18230.36460.54690.72920.9115SE +/- 0.01, N = 13SE +/- 0.03, N = 120.570.81MIN: 0.27 / MAX: 25.17MIN: 0.29 / MAX: 40.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P918273645SE +/- 0.05, N = 3SE +/- 0.10, N = 325.5540.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P30060090012001500SE +/- 2.53, N = 3SE +/- 2.09, N = 31167.83744.65MIN: 600.36 / MAX: 1656.84MIN: 515.46 / MAX: 1463.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P918273645SE +/- 0.01, N = 3SE +/- 0.45, N = 325.5340.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P30060090012001500SE +/- 0.26, N = 3SE +/- 8.26, N = 31169.15745.86MIN: 870.58 / MAX: 1651.76MIN: 475.57 / MAX: 1408.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P10K20K30K40K50KSE +/- 9.01, N = 3SE +/- 54.08, N = 316703.6445149.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P5K10K15K20K25KSE +/- 60.72, N = 10SE +/- 252.27, N = 47839.5122725.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P246810SE +/- 0.05, N = 10SE +/- 0.05, N = 47.525.16MIN: 2.66 / MAX: 31.82MIN: 4.27 / MAX: 91.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P13002600390052006500SE +/- 3.43, N = 3SE +/- 6.74, N = 33266.126038.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P8001600240032004000SE +/- 1.95, N = 3SE +/- 2.04, N = 31892.853801.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P48121620SE +/- 0.02, N = 3SE +/- 0.01, N = 315.837.88MIN: 7.8 / MAX: 50.59MIN: 7.12 / MAX: 60.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P16003200480064008000SE +/- 5.03, N = 3SE +/- 17.07, N = 33656.947533.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P48121620SE +/- 0.02, N = 3SE +/- 0.03, N = 316.3715.90MIN: 9.29 / MAX: 49.62MIN: 13.66 / MAX: 82.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P160320480640800SE +/- 0.03, N = 3SE +/- 2.72, N = 3448.59719.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P1530456075SE +/- 0.01, N = 3SE +/- 0.15, N = 366.6641.51MIN: 23.93 / MAX: 106.71MIN: 27.82 / MAX: 338.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

ASKAP

Test: tConvolve MPI - Degridding

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - DegriddingXeon Platinum 8490HXeon Platinum 8490H 2P7K14K21K28K35KSE +/- 52.77, N = 3SE +/- 305.60, N = 317623.934531.11. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

ASKAP

Test: tConvolve MPI - Gridding

OpenBenchmarking.orgMpix/sec, More Is BetterASKAP 1.0Test: tConvolve MPI - GriddingXeon Platinum 8490HXeon Platinum 8490H 2P9K18K27K36K45KSE +/- 78.37, N = 3SE +/- 303.43, N = 321469.342175.01. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenXeon Platinum 8490HXeon Platinum 8490H 2P3K6K9K12K15KSE +/- 64.57, N = 3SE +/- 76.29, N = 310513119761. (CXX) g++ options: -flto -pthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUXeon Platinum 8490HXeon Platinum 8490H 2P0.14320.28640.42960.57280.716SE +/- 0.000967, N = 7SE +/- 0.002329, N = 70.6363940.435654MIN: 0.54MIN: 0.381. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUXeon Platinum 8490HXeon Platinum 8490H 2P0.11080.22160.33240.44320.554SE +/- 0.000571, N = 7SE +/- 0.001562, N = 70.4925160.267939MIN: 0.42MIN: 0.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUXeon Platinum 8490HXeon Platinum 8490H 2P0.24930.49860.74790.99721.2465SE +/- 0.000893, N = 9SE +/- 0.001670, N = 91.1081200.744021MIN: 1.08MIN: 0.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: NinjaXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.37, N = 3SE +/- 0.40, N = 3155.92105.73

Timed LLVM Compilation

Build System: Unix Makefiles

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: Unix MakefilesXeon Platinum 8490HXeon Platinum 8490H 2P50100150200250SE +/- 0.44, N = 3SE +/- 0.46, N = 3216.61181.02

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To CompileXeon Platinum 8490HXeon Platinum 8490H 2P4080120160200SE +/- 1.49, N = 3SE +/- 0.74, N = 3174.42164.02

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To CompileXeon Platinum 8490HXeon Platinum 8490H 2P1020304050SE +/- 0.03, N = 3SE +/- 0.38, N = 442.1336.66

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.18Build: defconfigXeon Platinum 8490HXeon Platinum 8490H 2P714212835SE +/- 0.30, N = 3SE +/- 0.25, N = 431.6523.57

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.18Build: allmodconfigXeon Platinum 8490HXeon Platinum 8490H 2P60120180240300SE +/- 0.49, N = 3SE +/- 0.49, N = 3263.29156.11

Timed Mesa Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 21.0Time To CompileXeon Platinum 8490HXeon Platinum 8490H 2P612182430SE +/- 0.07, N = 3SE +/- 0.13, N = 324.6322.75

Timed MPlayer Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MPlayer Compilation 1.5Time To CompileXeon Platinum 8490HXeon Platinum 8490H 2P3691215SE +/- 0.059, N = 4SE +/- 0.052, N = 511.7459.350

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To CompileXeon Platinum 8490HXeon Platinum 8490H 2P4080120160200SE +/- 0.47, N = 3SE +/- 0.59, N = 3174.87125.27

Build2

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.13Time To CompileXeon Platinum 8490HXeon Platinum 8490H 2P1326395265SE +/- 0.14, N = 3SE +/- 0.14, N = 359.7154.55

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonXeon Platinum 8490HXeon Platinum 8490H 2P6001200180024003000SE +/- 20.10, N = 8SE +/- 22.04, N = 925572664

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingXeon Platinum 8490HXeon Platinum 8490H 2P120K240K360K480K600KSE +/- 74.62, N = 3SE +/- 4200.11, N = 33787415576821. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingXeon Platinum 8490HXeon Platinum 8490H 2P120K240K360K480K600KSE +/- 197.90, N = 3SE +/- 925.70, N = 32912485567551. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19 - Compression SpeedXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.13, N = 3SE +/- 0.51, N = 389.992.21. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19, Long Mode - Decompression SpeedXeon Platinum 8490HXeon Platinum 8490H 2P6001200180024003000SE +/- 7.21, N = 3SE +/- 2.47, N = 153003.52841.41. (CC) gcc options: -O3 -pthread -lz -llzma

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.3Blend File: BMW27 - Compute: CPU-OnlyXeon Platinum 8490HXeon Platinum 8490H 2P612182430SE +/- 0.03, N = 3SE +/- 0.06, N = 425.5214.05

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.3Blend File: Classroom - Compute: CPU-OnlyXeon Platinum 8490HXeon Platinum 8490H 2P1530456075SE +/- 0.08, N = 3SE +/- 0.15, N = 367.6835.90

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.3Blend File: Fishy Cat - Compute: CPU-OnlyXeon Platinum 8490HXeon Platinum 8490H 2P816243240SE +/- 0.18, N = 3SE +/- 0.18, N = 336.0520.01

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.3Blend File: Pabellon Barcelona - Compute: CPU-OnlyXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.18, N = 3SE +/- 0.08, N = 388.9647.14

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.3Blend File: Barbershop - Compute: CPU-OnlyXeon Platinum 8490HXeon Platinum 8490H 2P60120180240300SE +/- 1.33, N = 3SE +/- 0.47, N = 3277.99150.54

C-Ray

Total Time - 4K, 16 Rays Per Pixel

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Time - 4K, 16 Rays Per PixelXeon Platinum 8490HXeon Platinum 8490H 2P3691215SE +/- 0.002, N = 5SE +/- 0.009, N = 710.6675.5351. (CC) gcc options: -lm -lpthread -O3

POV-Ray

Trace Time

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-Ray 3.7.0.7Trace TimeXeon Platinum 8490HXeon Platinum 8490H 2P3691215SE +/- 0.055, N = 4SE +/- 0.045, N = 59.8096.6551. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -R/usr/lib -lSDL -lXpm -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer - Model: Asian DragonXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.32, N = 5SE +/- 0.75, N = 669.46106.25MIN: 62.46 / MAX: 82.23MIN: 81.97 / MAX: 143.97

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer - Model: CrownXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.11, N = 4SE +/- 0.51, N = 557.2784.94MIN: 53.31 / MAX: 67.51MIN: 71.38 / MAX: 118.61

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.68, N = 6SE +/- 0.50, N = 683.21122.37MIN: 73.06 / MAX: 101.5MIN: 88.61 / MAX: 170.97

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.13, N = 5SE +/- 0.53, N = 663.8291.31MIN: 59.5 / MAX: 75.6MIN: 75.79 / MAX: 138.07

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160Xeon Platinum 8490HXeon Platinum 8490H 2P0.94951.8992.84853.7984.7475SE +/- 0.00, N = 4SE +/- 0.01, N = 62.634.22

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.ldr_alb_nrm.3840x2160Xeon Platinum 8490HXeon Platinum 8490H 2P0.95631.91262.86893.82524.7815SE +/- 0.00, N = 4SE +/- 0.02, N = 62.644.25

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096Xeon Platinum 8490HXeon Platinum 8490H 2P0.45230.90461.35691.80922.2615SE +/- 0.00, N = 3SE +/- 0.01, N = 41.252.01

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeXeon Platinum 8490HXeon Platinum 8490H 2P816243240SE +/- 0.02, N = 3SE +/- 0.08, N = 319.6136.45

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeXeon Platinum 8490HXeon Platinum 8490H 2P1020304050SE +/- 0.02, N = 3SE +/- 0.40, N = 624.1242.38

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerXeon Platinum 8490HXeon Platinum 8490H 2P30060090012001500SE +/- 1.00, N = 3SE +/- 1.45, N = 316038571. (CXX) g++ options: -O3 -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerXeon Platinum 8490HXeon Platinum 8490H 2P6K12K18K24K30KSE +/- 33.98, N = 3SE +/- 14.17, N = 325685136281. (CXX) g++ options: -O3 -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerXeon Platinum 8490HXeon Platinum 8490H 2P11K22K33K44K55KSE +/- 73.00, N = 3SE +/- 43.66, N = 351326273161. (CXX) g++ options: -O3 -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerXeon Platinum 8490HXeon Platinum 8490H 2P30060090012001500SE +/- 1.33, N = 3SE +/- 0.88, N = 316278781. (CXX) g++ options: -O3 -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerXeon Platinum 8490HXeon Platinum 8490H 2P6K12K18K24K30KSE +/- 36.19, N = 3SE +/- 18.15, N = 326095138441. (CXX) g++ options: -O3 -ldl

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerXeon Platinum 8490HXeon Platinum 8490H 2P11K22K33K44K55KSE +/- 84.62, N = 3SE +/- 10.53, N = 352081276511. (CXX) g++ options: -O3 -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerXeon Platinum 8490HXeon Platinum 8490H 2P400800120016002000SE +/- 2.33, N = 3SE +/- 1.45, N = 3193110311. (CXX) g++ options: -O3 -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerXeon Platinum 8490HXeon Platinum 8490H 2P7K14K21K28K35KSE +/- 47.70, N = 3SE +/- 18.59, N = 330888163731. (CXX) g++ options: -O3 -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerXeon Platinum 8490HXeon Platinum 8490H 2P14K28K42K56K70KSE +/- 105.74, N = 3SE +/- 30.66, N = 367518327591. (CXX) g++ options: -O3 -ldl

LuxCoreRender

Scene: DLSC - Acceleration: CPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: DLSC - Acceleration: CPUXeon Platinum 8490HXeon Platinum 8490H 2P3691215SE +/- 0.01, N = 3SE +/- 0.17, N = 158.4610.36MIN: 8.06 / MAX: 10.38MIN: 8.3 / MAX: 16.8

LuxCoreRender

Scene: Orange Juice - Acceleration: CPU

OpenBenchmarking.orgM samples/sec, More Is BetterLuxCoreRender 2.6Scene: Orange Juice - Acceleration: CPUXeon Platinum 8490HXeon Platinum 8490H 2P48121620SE +/- 0.11, N = 15SE +/- 0.18, N = 312.8916.68MIN: 10.41 / MAX: 16.31MIN: 12.85 / MAX: 25.49

GraphicsMagick

Operation: Enhanced

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: EnhancedXeon Platinum 8490HXeon Platinum 8490H 2P400800120016002000SE +/- 0.58, N = 3SE +/- 4.26, N = 3113217591. (CC) gcc options: -fopenmp -O2 -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SharpenXeon Platinum 8490HXeon Platinum 8490H 2P2004006008001000SE +/- 0.00, N = 3SE +/- 0.88, N = 369211611. (CC) gcc options: -fopenmp -O2 -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: MediumXeon Platinum 8490HXeon Platinum 8490H 2P110220330440550SE +/- 0.08, N = 7SE +/- 0.43, N = 7287.82492.941. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.02, N = 5SE +/- 0.02, N = 642.0378.981. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ExhaustiveXeon Platinum 8490HXeon Platinum 8490H 2P246810SE +/- 0.0010, N = 4SE +/- 0.0085, N = 54.07228.06291. (CXX) g++ options: -O3 -flto -pthread

Etcpak

Benchmark: Multi-Threaded - Configuration: ETC2

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 1.0Benchmark: Multi-Threaded - Configuration: ETC2Xeon Platinum 8490HXeon Platinum 8490H 2P15003000450060007500SE +/- 23.61, N = 9SE +/- 53.37, N = 86573.676955.481. (CXX) g++ options: -O3 -march=native -std=c++11 -lpthread

ebizzy

OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3Xeon Platinum 8490HXeon Platinum 8490H 2P1.1M2.2M3.3M4.4M5.5MSE +/- 64571.95, N = 15SE +/- 159851.14, N = 13295102450667511. (CC) gcc options: -pthread -lpthread -O3 -march=native

Node.js Express HTTP Load Test

OpenBenchmarking.orgRequests Per Second, More Is BetterNode.js Express HTTP Load TestXeon Platinum 8490HXeon Platinum 8490H 2P3K6K9K12K15KSE +/- 27.68, N = 5SE +/- 79.75, N = 151190210861

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsXeon Platinum 8490HXeon Platinum 8490H 2P1.2782.5563.8345.1126.39SE +/- 0.02, N = 3SE +/- 0.03, N = 35.605.681. (CXX) g++ options: -O3

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: LargeRandomXeon Platinum 8490HXeon Platinum 8490H 2P0.29250.5850.87751.171.4625SE +/- 0.00, N = 3SE +/- 0.00, N = 31.301.281. (CXX) g++ options: -O3

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: KostyaXeon Platinum 8490HXeon Platinum 8490H 2P0.78531.57062.35593.14123.9265SE +/- 0.01, N = 3SE +/- 0.01, N = 33.493.491. (CXX) g++ options: -O3

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDXeon Platinum 8490HXeon Platinum 8490H 2P246810SE +/- 0.00, N = 3SE +/- 0.02, N = 36.536.531. (CXX) g++ options: -O3

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: TopTweetXeon Platinum 8490HXeon Platinum 8490H 2P246810SE +/- 0.01, N = 3SE +/- 0.01, N = 36.776.801. (CXX) g++ options: -O3

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.32.6VGR Performance MetricXeon Platinum 8490HXeon Platinum 8490H 2P900K1800K2700K3600K4500K82904643741451. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -ldl -lm

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesXeon Platinum 8490HXeon Platinum 8490H 2P170340510680850SE +/- 2.96, N = 3SE +/- 2.60, N = 3771770

PyPerformance

Benchmark: crypto_pyaes

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: crypto_pyaesXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.03, N = 3SE +/- 0.03, N = 379.078.8

PyPerformance

Benchmark: django_template

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: django_templateXeon Platinum 8490HXeon Platinum 8490H 2P816243240SE +/- 0.09, N = 3SE +/- 0.00, N = 334.934.7

PyPerformance

Benchmark: json_loads

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: json_loadsXeon Platinum 8490HXeon Platinum 8490H 2P510152025SE +/- 0.00, N = 3SE +/- 0.00, N = 318.718.7

PyPerformance

Benchmark: regex_compile

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: regex_compileXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.00, N = 3SE +/- 0.00, N = 3132132

Numpy Benchmark

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkXeon Platinum 8490HXeon Platinum 8490H 2P100200300400500SE +/- 1.69, N = 3SE +/- 0.90, N = 3458.09455.27

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteXeon Platinum 8490HXeon Platinum 8490H 2P200K400K600K800K1000KSE +/- 2905.52, N = 3SE +/- 948.00, N = 3947570951782

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.32, N = 4SE +/- 0.20, N = 4144.1144.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.41, N = 3SE +/- 0.29, N = 3152.1152.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.19, N = 3SE +/- 0.33, N = 3132.4133.71. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.34, N = 3SE +/- 0.38, N = 3144.9145.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.77, N = 3SE +/- 0.17, N = 3132.3132.81. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

srsRAN

Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.15, N = 3SE +/- 0.03, N = 388.388.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

srsRAN

Test: OFDM_Test

OpenBenchmarking.orgSamples / Second, More Is BettersrsRAN 22.04.1Test: OFDM_TestXeon Platinum 8490HXeon Platinum 8490H 2P30M60M90M120M150MSE +/- 1504437.88, N = 3SE +/- 405517.50, N = 31607000001603666671. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

Liquid-DSP

Threads: 32 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 2021.01.31Threads: 32 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8490HXeon Platinum 8490H 2P500M1000M1500M2000M2500MSE +/- 2794240.11, N = 3SE +/- 3540872.46, N = 3225433333322340666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 64 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 2021.01.31Threads: 64 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8490HXeon Platinum 8490H 2P900M1800M2700M3600M4500MSE +/- 3175426.48, N = 3SE +/- 1040833.00, N = 3339870000042799000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 128 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 2021.01.31Threads: 128 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8490HXeon Platinum 8490H 2P1300M2600M3900M5200M6500MSE +/- 2667291.59, N = 3SE +/- 13313151.39, N = 3346803333362762000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Liquid-DSP

Threads: 256 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 2021.01.31Threads: 256 - Buffer Length: 256 - Filter Length: 57Xeon Platinum 8490HXeon Platinum 8490H 2P1400M2800M4200M5600M7000MSE +/- 7522484.81, N = 3SE +/- 1192103.65, N = 3358306666766291666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

PJSIP

Method: OPTIONS, Stateless

OpenBenchmarking.orgResponses Per Second, More Is BetterPJSIP 2.11Method: OPTIONS, StatelessXeon Platinum 8490HXeon Platinum 8490H 2P7K14K21K28K35KSE +/- 559.10, N = 15SE +/- 299.91, N = 734041342821. (CC) gcc options: -lavformat -lavcodec -lswscale -lavutil -lstdc++ -lopus -lssl -lcrypto -luuid -lm -lrt -lpthread -lasound -O2

QuantLib

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.21Xeon Platinum 8490HXeon Platinum 8490H 2P7001400210028003500SE +/- 25.54, N = 3SE +/- 30.19, N = 33167.93167.81. (CXX) g++ options: -O3 -march=native -rdynamic

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.0Algorithm: RSA4096Xeon Platinum 8490HXeon Platinum 8490H 2P6K12K18K24K30KSE +/- 22.62, N = 3SE +/- 28.11, N = 314735.928605.01. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.0Algorithm: RSA4096Xeon Platinum 8490HXeon Platinum 8490H 2P400K800K1200K1600K2000KSE +/- 461.15, N = 3SE +/- 383.16, N = 3979532.11891795.01. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.0Algorithm: SHA256Xeon Platinum 8490HXeon Platinum 8490H 2P30000M60000M90000M120000M150000MSE +/- 20153231.00, N = 3SE +/- 1169331279.81, N = 3629647713771223140036201. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.12.1Variant: Monero - Hash Count: 1MXeon Platinum 8490HXeon Platinum 8490H 2P10K20K30K40K50KSE +/- 7.76, N = 3SE +/- 177.42, N = 327397.846050.41. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.12.1Variant: Wownero - Hash Count: 1MXeon Platinum 8490HXeon Platinum 8490H 2P13K26K39K52K65KSE +/- 13.52, N = 3SE +/- 7.56, N = 335200.561104.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Sysbench

Test: CPU

OpenBenchmarking.orgEvents Per Second, More Is BetterSysbench 1.0.20Test: CPUXeon Platinum 8490HXeon Platinum 8490H 2P70K140K210K280K350KSE +/- 0.27, N = 3SE +/- 9.45, N = 3155262.70310297.601. (CC) gcc options: -O2 -funroll-loops -rdynamic -ldl -laio -lm

m-queens

Time To Solve

OpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2Time To SolveXeon Platinum 8490HXeon Platinum 8490H 2P48121620SE +/- 0.036, N = 4SE +/- 0.012, N = 614.7857.6481. (CXX) g++ options: -fopenmp -O2 -march=native

Coremark

CoreMark Size 666 - Iterations Per Second

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondXeon Platinum 8490HXeon Platinum 8490H 2P900K1800K2700K3600K4500KSE +/- 8023.55, N = 3SE +/- 6853.25, N = 32162643.684299941.231. (CC) gcc options: -O2 -lrt" -lrt

asmFish

1024 Hash Memory, 26 Depth

OpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-231024 Hash Memory, 26 DepthXeon Platinum 8490HXeon Platinum 8490H 2P50M100M150M200M250MSE +/- 712788.73, N = 3SE +/- 1570117.84, N = 3130447170230901090

Tachyon

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterTachyon 0.99.2Total TimeXeon Platinum 8490HXeon Platinum 8490H 2P612182430SE +/- 0.15, N = 3SE +/- 0.03, N = 425.8313.321. (CC) gcc options: -m64 -O3 -fomit-frame-pointer -ffast-math -ltachyon -lm -lpthread

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeXeon Platinum 8490HXeon Platinum 8490H 2P81624324031.7632.871. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeXeon Platinum 8490HXeon Platinum 8490H 2P102030405042.6929.221. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeXeon Platinum 8490HXeon Platinum 8490H 2P306090120150149.14155.861. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeXeon Platinum 8490HXeon Platinum 8490H 2P90180270360450418.90192.691. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUXeon Platinum 8490HXeon Platinum 8490H 2P0.14530.29060.43590.58120.7265SE +/- 0.000493, N = 7SE +/- 0.002510, N = 70.6457790.431788MIN: 0.55MIN: 0.381. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUXeon Platinum 8490HXeon Platinum 8490H 2P0.11690.23380.35070.46760.5845SE +/- 0.001949, N = 7SE +/- 0.002009, N = 100.5194510.262114MIN: 0.46MIN: 0.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUXeon Platinum 8490HXeon Platinum 8490H 2P0.06340.12680.19020.25360.317SE +/- 0.002592, N = 15SE +/- 0.001768, N = 70.2818120.264160MIN: 0.25MIN: 0.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P1224364860SE +/- 0.08, N = 3SE +/- 0.09, N = 353.8352.60

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P510152025SE +/- 0.03, N = 3SE +/- 0.03, N = 318.5719.00

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P90180270360450SE +/- 0.26, N = 3SE +/- 0.50, N = 3218.39426.84

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.15, N = 3SE +/- 0.17, N = 3137.32140.38

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.09, N = 3SE +/- 0.00, N = 3103.82103.24

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P3691215SE +/- 0.0079, N = 3SE +/- 0.0003, N = 39.62559.6785

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P2004006008001000SE +/- 1.01, N = 3SE +/- 2.47, N = 3447.96877.37

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P1530456075SE +/- 0.15, N = 3SE +/- 0.17, N = 366.9568.32

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P60120180240300SE +/- 0.50, N = 3SE +/- 0.80, N = 3279.46281.82

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P0.8041.6082.4123.2164.02SE +/- 0.0063, N = 3SE +/- 0.0099, N = 33.57343.5434

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P30060090012001500SE +/- 0.49, N = 3SE +/- 2.06, N = 3769.781499.50

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P918273645SE +/- 0.03, N = 3SE +/- 0.06, N = 338.9439.97

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P714212835SE +/- 0.00, N = 3SE +/- 0.18, N = 327.7126.28

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P918273645SE +/- 0.00, N = 3SE +/- 0.26, N = 336.0838.04

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.06, N = 3SE +/- 0.09, N = 347.4592.16

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.35, N = 3SE +/- 0.08, N = 384.5482.95

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P3691215SE +/- 0.05, N = 3SE +/- 0.01, N = 311.8212.05

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P80160240320400SE +/- 0.12, N = 3SE +/- 2.04, N = 3192.99364.80

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P4080120160200SE +/- 0.10, N = 3SE +/- 0.87, N = 3155.40164.18

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.45, N = 3SE +/- 1.07, N = 3121.2595.04

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P3691215SE +/- 0.0308, N = 3SE +/- 0.1185, N = 38.241510.5177

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P130260390520650SE +/- 0.14, N = 3SE +/- 0.43, N = 3318.93594.02

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.04, N = 3SE +/- 0.07, N = 394.00100.77

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P714212835SE +/- 0.02, N = 3SE +/- 0.08, N = 327.6726.55

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamXeon Platinum 8490HXeon Platinum 8490H 2P918273645SE +/- 0.02, N = 3SE +/- 0.12, N = 336.1437.65

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.15, N = 3SE +/- 0.24, N = 347.2992.17

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.72, N = 3SE +/- 0.53, N = 3130.17141.67

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestXeon Platinum 8490HXeon Platinum 8490H 2P816243240SE +/- 0.04, N = 3SE +/- 0.03, N = 332.3826.82

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamXeon Platinum 8490HXeon Platinum 8490H 2P20406080100SE +/- 0.11, N = 3SE +/- 0.22, N = 381.3481.73

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerXeon Platinum 8490HXeon Platinum 8490H 2P306090120150SE +/- 0.11, N = 3SE +/- 0.09, N = 3152.91112.02

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P90180270360450SE +/- 1.06, N = 3SE +/- 0.52, N = 3396.76318.00MIN: 130.62 / MAX: 484.95MIN: 225.29 / MAX: 493.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P0.80551.6112.41653.2224.0275SE +/- 0.00, N = 3SE +/- 0.00, N = 33.582.61MIN: 1.58 / MAX: 28.82MIN: 2.11 / MAX: 28.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUXeon Platinum 8490HXeon Platinum 8490H 2P510152025SE +/- 0.02, N = 3SE +/- 0.02, N = 318.3519.85MIN: 8.59 / MAX: 57.04MIN: 13.53 / MAX: 111.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19 - Decompression SpeedXeon Platinum 8490HXeon Platinum 8490H 2P6001200180024003000SE +/- 0.43, N = 3SE +/- 8.11, N = 32857.42713.41. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19, Long Mode - Compression SpeedXeon Platinum 8490HXeon Platinum 8490H 2P1224364860SE +/- 0.03, N = 3SE +/- 0.59, N = 1551.950.61. (CC) gcc options: -O3 -pthread -lz -llzma

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMXeon Platinum 8490HXeon Platinum 8490H 2P80160240320400SE +/- 0.85, N = 4SE +/- 1.13, N = 4373.0371.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMXeon Platinum 8490HXeon Platinum 8490H 2P90180270360450SE +/- 1.19, N = 3SE +/- 1.44, N = 3405.0407.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMXeon Platinum 8490HXeon Platinum 8490H 2P80160240320400SE +/- 0.84, N = 3SE +/- 1.98, N = 3365.2364.71. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMXeon Platinum 8490HXeon Platinum 8490H 2P90180270360450SE +/- 0.61, N = 3SE +/- 0.99, N = 3403.8402.71. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -ldl -lpthread -lm

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P140280420560700SE +/- 1.35, N = 3SE +/- 0.61, N = 3629.59647.82

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamXeon Platinum 8490HXeon Platinum 8490H 2P140280420560700SE +/- 0.12, N = 3SE +/- 1.63, N = 3630.23646.40


Phoronix Test Suite v10.8.4