epyc last

AMD EPYC 7343 16-Core testing with a Supermicro H12SSL-i v1.02 (2.4 BIOS) and astdrmfb on AlmaLinux 9.1 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2304307-NE-EPYCLAST283&grs&sor.

epyc lastProcessorMotherboardMemoryDiskGraphicsMonitorOSKernelCompilerFile-SystemScreen ResolutionabcdAMD EPYC 7343 16-Core @ 3.20GHz (16 Cores / 32 Threads)Supermicro H12SSL-i v1.02 (2.4 BIOS)8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07astdrmfbDELL E207WFPAlmaLinux 9.15.14.0-162.12.1.el9_1.x86_64 (x86_64)GCC 11.3.1 20220421ext41680x1050OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Disk Details- NONE / relatime,rw,stripe=32 / raid1 nvme1n1p3[0] nvme0n1p3[1] Block Size: 4096Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001173 Python Details- Python 3.9.14Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

epyc lastsqlite: 8sqlite: 4sqlite: 2sqlite: 32intel-tensorflow: inceptionv4_fp32_pretrained_model - 1intel-tensorflow: mobilenetv1_int8_pretrained_model - 256intel-tensorflow: mobilenetv1_int8_pretrained_model - 32svt-av1: Preset 4 - Bosphorus 1080pintel-tensorflow: mobilenetv1_int8_pretrained_model - 64intel-tensorflow: resnet50_int8_pretrained_model - 1intel-tensorflow: resnet50_int8_pretrained_model - 1svt-av1: Preset 12 - Bosphorus 1080pintel-tensorflow: inceptionv4_int8_pretrained_model - 64intel-tensorflow: inceptionv4_int8_pretrained_model - 16svt-av1: Preset 12 - Bosphorus 4Kintel-tensorflow: resnet50_fp32_pretrained_model - 16intel-tensorflow: resnet50_int8_pretrained_model - 32intel-tensorflow: inceptionv4_fp32_pretrained_model - 64intel-tensorflow: inceptionv4_int8_pretrained_model - 96intel-tensorflow: resnet50_fp32_pretrained_model - 32intel-tensorflow: resnet50_fp32_pretrained_model - 1intel-tensorflow: resnet50_fp32_pretrained_model - 1svt-av1: Preset 8 - Bosphorus 4Kintel-tensorflow: inceptionv4_fp32_pretrained_model - 1intel-tensorflow: resnet50_int8_pretrained_model - 16svt-av1: Preset 13 - Bosphorus 1080pinfluxdb: 4 - 10000 - 2,5000,1 - 10000intel-tensorflow: mobilenetv1_int8_pretrained_model - 16intel-tensorflow: inceptionv4_fp32_pretrained_model - 16intel-tensorflow: inceptionv4_int8_pretrained_model - 32intel-tensorflow: resnet50_fp32_pretrained_model - 960intel-tensorflow: inceptionv4_int8_pretrained_model - 512intel-tensorflow: mobilenetv1_int8_pretrained_model - 512intel-tensorflow: mobilenetv1_int8_pretrained_model - 96svt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 1080pintel-tensorflow: inceptionv4_fp32_pretrained_model - 32svt-av1: Preset 4 - Bosphorus 4Kintel-tensorflow: resnet50_int8_pretrained_model - 256intel-tensorflow: inceptionv4_fp32_pretrained_model - 96influxdb: 64 - 10000 - 2,5000,1 - 10000intel-tensorflow: resnet50_int8_pretrained_model - 512intel-tensorflow: mobilenetv1_fp32_pretrained_model - 16intel-tensorflow: mobilenetv1_int8_pretrained_model - 960quantlib: intel-tensorflow: inceptionv4_int8_pretrained_model - 1intel-tensorflow: resnet50_fp32_pretrained_model - 96intel-tensorflow: inceptionv4_fp32_pretrained_model - 960intel-tensorflow: mobilenetv1_fp32_pretrained_model - 96intel-tensorflow: resnet50_int8_pretrained_model - 64intel-tensorflow: mobilenetv1_fp32_pretrained_model - 32intel-tensorflow: inceptionv4_int8_pretrained_model - 960intel-tensorflow: inceptionv4_fp32_pretrained_model - 256intel-tensorflow: resnet50_int8_pretrained_model - 960intel-tensorflow: resnet50_fp32_pretrained_model - 512intel-tensorflow: mobilenetv1_fp32_pretrained_model - 1intel-tensorflow: inceptionv4_int8_pretrained_model - 256intel-tensorflow: mobilenetv1_fp32_pretrained_model - 64intel-tensorflow: inceptionv4_int8_pretrained_model - 1intel-tensorflow: resnet50_int8_pretrained_model - 96intel-tensorflow: inceptionv4_fp32_pretrained_model - 512intel-tensorflow: resnet50_fp32_pretrained_model - 64intel-tensorflow: mobilenetv1_fp32_pretrained_model - 512intel-tensorflow: mobilenetv1_fp32_pretrained_model - 960intel-tensorflow: mobilenetv1_fp32_pretrained_model - 256intel-tensorflow: resnet50_fp32_pretrained_model - 256intel-tensorflow: mobilenetv1_int8_pretrained_model - 1sqlite: 16sqlite: 1abcd5.0653.1782.15011.32132.232090.972056.189.0272112.33221.8554.508547.498118.48113.31174.519168.744356.31752.44118.25174.04079.28312.61352.58230.817346.017548.0071547894.42003.4953.20117.00168.721119.902170.092083.55160.50195.92553.103.766382.09351.831602099.9383.615932.192133.183202.114.436169.72651.76990.35365.095981.32120.7451.92391.680168.3711045.59119.18998.4369.04373.12651.76170.509976.58983.761001.61167.9681933.378.4763.8562.9382.04111.81133.162106.542110.199.0642120.77221.7694.509542.028118.93111.63175.683171.632361.36252.40119.097759734174.30379.77612.53551.98230.475347.926542.6251545780.82002.0953.47117.81169.729119.612179.092081.87160.66495.70752.913.782380.65251.721593776.4385.546929.582128.13206.114.415169.64951.78986.72364.043984.41120.9452.07392.07168.6411048.2119.18997.7369.16373.72351.87170.516974.84982.711000.28167.9981932.476.2093.9662.9042.10611.74332.062028.822037.869.1212063.78216.3694.622535.678117.61113.63172.696171.049357.71451.72119.82174.25579.98812.50252.52330.647348.365545.8641552035.6198952.99116.93170.093119.912161.982087.39160.13996.32953.113.791381.06451.901599391.9385.5933.762137.23200.714.426169.97151.59988.15365.003982.66120.7452.06392.383168.7881046.79119.33999.9369.01372.93351.77170.603976.22982.461001.43168.0551933.587.1983.7612.7122.03911.59831.862091.62033.579.282091.66217.5934.596539.588119.83113.36174.836169.333357.03551.97118.23172.26980.21812.46652.57230.723344.868547.43215607581984.3853.22117.89169.338120.562171.792071.18159.52195.64853.273.784380.01552.001600346.9384.26931.222132.293192.714.377169.3151.62988.72365.305981.61120.5752.04391.383168.3651046.4119.45999.9269.07372.92851.76170.261974.69984.361001.3168.161934.326.075OpenBenchmarking.org

SQLite

Threads / Copies: 8

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 8dbca1.13962.27923.41884.55845.698SE +/- 0.038, N = 33.7613.8563.9665.0651. (CC) gcc options: -O2 -lz -lm

SQLite

Threads / Copies: 4

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 4dcba0.71511.43022.14532.86043.5755SE +/- 0.030, N = 152.7122.9042.9383.1781. (CC) gcc options: -O2 -lz -lm

SQLite

Threads / Copies: 2

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 2dbca0.48380.96761.45141.93522.419SE +/- 0.004, N = 32.0392.0412.1062.1501. (CC) gcc options: -O2 -lz -lm

SQLite

Threads / Copies: 32

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 32adcb3691215SE +/- 0.05, N = 311.3211.6011.7411.811. (CC) gcc options: -O2 -lz -lm

Intel TensorFlow

Model: inceptionv4_fp32_pretrained_model - Batch Size: 1

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_fp32_pretrained_model - Batch Size: 1bacd816243240SE +/- 0.26, N = 333.1632.2332.0631.86

Intel TensorFlow

Model: mobilenetv1_int8_pretrained_model - Batch Size: 256

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_int8_pretrained_model - Batch Size: 256bdac5001000150020002500SE +/- 14.60, N = 32106.542091.602090.972028.82

Intel TensorFlow

Model: mobilenetv1_int8_pretrained_model - Batch Size: 32

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_int8_pretrained_model - Batch Size: 32bacd5001000150020002500SE +/- 19.33, N = 72110.192056.182037.862033.57

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.5Encoder Mode: Preset 4 - Input: Bosphorus 1080pdcba3691215SE +/- 0.031, N = 39.2809.1219.0649.0271. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel TensorFlow

Model: mobilenetv1_int8_pretrained_model - Batch Size: 64

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_int8_pretrained_model - Batch Size: 64badc5001000150020002500SE +/- 10.67, N = 32120.772112.332091.662063.78

Intel TensorFlow

Model: resnet50_int8_pretrained_model - Batch Size: 1

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_int8_pretrained_model - Batch Size: 1abdc50100150200250SE +/- 1.58, N = 3221.86221.77217.59216.37

Intel TensorFlow

Model: resnet50_int8_pretrained_model - Batch Size: 1

OpenBenchmarking.orgms, Fewer Is BetterIntel TensorFlow 2.12Model: resnet50_int8_pretrained_model - Batch Size: 1abdc1.042.083.124.165.2SE +/- 0.032, N = 34.5084.5094.5964.622

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.5Encoder Mode: Preset 12 - Input: Bosphorus 1080pabdc120240360480600SE +/- 0.64, N = 3547.50542.03539.59535.681. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel TensorFlow

Model: inceptionv4_int8_pretrained_model - Batch Size: 64

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_int8_pretrained_model - Batch Size: 64dbac306090120150SE +/- 0.54, N = 3119.83118.93118.48117.61

Intel TensorFlow

Model: inceptionv4_int8_pretrained_model - Batch Size: 16

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_int8_pretrained_model - Batch Size: 16cdab306090120150SE +/- 0.30, N = 3113.63113.36113.31111.63

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.5Encoder Mode: Preset 12 - Input: Bosphorus 4Kbdac4080120160200SE +/- 0.56, N = 3175.68174.84174.52172.701. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel TensorFlow

Model: resnet50_fp32_pretrained_model - Batch Size: 16

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_fp32_pretrained_model - Batch Size: 16bcda4080120160200SE +/- 0.83, N = 3171.63171.05169.33168.74

Intel TensorFlow

Model: resnet50_int8_pretrained_model - Batch Size: 32

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_int8_pretrained_model - Batch Size: 32bcda80160240320400SE +/- 0.47, N = 3361.36357.71357.04356.32

Intel TensorFlow

Model: inceptionv4_fp32_pretrained_model - Batch Size: 64

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_fp32_pretrained_model - Batch Size: 64abdc1224364860SE +/- 0.12, N = 352.4452.4051.9751.72

Intel TensorFlow

Model: inceptionv4_int8_pretrained_model - Batch Size: 96

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_int8_pretrained_model - Batch Size: 96cbad306090120150SE +/- 0.42, N = 3119.82119.10118.25118.23

Intel TensorFlow

Model: resnet50_fp32_pretrained_model - Batch Size: 32

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_fp32_pretrained_model - Batch Size: 32bcad4080120160200SE +/- 0.31, N = 3174.30174.26174.04172.27

Intel TensorFlow

Model: resnet50_fp32_pretrained_model - Batch Size: 1

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_fp32_pretrained_model - Batch Size: 1dcba20406080100SE +/- 0.09, N = 380.2279.9979.7879.28

Intel TensorFlow

Model: resnet50_fp32_pretrained_model - Batch Size: 1

OpenBenchmarking.orgms, Fewer Is BetterIntel TensorFlow 2.12Model: resnet50_fp32_pretrained_model - Batch Size: 1dcba3691215SE +/- 0.01, N = 312.4712.5012.5412.61

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.5Encoder Mode: Preset 8 - Input: Bosphorus 4Kadcb1224364860SE +/- 0.19, N = 352.5852.5752.5251.981. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel TensorFlow

Model: inceptionv4_fp32_pretrained_model - Batch Size: 1

OpenBenchmarking.orgms, Fewer Is BetterIntel TensorFlow 2.12Model: inceptionv4_fp32_pretrained_model - Batch Size: 1bcda714212835SE +/- 0.10, N = 330.4830.6530.7230.82

Intel TensorFlow

Model: resnet50_int8_pretrained_model - Batch Size: 16

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_int8_pretrained_model - Batch Size: 16cbad80160240320400SE +/- 1.45, N = 3348.37347.93346.02344.87

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.5Encoder Mode: Preset 13 - Input: Bosphorus 1080padcb120240360480600SE +/- 0.34, N = 3548.01547.43545.86542.631. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

InfluxDB

Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000dcab300K600K900K1200K1500KSE +/- 5338.36, N = 31560758.01552035.61547894.41545780.8

Intel TensorFlow

Model: mobilenetv1_int8_pretrained_model - Batch Size: 16

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_int8_pretrained_model - Batch Size: 16abcd400800120016002000SE +/- 14.27, N = 32003.492002.091989.001984.38

Intel TensorFlow

Model: inceptionv4_fp32_pretrained_model - Batch Size: 16

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_fp32_pretrained_model - Batch Size: 16bdac1224364860SE +/- 0.07, N = 353.4753.2253.2052.99

Intel TensorFlow

Model: inceptionv4_int8_pretrained_model - Batch Size: 32

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_int8_pretrained_model - Batch Size: 32dbac306090120150SE +/- 0.81, N = 3117.89117.81117.00116.93

Intel TensorFlow

Model: resnet50_fp32_pretrained_model - Batch Size: 960

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_fp32_pretrained_model - Batch Size: 960cbda4080120160200SE +/- 0.30, N = 3170.09169.73169.34168.72

Intel TensorFlow

Model: inceptionv4_int8_pretrained_model - Batch Size: 512

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_int8_pretrained_model - Batch Size: 512dcab306090120150SE +/- 0.14, N = 3120.56119.91119.90119.61

Intel TensorFlow

Model: mobilenetv1_int8_pretrained_model - Batch Size: 512

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_int8_pretrained_model - Batch Size: 512bdac5001000150020002500SE +/- 2.76, N = 32179.092171.792170.092161.98

Intel TensorFlow

Model: mobilenetv1_int8_pretrained_model - Batch Size: 96

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_int8_pretrained_model - Batch Size: 96cabd400800120016002000SE +/- 2.02, N = 32087.392083.552081.872071.18

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.5Encoder Mode: Preset 13 - Input: Bosphorus 4Kbacd4080120160200SE +/- 0.85, N = 3160.66160.50160.14159.521. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.5Encoder Mode: Preset 8 - Input: Bosphorus 1080pcabd20406080100SE +/- 0.42, N = 396.3395.9395.7195.651. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel TensorFlow

Model: inceptionv4_fp32_pretrained_model - Batch Size: 32

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_fp32_pretrained_model - Batch Size: 32dcab1224364860SE +/- 0.09, N = 353.2753.1153.1052.91

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.5Encoder Mode: Preset 4 - Input: Bosphorus 4Kcdba0.8531.7062.5593.4124.265SE +/- 0.019, N = 33.7913.7843.7823.7661. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel TensorFlow

Model: resnet50_int8_pretrained_model - Batch Size: 256

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_int8_pretrained_model - Batch Size: 256acbd80160240320400SE +/- 0.54, N = 3382.09381.06380.65380.02

Intel TensorFlow

Model: inceptionv4_fp32_pretrained_model - Batch Size: 96

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_fp32_pretrained_model - Batch Size: 96dcab1224364860SE +/- 0.07, N = 352.0051.9051.8351.72

InfluxDB

Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000adcb300K600K900K1200K1500KSE +/- 3918.66, N = 31602099.91600346.91599391.91593776.4

Intel TensorFlow

Model: resnet50_int8_pretrained_model - Batch Size: 512

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_int8_pretrained_model - Batch Size: 512bcda80160240320400SE +/- 0.21, N = 3385.55385.50384.26383.62

Intel TensorFlow

Model: mobilenetv1_fp32_pretrained_model - Batch Size: 16

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_fp32_pretrained_model - Batch Size: 16cadb2004006008001000SE +/- 0.39, N = 3933.76932.19931.22929.58

Intel TensorFlow

Model: mobilenetv1_int8_pretrained_model - Batch Size: 960

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_int8_pretrained_model - Batch Size: 960cadb5001000150020002500SE +/- 2.58, N = 32137.202133.182132.292128.10

QuantLib

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.30bacd7001400210028003500SE +/- 1.35, N = 33206.13202.13200.73192.71. (CXX) g++ options: -O3 -march=native -fPIE -pie

Intel TensorFlow

Model: inceptionv4_int8_pretrained_model - Batch Size: 1

OpenBenchmarking.orgms, Fewer Is BetterIntel TensorFlow 2.12Model: inceptionv4_int8_pretrained_model - Batch Size: 1dbca48121620SE +/- 0.03, N = 314.3814.4214.4314.44

Intel TensorFlow

Model: resnet50_fp32_pretrained_model - Batch Size: 96

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_fp32_pretrained_model - Batch Size: 96cabd4080120160200SE +/- 0.11, N = 3169.97169.73169.65169.31

Intel TensorFlow

Model: inceptionv4_fp32_pretrained_model - Batch Size: 960

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_fp32_pretrained_model - Batch Size: 960badc1224364860SE +/- 0.11, N = 351.7851.7651.6251.59

Intel TensorFlow

Model: mobilenetv1_fp32_pretrained_model - Batch Size: 96

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_fp32_pretrained_model - Batch Size: 96adcb2004006008001000SE +/- 1.26, N = 3990.35988.72988.15986.72

Intel TensorFlow

Model: resnet50_int8_pretrained_model - Batch Size: 64

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_int8_pretrained_model - Batch Size: 64dacb80160240320400SE +/- 0.43, N = 3365.31365.10365.00364.04

Intel TensorFlow

Model: mobilenetv1_fp32_pretrained_model - Batch Size: 32

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_fp32_pretrained_model - Batch Size: 32bcda2004006008001000SE +/- 1.14, N = 3984.41982.66981.61981.32

Intel TensorFlow

Model: inceptionv4_int8_pretrained_model - Batch Size: 960

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_int8_pretrained_model - Batch Size: 960bcad306090120150SE +/- 0.16, N = 3120.94120.74120.74120.57

Intel TensorFlow

Model: inceptionv4_fp32_pretrained_model - Batch Size: 256

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_fp32_pretrained_model - Batch Size: 256bcda1224364860SE +/- 0.02, N = 352.0752.0652.0451.92

Intel TensorFlow

Model: resnet50_int8_pretrained_model - Batch Size: 960

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_int8_pretrained_model - Batch Size: 960cbad90180270360450SE +/- 0.57, N = 3392.38392.07391.68391.38

Intel TensorFlow

Model: resnet50_fp32_pretrained_model - Batch Size: 512

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_fp32_pretrained_model - Batch Size: 512cbad4080120160200SE +/- 0.21, N = 3168.79168.64168.37168.37

Intel TensorFlow

Model: mobilenetv1_fp32_pretrained_model - Batch Size: 1

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_fp32_pretrained_model - Batch Size: 1bcda2004006008001000SE +/- 0.98, N = 31048.201046.791046.401045.59

Intel TensorFlow

Model: inceptionv4_int8_pretrained_model - Batch Size: 256

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_int8_pretrained_model - Batch Size: 256dcba306090120150SE +/- 0.27, N = 3119.45119.33119.18119.18

Intel TensorFlow

Model: mobilenetv1_fp32_pretrained_model - Batch Size: 64

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_fp32_pretrained_model - Batch Size: 64cdab2004006008001000SE +/- 0.55, N = 3999.93999.92998.43997.73

Intel TensorFlow

Model: inceptionv4_int8_pretrained_model - Batch Size: 1

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_int8_pretrained_model - Batch Size: 1bdac1530456075SE +/- 0.07, N = 369.1669.0769.0469.01

Intel TensorFlow

Model: resnet50_int8_pretrained_model - Batch Size: 96

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_int8_pretrained_model - Batch Size: 96bacd80160240320400SE +/- 0.27, N = 3373.72373.13372.93372.93

Intel TensorFlow

Model: inceptionv4_fp32_pretrained_model - Batch Size: 512

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: inceptionv4_fp32_pretrained_model - Batch Size: 512bcda1224364860SE +/- 0.05, N = 351.8751.7751.7651.76

Intel TensorFlow

Model: resnet50_fp32_pretrained_model - Batch Size: 64

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_fp32_pretrained_model - Batch Size: 64cbad4080120160200SE +/- 0.12, N = 3170.60170.52170.51170.26

Intel TensorFlow

Model: mobilenetv1_fp32_pretrained_model - Batch Size: 512

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_fp32_pretrained_model - Batch Size: 512acbd2004006008001000SE +/- 0.75, N = 3976.58976.22974.84974.69

Intel TensorFlow

Model: mobilenetv1_fp32_pretrained_model - Batch Size: 960

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_fp32_pretrained_model - Batch Size: 960dabc2004006008001000SE +/- 0.13, N = 3984.36983.76982.71982.46

Intel TensorFlow

Model: mobilenetv1_fp32_pretrained_model - Batch Size: 256

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_fp32_pretrained_model - Batch Size: 256acdb2004006008001000SE +/- 0.11, N = 31001.611001.431001.301000.28

Intel TensorFlow

Model: resnet50_fp32_pretrained_model - Batch Size: 256

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: resnet50_fp32_pretrained_model - Batch Size: 256dcba4080120160200SE +/- 0.12, N = 3168.16168.06168.00167.97

Intel TensorFlow

Model: mobilenetv1_int8_pretrained_model - Batch Size: 1

OpenBenchmarking.orgimages/sec, More Is BetterIntel TensorFlow 2.12Model: mobilenetv1_int8_pretrained_model - Batch Size: 1dcab400800120016002000SE +/- 0.61, N = 31934.321933.581933.371932.47

SQLite

Threads / Copies: 16

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.41.2Threads / Copies: 16dbca246810SE +/- 0.163, N = 136.0756.2097.1988.4761. (CC) gcc options: -O2 -lz -lm

Phoronix Test Suite v10.8.4