bergamo extra

AMD EPYC 9754 128-Core testing with a AMD Titanite_4G (RTI1007B BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2308295-NE-BERGAMOEX92
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
a
August 28 2023
  1 Hour, 29 Minutes
b
August 28 2023
  6 Hours, 1 Minute
c
August 29 2023
  1 Hour, 29 Minutes
d
August 29 2023
  3 Hours, 1 Minute
Invert Behavior (Only Show Selected Data)
  3 Hours

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


bergamo extraOpenBenchmarking.orgPhoronix Test SuiteAMD EPYC 9754 128-Core @ 3.10GHz (128 Cores / 256 Threads)AMD Titanite_4G (RTI1007B BIOS)AMD Device 14a4768GB3841GB Micron_9300_MTFDHAL3T8TDPASPEEDBroadcom NetXtreme BCM5720 PCIeUbuntu 22.045.15.0-47-generic (x86_64)GNOME Shell 42.4X Server 1.21.1.31.2.204GCC 11.2.0ext41024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionBergamo Extra BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xaa0010b - OpenJDK Runtime Environment (build 11.0.16+8-post-Ubuntu-0ubuntu122.04)- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

abcdResult OverviewPhoronix Test Suite100%103%107%110%Apache IoTDBSVT-AV1Stress-NGlibavif avifenc

bergamo extraapache-iotdb: 100 - 1 - 200apache-iotdb: 100 - 1 - 200apache-iotdb: 100 - 1 - 500apache-iotdb: 100 - 1 - 500apache-iotdb: 200 - 1 - 200apache-iotdb: 200 - 1 - 200apache-iotdb: 200 - 1 - 500apache-iotdb: 200 - 1 - 500apache-iotdb: 500 - 1 - 200apache-iotdb: 500 - 1 - 200apache-iotdb: 500 - 1 - 500apache-iotdb: 500 - 1 - 500apache-iotdb: 100 - 100 - 200apache-iotdb: 100 - 100 - 200apache-iotdb: 100 - 100 - 500apache-iotdb: 100 - 100 - 500apache-iotdb: 200 - 100 - 200apache-iotdb: 200 - 100 - 200apache-iotdb: 200 - 100 - 500apache-iotdb: 200 - 100 - 500apache-iotdb: 500 - 100 - 200apache-iotdb: 500 - 100 - 200apache-iotdb: 500 - 100 - 500apache-iotdb: 500 - 100 - 500avifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessavifenc: 10, Losslessncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetstress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pipestress-ng: Pollstress-ng: Zlibstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Cloningstress-ng: Forkingstress-ng: Pthreadstress-ng: AVL Treestress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: AVX-512 VNNIstress-ng: Function Callstress-ng: x86_64 RdRandstress-ng: Floating Pointstress-ng: Matrix 3D Mathstress-ng: Memory Copyingstress-ng: Vector Shufflestress-ng: Mixed Schedulerstress-ng: Socket Activitystress-ng: Wide Vector Mathstress-ng: Context Switchingstress-ng: Fused Multiply-Addstress-ng: Vector Floating Pointstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pabcd537074.6323.49938096.1539.4778139.9218.58999701.3343.051151772.0714.121274649.1635.7233175460.0644.7444369568.9395.1741306750.5340.3943327049.22107.0353919386.0233.0464537220.8371.9773.80640.1942.6775.9454.8124.7714.216.1718.1513.5720.78.9830.1429.4113.918.3126.4832.4126.5570.9749.7120.7124467797.72231.16283.3772367692.2814505273.7113705.121895146.4440.4293918333.13211.66271895.07388083810.4810469.7151409.5898472.65992.578566298.561650240.07604083.2279850.9367850395.98552391.35716693.511480669.885124.2341046836.3639805.6113023.7943632.0985166.5590689.7278214.724572615.577469675.5102526238.37340089.77102825108.482701.8810103031.394.99998.456178.176182.78612.041142.338493.566613.433677623.1115.80926489.1140.14912813.6014.881231654.4733.631303858.9912.271329811.1133.9638473913.1036.3551799432.6979.1345305910.9735.7944033224.05104.6254861433.1532.6165454585.3571.6673.75540.2112.6705.9414.80824.8814.2416.1321.4513.5920.998.9630.1428.7913.868.3726.5632.0926.5470.3149.6121.0324474278.892214.38281.2276591989.3914476344.5513658.502040244.79439.4792655094.89210.75271224.97389674083.449174.9546384.7997666.68820.436725069.761443997.07749643.70280293.57378329416.41552416.95716679.5211473920.0885282.2441047165.1339800.438776.1743636.7185167.4390027.3380432.614572134.627906554.60102530863.13340161.67104553211.512708.2610090750.294.991103.707181.633179.95512.156142.137510.670588.734450372.2623.93856042.7944.59759389.3519.29926034.5943.61121506.3314.981413053.331.2631605198.3841.2248070121.0687.9440976754.0340.5945493895.77100.9353565430.3532.8862451638.475.4974.05840.2252.6945.9744.83725.0714.2916.0218.1714.0220.789.2930.3228.9714.328.3126.4732.226.5371.0550.0321.2224491429.312149.59280.6276333457.3114480252.8213642.072047529.16431.2392948117.03212.03272088.28390162833.0210130.6150667.5898016.22990.89046768.131773574.36688466.74280785.65368063616.01552401.63716735.7711514003.9885248.6941047280.3339785.6913029.3543635.8885177.9389799.1581154.124572889.778037439.28102544387.84338134.06103670597.492715.6410078078.624.94974.653183.461185.2912.141148.348498.621584.53662399.9816.45921947.5440.44928635.3514.581214309.1134.151202704.6413.601521285.8029.1538246237.5636.3749363226.9984.2746082624.3834.8843683590.07105.9055623597.2131.9866646010.3368.8473.94640.2542.7005.9714.85724481007.592148.68281.3477385869.4514485138.9413663.251848992.37430.5492600002.69211.25270963.69390992187.569360.7045562.7696237.31789.685363538.722029025.97728809.40280456.86378385037.34552451.28716699.5911513829.3185281.0441048937.8339788.358081.3443638.2085165.5090534.1778780.844572386.637901208.78102525929.49339290.91104251502.302706.8610084371.255.009100.988184.093180.77712.199147.936516.410600.485OpenBenchmarking.org

Apache IoTDB

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200dcba150K300K450K600K750KSE +/- 3588.97, N = 3SE +/- 9185.25, N = 3662399.98450372.26677623.11537074.63

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200dcba612182430SE +/- 0.19, N = 3SE +/- 0.40, N = 316.4523.9315.8023.49MAX: 685.28MAX: 1586.11MAX: 721.43MAX: 1530.02

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500dcba200K400K600K800K1000KSE +/- 7335.74, N = 3SE +/- 7863.29, N = 3921947.54856042.79926489.11938096.15

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500dcba1020304050SE +/- 0.39, N = 3SE +/- 0.58, N = 340.4444.5940.1439.40MAX: 852.25MAX: 1590.03MAX: 792.12MAX: 1521.83

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200dcba200K400K600K800K1000KSE +/- 12086.86, N = 3SE +/- 10906.20, N = 4928635.35759389.35912813.60778139.92

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200dcba510152025SE +/- 0.34, N = 3SE +/- 0.18, N = 414.5819.2914.8818.58MAX: 743.12MAX: 1525.08MAX: 630.35MAX: 1524.1

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500dcba300K600K900K1200K1500KSE +/- 7695.87, N = 3SE +/- 12147.53, N = 31214309.11926034.591231654.47999701.33

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500dcba1020304050SE +/- 0.32, N = 3SE +/- 0.41, N = 334.1543.6033.6343.05MAX: 961.98MAX: 1897.71MAX: 734.86MAX: 1829.74

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200dcba300K600K900K1200K1500KSE +/- 3576.59, N = 3SE +/- 5643.06, N = 31202704.641121506.331303858.991151772.07

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200dcba48121620SE +/- 0.08, N = 3SE +/- 0.13, N = 313.6014.9812.2714.12MAX: 909.68MAX: 1615.98MAX: 935.57MAX: 1722.42

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500dcba300K600K900K1200K1500KSE +/- 2888.46, N = 3SE +/- 3441.10, N = 31521285.801413053.301329811.111274649.16

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500dcba816243240SE +/- 0.09, N = 3SE +/- 0.22, N = 329.1531.2633.9635.72MAX: 977.43MAX: 1711.54MAX: 1056.19MAX: 1699.24

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200dcba8M16M24M32M40MSE +/- 280845.65, N = 15SE +/- 423133.56, N = 338246237.5631605198.3838473913.1033175460.06

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200dcba1020304050SE +/- 0.30, N = 15SE +/- 0.60, N = 336.3741.2236.3544.74MAX: 888.19MAX: 1559.43MAX: 720.02MAX: 1539.96

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500dcba11M22M33M44M55MSE +/- 220442.16, N = 3SE +/- 569086.89, N = 349363226.9948070121.0651799432.6944369568.93

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500dcba20406080100SE +/- 0.43, N = 3SE +/- 0.59, N = 384.2787.9479.1395.17MAX: 1502.98MAX: 2241.3MAX: 1217.05MAX: 1952.6

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200dcba10M20M30M40M50MSE +/- 385456.41, N = 15SE +/- 289848.77, N = 1546082624.3840976754.0345305910.9741306750.53

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200dcba918273645SE +/- 0.30, N = 15SE +/- 0.21, N = 1534.8840.5935.7940.39MAX: 1173.23MAX: 1632.95MAX: 1101.58MAX: 1576.69

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500dcba10M20M30M40M50MSE +/- 459481.87, N = 5SE +/- 516345.89, N = 343683590.0745493895.7744033224.0543327049.22

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500dcba20406080100SE +/- 1.19, N = 5SE +/- 1.63, N = 3105.90100.93104.62107.03MAX: 4306.59MAX: 3162.47MAX: 4006.98MAX: 3391.16

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200dcba12M24M36M48M60MSE +/- 633658.18, N = 3SE +/- 439854.80, N = 955623597.2153565430.3554861433.1553919386.02

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200dcba816243240SE +/- 0.40, N = 3SE +/- 0.28, N = 931.9832.8832.6133.04MAX: 1985.76MAX: 1897.39MAX: 2175.08MAX: 1700.05

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500dcba14M28M42M56M70MSE +/- 629377.50, N = 3SE +/- 186140.02, N = 366646010.3362451638.4065454585.3564537220.83

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500dcba20406080100SE +/- 0.47, N = 3SE +/- 0.59, N = 368.8475.4971.6671.97MAX: 1724.46MAX: 2452.25MAX: 1695.08MAX: 2457.28

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0dcba1632486480SE +/- 0.05, N = 3SE +/- 0.07, N = 373.9574.0673.7673.811. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2dcba918273645SE +/- 0.05, N = 3SE +/- 0.04, N = 340.2540.2340.2140.191. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6dcba0.60751.2151.82252.433.0375SE +/- 0.006, N = 3SE +/- 0.004, N = 32.7002.6942.6702.6771. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslessdcba1.34422.68844.03265.37686.721SE +/- 0.004, N = 3SE +/- 0.004, N = 35.9715.9745.9415.9451. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, Losslessdcba1.09282.18563.27844.37125.464SE +/- 0.018, N = 3SE +/- 0.004, N = 34.8574.8374.8084.8101. (CXX) g++ options: -O3 -fPIC -lm

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenetcba612182430SE +/- 0.28, N = 325.0724.8824.77MIN: 23.88 / MAX: 128.21MIN: 24.04 / MAX: 149.11MIN: 24.64 / MAX: 25.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v2cba48121620SE +/- 0.02, N = 314.2914.2414.20MIN: 13.76 / MAX: 17.53MIN: 13.62 / MAX: 15.59MIN: 13.66 / MAX: 15.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v3cba48121620SE +/- 0.17, N = 316.0216.1316.17MIN: 15.82 / MAX: 17.17MIN: 15.46 / MAX: 147.31MIN: 15.94 / MAX: 23.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v2cba510152025SE +/- 3.00, N = 318.1721.4518.15MIN: 18.04 / MAX: 19.26MIN: 17.63 / MAX: 2074.28MIN: 17.99 / MAX: 25.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnetcba48121620SE +/- 0.05, N = 314.0213.5913.57MIN: 13.22 / MAX: 112.45MIN: 13.35 / MAX: 19.96MIN: 13.46 / MAX: 14.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b0cba510152025SE +/- 0.27, N = 320.7820.9920.70MIN: 20.41 / MAX: 28.31MIN: 20.11 / MAX: 154.38MIN: 20.36 / MAX: 21.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazefacecba3691215SE +/- 0.03, N = 39.298.968.98MIN: 8.89 / MAX: 73.72MIN: 8.74 / MAX: 10.5MIN: 8.86 / MAX: 10.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenetcba714212835SE +/- 0.30, N = 330.3230.1430.14MIN: 30.02 / MAX: 34.76MIN: 29.29 / MAX: 100.58MIN: 29.87 / MAX: 37.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg16cba714212835SE +/- 0.33, N = 328.9728.7929.41MIN: 28.64 / MAX: 35.6MIN: 27.84 / MAX: 36.36MIN: 28.95 / MAX: 37.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet18cba48121620SE +/- 0.10, N = 314.3213.8613.91MIN: 13.1 / MAX: 132.57MIN: 13.5 / MAX: 15.71MIN: 13.78 / MAX: 15.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnetcba246810SE +/- 0.07, N = 38.318.378.31MIN: 8.14 / MAX: 17.07MIN: 8.04 / MAX: 9.46MIN: 8.15 / MAX: 9.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet50cba612182430SE +/- 0.37, N = 326.4726.5626.48MIN: 26.2 / MAX: 42.48MIN: 25.8 / MAX: 33.91MIN: 26.21 / MAX: 32.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tinycba816243240SE +/- 0.09, N = 332.2032.0932.41MIN: 31.79 / MAX: 38.19MIN: 30.65 / MAX: 167.85MIN: 32.1 / MAX: 40.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssdcba612182430SE +/- 0.18, N = 326.5326.5426.55MIN: 26.35 / MAX: 27.75MIN: 26.03 / MAX: 36.21MIN: 26.39 / MAX: 30.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400mcba1632486480SE +/- 0.30, N = 371.0570.3170.97MIN: 69.95 / MAX: 273.33MIN: 69.06 / MAX: 230.57MIN: 69.64 / MAX: 332.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformercba1122334455SE +/- 0.42, N = 350.0349.6149.71MIN: 49.19 / MAX: 108.54MIN: 48.2 / MAX: 89.12MIN: 49 / MAX: 58.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDetcba510152025SE +/- 0.14, N = 321.2221.0320.71MIN: 20.45 / MAX: 152.1MIN: 20.16 / MAX: 178.74MIN: 20.49 / MAX: 27.741. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Stress-NG is a Linux stress tool developed by Colin Ian King. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hashdcba5M10M15M20M25MSE +/- 12802.79, N = 3SE +/- 5139.72, N = 324481007.5924491429.3124474278.8924467797.701. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPdcba5001000150020002500SE +/- 4.32, N = 3SE +/- 5.59, N = 32148.682149.592214.382231.161. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMAdcba60120180240300SE +/- 0.38, N = 3SE +/- 0.21, N = 3281.34280.62281.22283.371. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipedcba17M34M51M68M85MSE +/- 1022734.46, N = 3SE +/- 777377.85, N = 1577385869.4576333457.3176591989.3972367692.281. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Polldcba3M6M9M12M15MSE +/- 3276.84, N = 3SE +/- 7979.11, N = 314485138.9414480252.8214476344.5514505273.711. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlibdcba3K6K9K12K15KSE +/- 10.36, N = 3SE +/- 17.04, N = 313663.2513642.0713658.5013705.121. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Futexdcba400K800K1200K1600K2000KSE +/- 2656.28, N = 3SE +/- 25106.04, N = 151848992.372047529.162040244.791895146.401. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDdcba100200300400500SE +/- 0.28, N = 3SE +/- 0.15, N = 3430.54431.23439.47440.421. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutexdcba20M40M60M80M100MSE +/- 139198.93, N = 3SE +/- 74890.02, N = 392600002.6992948117.0392655094.8993918333.131. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Atomicdcba50100150200250SE +/- 0.14, N = 3SE +/- 0.23, N = 3211.25212.03210.75211.661. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cryptodcba60K120K180K240K300KSE +/- 471.77, N = 3SE +/- 186.77, N = 3270963.69272088.28271224.97271895.071. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mallocdcba80M160M240M320M400MSE +/- 829833.53, N = 3SE +/- 579979.71, N = 3390992187.56390162833.02389674083.44388083810.481. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cloningdcba2K4K6K8K10KSE +/- 885.53, N = 12SE +/- 889.03, N = 129360.7010130.619174.9510469.711. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Forkingdcba11K22K33K44K55KSE +/- 555.17, N = 3SE +/- 342.36, N = 1545562.7650667.5846384.7951409.581. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthreaddcba20K40K60K80K100KSE +/- 593.71, N = 3SE +/- 226.57, N = 396237.3198016.2297666.6898472.651. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Treedcba2004006008001000SE +/- 22.17, N = 15SE +/- 17.45, N = 15789.68990.80820.43992.571. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringdcba2M4M6M8M10MSE +/- 332209.71, N = 15SE +/- 646210.62, N = 125363538.729046768.136725069.768566298.561. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILEdcba400K800K1200K1600K2000KSE +/- 47969.65, N = 12SE +/- 26756.09, N = 152029025.971773574.361443997.071650240.071. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cachedcba160K320K480K640K800KSE +/- 17887.86, N = 15SE +/- 15699.82, N = 15728809.40688466.74749643.70604083.201. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stressdcba60K120K180K240K300KSE +/- 73.06, N = 3SE +/- 68.83, N = 3280456.86280785.65280293.57279850.901. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphoresdcba80M160M240M320M400MSE +/- 5453817.00, N = 3SE +/- 3488706.47, N = 15378385037.34368063616.01378329416.41367850395.981. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Mathdcba120K240K360K480K600KSE +/- 16.96, N = 3SE +/- 13.37, N = 3552451.28552401.63552416.95552391.351. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Mathdcba150K300K450K600K750KSE +/- 96.07, N = 3SE +/- 9.07, N = 3716699.59716735.77716679.52716693.501. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNIdcba2M4M6M8M10MSE +/- 1283.96, N = 3SE +/- 22298.43, N = 311513829.3111514003.9811473920.0811480669.801. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Calldcba20K40K60K80K100KSE +/- 1.98, N = 3SE +/- 3.58, N = 385281.0485248.6985282.2485124.231. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRanddcba9M18M27M36M45MSE +/- 490.53, N = 3SE +/- 440.05, N = 341048937.8341047280.3341047165.1341046836.361. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Pointdcba9K18K27K36K45KSE +/- 22.59, N = 3SE +/- 26.88, N = 339788.3539785.6939800.4339805.611. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Mathdcba3K6K9K12K15KSE +/- 818.02, N = 12SE +/- 718.84, N = 128081.3413029.358776.1713023.791. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copyingdcba9K18K27K36K45KSE +/- 2.00, N = 3SE +/- 2.51, N = 343638.2043635.8843636.7143632.091. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shuffledcba20K40K60K80K100KSE +/- 4.82, N = 3SE +/- 1.61, N = 385165.5085177.9385167.4385166.551. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed Schedulerdcba20K40K60K80K100KSE +/- 74.93, N = 3SE +/- 263.79, N = 390534.1789799.1590027.3390689.721. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket Activitydcba20K40K60K80K100KSE +/- 969.66, N = 15SE +/- 677.17, N = 1578780.8481154.1280432.6178214.721. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Mathdcba1000K2000K3000K4000K5000KSE +/- 133.55, N = 3SE +/- 87.18, N = 34572386.634572889.774572134.624572615.571. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context Switchingdcba2M4M6M8M10MSE +/- 19751.68, N = 3SE +/- 40757.28, N = 37901208.788037439.287906554.607469675.501. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Adddcba20M40M60M80M100MSE +/- 43428.26, N = 3SE +/- 18310.19, N = 3102525929.49102544387.84102530863.13102526238.371. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Pointdcba70K140K210K280K350KSE +/- 1106.27, N = 3SE +/- 498.79, N = 3339290.91338134.06340161.67340089.771. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functionsdcba20M40M60M80M100MSE +/- 503842.92, N = 3SE +/- 599063.24, N = 3104251502.30103670597.49104553211.51102825108.481. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sortingdcba6001200180024003000SE +/- 2.42, N = 3SE +/- 2.95, N = 32706.862715.642708.262701.881. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passingdcba2M4M6M8M10MSE +/- 4791.61, N = 3SE +/- 1058.07, N = 310084371.2510078078.6210090750.2910103031.391. (CXX) g++ options: -O2 -std=gnu99 -lc

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4Kdcba1.1272.2543.3814.5085.635SE +/- 0.010, N = 3SE +/- 0.003, N = 35.0094.9494.9914.9991. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 4Kdcba20406080100SE +/- 0.37, N = 3SE +/- 1.11, N = 3100.9974.65103.7198.461. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4Kdcba4080120160200SE +/- 1.39, N = 15SE +/- 2.17, N = 3184.09183.46181.63178.181. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4Kdcba4080120160200SE +/- 2.53, N = 3SE +/- 1.79, N = 6180.78185.29179.96182.791. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080pdcba3691215SE +/- 0.04, N = 3SE +/- 0.03, N = 312.2012.1412.1612.041. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 1080pdcba306090120150SE +/- 1.28, N = 3SE +/- 1.70, N = 15147.94148.35142.14142.341. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080pdcba110220330440550SE +/- 4.72, N = 3SE +/- 5.02, N = 3516.41498.62510.67493.571. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080pdcba130260390520650SE +/- 2.62, N = 3SE +/- 6.38, N = 3600.49584.53588.73613.431. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

93 Results Shown

Apache IoTDB:
  100 - 1 - 200:
    point/sec
    Average Latency
  100 - 1 - 500:
    point/sec
    Average Latency
  200 - 1 - 200:
    point/sec
    Average Latency
  200 - 1 - 500:
    point/sec
    Average Latency
  500 - 1 - 200:
    point/sec
    Average Latency
  500 - 1 - 500:
    point/sec
    Average Latency
  100 - 100 - 200:
    point/sec
    Average Latency
  100 - 100 - 500:
    point/sec
    Average Latency
  200 - 100 - 200:
    point/sec
    Average Latency
  200 - 100 - 500:
    point/sec
    Average Latency
  500 - 100 - 200:
    point/sec
    Average Latency
  500 - 100 - 500:
    point/sec
    Average Latency
libavif avifenc:
  0
  2
  6
  6, Lossless
  10, Lossless
NCNN:
  CPU - mobilenet
  CPU-v2-v2 - mobilenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU - shufflenet-v2
  CPU - mnasnet
  CPU - efficientnet-b0
  CPU - blazeface
  CPU - googlenet
  CPU - vgg16
  CPU - resnet18
  CPU - alexnet
  CPU - resnet50
  CPU - yolov4-tiny
  CPU - squeezenet_ssd
  CPU - regnety_400m
  CPU - vision_transformer
  CPU - FastestDet
Stress-NG:
  Hash
  MMAP
  NUMA
  Pipe
  Poll
  Zlib
  Futex
  MEMFD
  Mutex
  Atomic
  Crypto
  Malloc
  Cloning
  Forking
  Pthread
  AVL Tree
  IO_uring
  SENDFILE
  CPU Cache
  CPU Stress
  Semaphores
  Matrix Math
  Vector Math
  AVX-512 VNNI
  Function Call
  x86_64 RdRand
  Floating Point
  Matrix 3D Math
  Memory Copying
  Vector Shuffle
  Mixed Scheduler
  Socket Activity
  Wide Vector Math
  Context Switching
  Fused Multiply-Add
  Vector Floating Point
  Glibc C String Functions
  Glibc Qsort Data Sorting
  System V Message Passing
SVT-AV1:
  Preset 4 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 13 - Bosphorus 4K
  Preset 4 - Bosphorus 1080p
  Preset 8 - Bosphorus 1080p
  Preset 12 - Bosphorus 1080p
  Preset 13 - Bosphorus 1080p