bergamo extra

AMD EPYC 9754 128-Core testing with a AMD Titanite_4G (RTI1007B BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2308295-NE-BERGAMOEX92
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
a
August 28 2023
  1 Hour, 29 Minutes
b
August 28 2023
  6 Hours, 1 Minute
c
August 29 2023
  1 Hour, 29 Minutes
d
August 29 2023
  3 Hours, 1 Minute
Invert Behavior (Only Show Selected Data)
  3 Hours

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


bergamo extraOpenBenchmarking.orgPhoronix Test SuiteAMD EPYC 9754 128-Core @ 3.10GHz (128 Cores / 256 Threads)AMD Titanite_4G (RTI1007B BIOS)AMD Device 14a4768GB3841GB Micron_9300_MTFDHAL3T8TDPASPEEDBroadcom NetXtreme BCM5720 PCIeUbuntu 22.045.15.0-47-generic (x86_64)GNOME Shell 42.4X Server 1.21.1.31.2.204GCC 11.2.0ext41024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionBergamo Extra BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xaa0010b - OpenJDK Runtime Environment (build 11.0.16+8-post-Ubuntu-0ubuntu122.04)- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

abcdResult OverviewPhoronix Test Suite100%103%107%110%Apache IoTDBSVT-AV1Stress-NGlibavif avifenc

bergamo extrancnn: CPU - FastestDetncnn: CPU - vision_transformerncnn: CPU - regnety_400mncnn: CPU - squeezenet_ssdncnn: CPU - yolov4-tinyncnn: CPU - resnet50ncnn: CPU - alexnetncnn: CPU - resnet18ncnn: CPU - vgg16ncnn: CPU - googlenetncnn: CPU - blazefacencnn: CPU - efficientnet-b0ncnn: CPU - mnasnetncnn: CPU - shufflenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU - mobilenetstress-ng: CPU Cachestress-ng: IO_uringstress-ng: AVL Treestress-ng: Socket Activitystress-ng: Cloningstress-ng: SENDFILEapache-iotdb: 200 - 100 - 200apache-iotdb: 200 - 100 - 200stress-ng: Matrix 3D Mathapache-iotdb: 500 - 100 - 500apache-iotdb: 500 - 100 - 500apache-iotdb: 500 - 100 - 200apache-iotdb: 500 - 100 - 200stress-ng: Futexstress-ng: Forkingstress-ng: Semaphoresstress-ng: Pipeavifenc: 0apache-iotdb: 200 - 100 - 500apache-iotdb: 200 - 100 - 500apache-iotdb: 100 - 100 - 200apache-iotdb: 100 - 100 - 200apache-iotdb: 500 - 1 - 500apache-iotdb: 500 - 1 - 500avifenc: 2svt-av1: Preset 4 - Bosphorus 4Kapache-iotdb: 100 - 100 - 500apache-iotdb: 100 - 100 - 500stress-ng: Atomicstress-ng: Mallocapache-iotdb: 200 - 1 - 500apache-iotdb: 200 - 1 - 500stress-ng: Pthreadstress-ng: MEMFDstress-ng: MMAPstress-ng: NUMAstress-ng: Fused Multiply-Addstress-ng: Glibc Qsort Data Sortingstress-ng: Matrix Mathstress-ng: x86_64 RdRandstress-ng: Memory Copyingstress-ng: Function Callstress-ng: Cryptostress-ng: Glibc C String Functionsstress-ng: Mixed Schedulerstress-ng: System V Message Passingstress-ng: Zlibstress-ng: Vector Mathstress-ng: Wide Vector Mathstress-ng: CPU Stressstress-ng: Mutexstress-ng: Vector Shufflestress-ng: AVX-512 VNNIstress-ng: Hashstress-ng: Context Switchingstress-ng: Vector Floating Pointstress-ng: Floating Pointstress-ng: Pollapache-iotdb: 500 - 1 - 200apache-iotdb: 500 - 1 - 200apache-iotdb: 200 - 1 - 200apache-iotdb: 200 - 1 - 200apache-iotdb: 100 - 1 - 500apache-iotdb: 100 - 1 - 500apache-iotdb: 100 - 1 - 200apache-iotdb: 100 - 1 - 200svt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kavifenc: 6, Losslessavifenc: 10, Losslessavifenc: 6svt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pabcd20.7149.7170.9726.5532.4126.488.3113.9129.4130.148.9820.713.5718.1516.1714.224.77604083.28566298.56992.5778214.7210469.711650240.0740.3941306750.5313023.7971.9764537220.8333.0453919386.021895146.451409.58367850395.9872367692.2873.806107.0343327049.2244.7433175460.0635.721274649.1640.1944.99995.1744369568.93211.66388083810.4843.05999701.3398472.65440.422231.16283.37102526238.372701.88552391.3541046836.3643632.0985124.23271895.07102825108.4890689.7210103031.3913705.12716693.54572615.57279850.993918333.1385166.5511480669.824467797.77469675.5340089.7739805.6114505273.7114.121151772.0718.58778139.9239.4938096.1523.49537074.6312.041142.338178.17698.456182.7865.9454.812.677493.566613.43321.0349.6170.3126.5432.0926.568.3713.8628.7930.148.9620.9913.5921.4516.1314.2424.88749643.706725069.76820.4380432.619174.951443997.0735.7945305910.978776.1771.6665454585.3532.6154861433.152040244.7946384.79378329416.4176591989.3973.755104.6244033224.0536.3538473913.1033.961329811.1140.2114.99179.1351799432.69210.75389674083.4433.631231654.4797666.68439.472214.38281.22102530863.132708.26552416.9541047165.1343636.7185282.24271224.97104553211.5190027.3310090750.2913658.50716679.524572134.62280293.5792655094.8985167.4311473920.0824474278.897906554.60340161.6739800.4314476344.5512.271303858.9914.88912813.6040.14926489.1115.80677623.1112.156142.137181.633103.707179.9555.9414.8082.670510.670588.73421.2250.0371.0526.5332.226.478.3114.3228.9730.329.2920.7814.0218.1716.0214.2925.07688466.749046768.13990.881154.1210130.611773574.3640.5940976754.0313029.3575.4962451638.432.8853565430.352047529.1650667.58368063616.0176333457.3174.058100.9345493895.7741.2231605198.3831.261413053.340.2254.94987.9448070121.06212.03390162833.0243.6926034.5998016.22431.232149.59280.62102544387.842715.64552401.6341047280.3343635.8885248.69272088.28103670597.4989799.1510078078.6213642.07716735.774572889.77280785.6592948117.0385177.9311514003.9824491429.318037439.28338134.0639785.6914480252.8214.981121506.3319.29759389.3544.59856042.7923.93450372.2612.141148.348183.46174.653185.295.9744.8372.694498.621584.53728809.405363538.72789.6878780.849360.702029025.9734.8846082624.388081.3468.8466646010.3331.9855623597.211848992.3745562.76378385037.3477385869.4573.946105.9043683590.0736.3738246237.5629.151521285.8040.2545.00984.2749363226.99211.25390992187.5634.151214309.1196237.31430.542148.68281.34102525929.492706.86552451.2841048937.8343638.2085281.04270963.69104251502.3090534.1710084371.2513663.25716699.594572386.63280456.8692600002.6985165.5011513829.3124481007.597901208.78339290.9139788.3514485138.9413.601202704.6414.58928635.3540.44921947.5416.45662399.9812.199147.936184.093100.988180.7775.9714.8572.700516.410600.485OpenBenchmarking.org

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDetcba510152025SE +/- 0.14, N = 321.2221.0320.71MIN: 20.45 / MAX: 152.1MIN: 20.16 / MAX: 178.74MIN: 20.49 / MAX: 27.741. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformercab1122334455SE +/- 0.42, N = 350.0349.7149.61MIN: 49.19 / MAX: 108.54MIN: 49 / MAX: 58.88MIN: 48.2 / MAX: 89.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400mcab1632486480SE +/- 0.30, N = 371.0570.9770.31MIN: 69.95 / MAX: 273.33MIN: 69.64 / MAX: 332.61MIN: 69.06 / MAX: 230.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssdabc612182430SE +/- 0.18, N = 326.5526.5426.53MIN: 26.39 / MAX: 30.27MIN: 26.03 / MAX: 36.21MIN: 26.35 / MAX: 27.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tinyacb816243240SE +/- 0.09, N = 332.4132.2032.09MIN: 32.1 / MAX: 40.16MIN: 31.79 / MAX: 38.19MIN: 30.65 / MAX: 167.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet50bac612182430SE +/- 0.37, N = 326.5626.4826.47MIN: 25.8 / MAX: 33.91MIN: 26.21 / MAX: 32.59MIN: 26.2 / MAX: 42.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnetbca246810SE +/- 0.07, N = 38.378.318.31MIN: 8.04 / MAX: 9.46MIN: 8.14 / MAX: 17.07MIN: 8.15 / MAX: 9.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet18cab48121620SE +/- 0.10, N = 314.3213.9113.86MIN: 13.1 / MAX: 132.57MIN: 13.78 / MAX: 15.02MIN: 13.5 / MAX: 15.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg16acb714212835SE +/- 0.33, N = 329.4128.9728.79MIN: 28.95 / MAX: 37.42MIN: 28.64 / MAX: 35.6MIN: 27.84 / MAX: 36.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenetcba714212835SE +/- 0.30, N = 330.3230.1430.14MIN: 30.02 / MAX: 34.76MIN: 29.29 / MAX: 100.58MIN: 29.87 / MAX: 37.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazefacecab3691215SE +/- 0.03, N = 39.298.988.96MIN: 8.89 / MAX: 73.72MIN: 8.86 / MAX: 10.59MIN: 8.74 / MAX: 10.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b0bca510152025SE +/- 0.27, N = 320.9920.7820.70MIN: 20.11 / MAX: 154.38MIN: 20.41 / MAX: 28.31MIN: 20.36 / MAX: 21.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnetcba48121620SE +/- 0.05, N = 314.0213.5913.57MIN: 13.22 / MAX: 112.45MIN: 13.35 / MAX: 19.96MIN: 13.46 / MAX: 14.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v2bca510152025SE +/- 3.00, N = 321.4518.1718.15MIN: 17.63 / MAX: 2074.28MIN: 18.04 / MAX: 19.26MIN: 17.99 / MAX: 25.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v3abc48121620SE +/- 0.17, N = 316.1716.1316.02MIN: 15.94 / MAX: 23.88MIN: 15.46 / MAX: 147.31MIN: 15.82 / MAX: 17.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v2cba48121620SE +/- 0.02, N = 314.2914.2414.20MIN: 13.76 / MAX: 17.53MIN: 13.62 / MAX: 15.59MIN: 13.66 / MAX: 15.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenetcba612182430SE +/- 0.28, N = 325.0724.8824.77MIN: 23.88 / MAX: 128.21MIN: 24.04 / MAX: 149.11MIN: 24.64 / MAX: 25.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Stress-NG is a Linux stress tool developed by Colin Ian King. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cacheacdb160K320K480K640K800KSE +/- 17887.86, N = 15SE +/- 15699.82, N = 15604083.20688466.74728809.40749643.701. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringdbac2M4M6M8M10MSE +/- 332209.71, N = 15SE +/- 646210.62, N = 125363538.726725069.768566298.569046768.131. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Treedbca2004006008001000SE +/- 22.17, N = 15SE +/- 17.45, N = 15789.68820.43990.80992.571. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket Activityadbc20K40K60K80K100KSE +/- 969.66, N = 15SE +/- 677.17, N = 1578214.7278780.8480432.6181154.121. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cloningbdca2K4K6K8K10KSE +/- 889.03, N = 12SE +/- 885.53, N = 129174.959360.7010130.6110469.711. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILEbacd400K800K1200K1600K2000KSE +/- 26756.09, N = 15SE +/- 47969.65, N = 121443997.071650240.071773574.362029025.971. (CXX) g++ options: -O2 -std=gnu99 -lc

Apache IoTDB

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200cabd918273645SE +/- 0.21, N = 15SE +/- 0.30, N = 1540.5940.3935.7934.88MAX: 1632.95MAX: 1576.69MAX: 1101.58MAX: 1173.23

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200cabd10M20M30M40M50MSE +/- 289848.77, N = 15SE +/- 385456.41, N = 1540976754.0341306750.5345305910.9746082624.38

Stress-NG

Stress-NG is a Linux stress tool developed by Colin Ian King. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Mathdbac3K6K9K12K15KSE +/- 818.02, N = 12SE +/- 718.84, N = 128081.348776.1713023.7913029.351. (CXX) g++ options: -O2 -std=gnu99 -lc

Apache IoTDB

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500cabd20406080100SE +/- 0.59, N = 3SE +/- 0.47, N = 375.4971.9771.6668.84MAX: 2452.25MAX: 2457.28MAX: 1695.08MAX: 1724.46

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500cabd14M28M42M56M70MSE +/- 186140.02, N = 3SE +/- 629377.50, N = 362451638.4064537220.8365454585.3566646010.33

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200acbd816243240SE +/- 0.28, N = 9SE +/- 0.40, N = 333.0432.8832.6131.98MAX: 1700.05MAX: 1897.39MAX: 2175.08MAX: 1985.76

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200cabd12M24M36M48M60MSE +/- 439854.80, N = 9SE +/- 633658.18, N = 353565430.3553919386.0254861433.1555623597.21

Stress-NG

Stress-NG is a Linux stress tool developed by Colin Ian King. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Futexdabc400K800K1200K1600K2000KSE +/- 2656.28, N = 3SE +/- 25106.04, N = 151848992.371895146.402040244.792047529.161. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Forkingdbca11K22K33K44K55KSE +/- 555.17, N = 3SE +/- 342.36, N = 1545562.7646384.7950667.5851409.581. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphoresacbd80M160M240M320M400MSE +/- 3488706.47, N = 15SE +/- 5453817.00, N = 3367850395.98368063616.01378329416.41378385037.341. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipeacbd17M34M51M68M85MSE +/- 777377.85, N = 15SE +/- 1022734.46, N = 372367692.2876333457.3176591989.3977385869.451. (CXX) g++ options: -O2 -std=gnu99 -lc

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0cdab1632486480SE +/- 0.05, N = 3SE +/- 0.07, N = 374.0673.9573.8173.761. (CXX) g++ options: -O3 -fPIC -lm

Apache IoTDB

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500adbc20406080100SE +/- 1.19, N = 5SE +/- 1.63, N = 3107.03105.90104.62100.93MAX: 3391.16MAX: 4306.59MAX: 4006.98MAX: 3162.47

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500adbc10M20M30M40M50MSE +/- 459481.87, N = 5SE +/- 516345.89, N = 343327049.2243683590.0744033224.0545493895.77

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200acdb1020304050SE +/- 0.30, N = 15SE +/- 0.60, N = 344.7441.2236.3736.35MAX: 1539.96MAX: 1559.43MAX: 888.19MAX: 720.02

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200cadb8M16M24M32M40MSE +/- 280845.65, N = 15SE +/- 423133.56, N = 331605198.3833175460.0638246237.5638473913.10

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500abcd816243240SE +/- 0.22, N = 3SE +/- 0.09, N = 335.7233.9631.2629.15MAX: 1699.24MAX: 1056.19MAX: 1711.54MAX: 977.43

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500abcd300K600K900K1200K1500KSE +/- 3441.10, N = 3SE +/- 2888.46, N = 31274649.161329811.111413053.301521285.80

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2dcba918273645SE +/- 0.05, N = 3SE +/- 0.04, N = 340.2540.2340.2140.191. (CXX) g++ options: -O3 -fPIC -lm

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 4Kcbad1.1272.2543.3814.5085.635SE +/- 0.003, N = 3SE +/- 0.010, N = 34.9494.9914.9995.0091. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Apache IoTDB

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500acdb20406080100SE +/- 0.43, N = 3SE +/- 0.59, N = 395.1787.9484.2779.13MAX: 1952.6MAX: 2241.3MAX: 1502.98MAX: 1217.05

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500acdb11M22M33M44M55MSE +/- 220442.16, N = 3SE +/- 569086.89, N = 344369568.9348070121.0649363226.9951799432.69

Stress-NG

Stress-NG is a Linux stress tool developed by Colin Ian King. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Atomicbdac50100150200250SE +/- 0.23, N = 3SE +/- 0.14, N = 3210.75211.25211.66212.031. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mallocabcd80M160M240M320M400MSE +/- 579979.71, N = 3SE +/- 829833.53, N = 3388083810.48389674083.44390162833.02390992187.561. (CXX) g++ options: -O2 -std=gnu99 -lc

Apache IoTDB

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500cadb1020304050SE +/- 0.32, N = 3SE +/- 0.41, N = 343.6043.0534.1533.63MAX: 1897.71MAX: 1829.74MAX: 961.98MAX: 734.86

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500cadb300K600K900K1200K1500KSE +/- 7695.87, N = 3SE +/- 12147.53, N = 3926034.59999701.331214309.111231654.47

Stress-NG

Stress-NG is a Linux stress tool developed by Colin Ian King. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthreaddbca20K40K60K80K100KSE +/- 593.71, N = 3SE +/- 226.57, N = 396237.3197666.6898016.2298472.651. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDdcba100200300400500SE +/- 0.28, N = 3SE +/- 0.15, N = 3430.54431.23439.47440.421. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPdcba5001000150020002500SE +/- 4.32, N = 3SE +/- 5.59, N = 32148.682149.592214.382231.161. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMAcbda60120180240300SE +/- 0.21, N = 3SE +/- 0.38, N = 3280.62281.22281.34283.371. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Adddabc20M40M60M80M100MSE +/- 43428.26, N = 3SE +/- 18310.19, N = 3102525929.49102526238.37102530863.13102544387.841. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sortingadbc6001200180024003000SE +/- 2.42, N = 3SE +/- 2.95, N = 32701.882706.862708.262715.641. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Mathacbd120K240K360K480K600KSE +/- 13.37, N = 3SE +/- 16.96, N = 3552391.35552401.63552416.95552451.281. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRandabcd9M18M27M36M45MSE +/- 440.05, N = 3SE +/- 490.53, N = 341046836.3641047165.1341047280.3341048937.831. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copyingacbd9K18K27K36K45KSE +/- 2.51, N = 3SE +/- 2.00, N = 343632.0943635.8843636.7143638.201. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Callacdb20K40K60K80K100KSE +/- 1.98, N = 3SE +/- 3.58, N = 385124.2385248.6985281.0485282.241. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cryptodbac60K120K180K240K300KSE +/- 471.77, N = 3SE +/- 186.77, N = 3270963.69271224.97271895.07272088.281. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functionsacdb20M40M60M80M100MSE +/- 503842.92, N = 3SE +/- 599063.24, N = 3102825108.48103670597.49104251502.30104553211.511. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed Schedulercbda20K40K60K80K100KSE +/- 263.79, N = 3SE +/- 74.93, N = 389799.1590027.3390534.1790689.721. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passingcdba2M4M6M8M10MSE +/- 4791.61, N = 3SE +/- 1058.07, N = 310078078.6210084371.2510090750.2910103031.391. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlibcbda3K6K9K12K15KSE +/- 17.04, N = 3SE +/- 10.36, N = 313642.0713658.5013663.2513705.121. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Mathbadc150K300K450K600K750KSE +/- 9.07, N = 3SE +/- 96.07, N = 3716679.52716693.50716699.59716735.771. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Mathbdac1000K2000K3000K4000K5000KSE +/- 87.18, N = 3SE +/- 133.55, N = 34572134.624572386.634572615.574572889.771. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stressabdc60K120K180K240K300KSE +/- 68.83, N = 3SE +/- 73.06, N = 3279850.90280293.57280456.86280785.651. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutexdbca20M40M60M80M100MSE +/- 139198.93, N = 3SE +/- 74890.02, N = 392600002.6992655094.8992948117.0393918333.131. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shuffledabc20K40K60K80K100KSE +/- 4.82, N = 3SE +/- 1.61, N = 385165.5085166.5585167.4385177.931. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNIbadc2M4M6M8M10MSE +/- 22298.43, N = 3SE +/- 1283.96, N = 311473920.0811480669.8011513829.3111514003.981. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hashabdc5M10M15M20M25MSE +/- 5139.72, N = 3SE +/- 12802.79, N = 324467797.7024474278.8924481007.5924491429.311. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context Switchingadbc2M4M6M8M10MSE +/- 19751.68, N = 3SE +/- 40757.28, N = 37469675.507901208.787906554.608037439.281. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Pointcdab70K140K210K280K350KSE +/- 1106.27, N = 3SE +/- 498.79, N = 3338134.06339290.91340089.77340161.671. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Pointcdba9K18K27K36K45KSE +/- 22.59, N = 3SE +/- 26.88, N = 339785.6939788.3539800.4339805.611. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pollbcda3M6M9M12M15MSE +/- 7979.11, N = 3SE +/- 3276.84, N = 314476344.5514480252.8214485138.9414505273.711. (CXX) g++ options: -O2 -std=gnu99 -lc

Apache IoTDB

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200cadb48121620SE +/- 0.08, N = 3SE +/- 0.13, N = 314.9814.1213.6012.27MAX: 1615.98MAX: 1722.42MAX: 909.68MAX: 935.57

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200cadb300K600K900K1200K1500KSE +/- 3576.59, N = 3SE +/- 5643.06, N = 31121506.331151772.071202704.641303858.99

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200cabd510152025SE +/- 0.18, N = 4SE +/- 0.34, N = 319.2918.5814.8814.58MAX: 1525.08MAX: 1524.1MAX: 630.35MAX: 743.12

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200cabd200K400K600K800K1000KSE +/- 10906.20, N = 4SE +/- 12086.86, N = 3759389.35778139.92912813.60928635.35

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500cdba1020304050SE +/- 0.39, N = 3SE +/- 0.58, N = 344.5940.4440.1439.40MAX: 1590.03MAX: 852.25MAX: 792.12MAX: 1521.83

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500cdba200K400K600K800K1000KSE +/- 7335.74, N = 3SE +/- 7863.29, N = 3856042.79921947.54926489.11938096.15

OpenBenchmarking.orgAverage Latency, Fewer Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200cadb612182430SE +/- 0.19, N = 3SE +/- 0.40, N = 323.9323.4916.4515.80MAX: 1586.11MAX: 1530.02MAX: 685.28MAX: 721.43

OpenBenchmarking.orgpoint/sec, More Is BetterApache IoTDB 1.1.2Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200cadb150K300K450K600K750KSE +/- 3588.97, N = 3SE +/- 9185.25, N = 3450372.26537074.63662399.98677623.11

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 4 - Input: Bosphorus 1080pacbd3691215SE +/- 0.03, N = 3SE +/- 0.04, N = 312.0412.1412.1612.201. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 1080pbadc306090120150SE +/- 1.70, N = 15SE +/- 1.28, N = 3142.14142.34147.94148.351. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 4Kabcd4080120160200SE +/- 2.17, N = 3SE +/- 1.39, N = 15178.18181.63183.46184.091. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 8 - Input: Bosphorus 4Kcadb20406080100SE +/- 0.37, N = 3SE +/- 1.11, N = 374.6598.46100.99103.711. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 4Kbdac4080120160200SE +/- 1.79, N = 6SE +/- 2.53, N = 3179.96180.78182.79185.291. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslesscdab1.34422.68844.03265.37686.721SE +/- 0.004, N = 3SE +/- 0.004, N = 35.9745.9715.9455.9411. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, Losslessdcab1.09282.18563.27844.37125.464SE +/- 0.018, N = 3SE +/- 0.004, N = 34.8574.8374.8104.8081. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6dcab0.60751.2151.82252.433.0375SE +/- 0.006, N = 3SE +/- 0.004, N = 32.7002.6942.6772.6701. (CXX) g++ options: -O3 -fPIC -lm

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 12 - Input: Bosphorus 1080pacbd110220330440550SE +/- 5.02, N = 3SE +/- 4.72, N = 3493.57498.62510.67516.411. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.7Encoder Mode: Preset 13 - Input: Bosphorus 1080pcbda130260390520650SE +/- 6.38, N = 3SE +/- 2.62, N = 3584.53588.73600.49613.431. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

93 Results Shown

NCNN:
  CPU - FastestDet
  CPU - vision_transformer
  CPU - regnety_400m
  CPU - squeezenet_ssd
  CPU - yolov4-tiny
  CPU - resnet50
  CPU - alexnet
  CPU - resnet18
  CPU - vgg16
  CPU - googlenet
  CPU - blazeface
  CPU - efficientnet-b0
  CPU - mnasnet
  CPU - shufflenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU-v2-v2 - mobilenet-v2
  CPU - mobilenet
Stress-NG:
  CPU Cache
  IO_uring
  AVL Tree
  Socket Activity
  Cloning
  SENDFILE
Apache IoTDB:
  200 - 100 - 200:
    Average Latency
    point/sec
Stress-NG
Apache IoTDB:
  500 - 100 - 500:
    Average Latency
    point/sec
  500 - 100 - 200:
    Average Latency
    point/sec
Stress-NG:
  Futex
  Forking
  Semaphores
  Pipe
libavif avifenc
Apache IoTDB:
  200 - 100 - 500:
    Average Latency
    point/sec
  100 - 100 - 200:
    Average Latency
    point/sec
  500 - 1 - 500:
    Average Latency
    point/sec
libavif avifenc
SVT-AV1
Apache IoTDB:
  100 - 100 - 500:
    Average Latency
    point/sec
Stress-NG:
  Atomic
  Malloc
Apache IoTDB:
  200 - 1 - 500:
    Average Latency
    point/sec
Stress-NG:
  Pthread
  MEMFD
  MMAP
  NUMA
  Fused Multiply-Add
  Glibc Qsort Data Sorting
  Matrix Math
  x86_64 RdRand
  Memory Copying
  Function Call
  Crypto
  Glibc C String Functions
  Mixed Scheduler
  System V Message Passing
  Zlib
  Vector Math
  Wide Vector Math
  CPU Stress
  Mutex
  Vector Shuffle
  AVX-512 VNNI
  Hash
  Context Switching
  Vector Floating Point
  Floating Point
  Poll
Apache IoTDB:
  500 - 1 - 200:
    Average Latency
    point/sec
  200 - 1 - 200:
    Average Latency
    point/sec
  100 - 1 - 500:
    Average Latency
    point/sec
  100 - 1 - 200:
    Average Latency
    point/sec
SVT-AV1:
  Preset 4 - Bosphorus 1080p
  Preset 8 - Bosphorus 1080p
  Preset 12 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 13 - Bosphorus 4K
libavif avifenc:
  6, Lossless
  10, Lossless
  6
SVT-AV1:
  Preset 12 - Bosphorus 1080p
  Preset 13 - Bosphorus 1080p