FreeBSD ZFS Hypervisor

AMD Ryzen 5 3600 6-Core testing on FreeBSD via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2110053-IB-FREEBSDZF95&export=txt&grs&sro&rro.

FreeBSD ZFS HypervisorProcessorChipsetMemoryDiskGraphicsAudioMotherboardOSKernelCompilerFile-SystemScreen ResolutionPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2019 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2022 gen2 UFSHyper-V Server 2022 gen2 ZFS #2Proxmox 7 ZFSXCP-ng 8.2 ZFSAMD Ryzen 5 3600 6-Core @ 3.60GHz (12 Cores)AMD [AMD] Starship/Matisse Root Complex64GBSamsung SSD 980 1TBASPEEDAMD X570 HDAFreeBSD13.0-RELEASE (x86_64)GCC 10.3.0 + Clang 11.0.1zfs800x600AMD Ryzen 5 3600 6-Core (4 Cores)Microsoft Virtual Machine Hyper-V UEFI v4.1 (Hyper-V BIOS)4096MBMsft Virtual Disk 1.013.0-RELEASE-p4 (x86_64)1024x768Microsoft Virtual Machine Hyper-V UEFI v4.0 (Hyper-V BIOS)ufs13.0-RELEASE (x86_64)zfsMicrosoft Virtual Machine Hyper-V UEFI v4.1 (Hyper-V BIOS)ufs13.0-RELEASE-p4 (x86_64)zfsCommon KVM (4 Cores)QEMU Standard PC (i440FX + PIIX 1996) pc-i440fx-6.0Intel 440FX 82441FX PMC [Natoma]47GBIntel 82371AB/EB/MB PIIX4 ACPI13.0-RELEASE (x86_64)AMD Ryzen 5 3600 6-Core (4 Cores)Xen HVM domU 4.13Cirrus Logic GD 544613.0-RELEASE-p4 (x86_64)OpenBenchmarking.orgCompiler Details- --build=x86_64-portbld-freebsd13.0 --disable-nls --enable-gnu-indirect-function --enable-languages=c,c++,objc,fortran --enable-multilib --enable-plugin --localstatedir=/var --mandir=/usr/local/man --with-as=/usr/local/bin/as --with-build-config=bootstrap-debug --with-gmp=/usr/local --with-ld=/usr/local/bin/ld --without-zstd

FreeBSD ZFS Hypervisoropenssl: SHA256sqlite-speedtest: Timed Time - Size 1,000openssl: RSA4096openssl: RSA4096compress-7zip: Compress Speed Testjohn-the-ripper: Blowfishpgbench: 1 - 100 - Read Onlypgbench: 1 - 100 - Read Only - Average Latencyapache: 100john-the-ripper: MD5t-test1: 2phpbench: PHP Benchmark Suitet-test1: 1nginx: 100iperf: 192.168.1.27 - 5201 - 360 Seconds - TCP - 20pgbench: 1 - 100 - Read Only - Average Latencypgbench: 1 - 100 - Read Onlypgbench: 1 - 100 - Read Write - Average Latencypgbench: 1 - 100 - Read Writepgbench: 1 - 100 - Read Write - Average Latencypgbench: 1 - 100 - Read Writeblogbench: Writeblogbench: ReadPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2019 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2022 gen2 UFSHyper-V Server 2022 gen2 ZFS #2Proxmox 7 ZFSXCP-ng 8.2 ZFS918493551088.0081748.8113146.44339188672046490.489104396.273105262.6914570468.250224.7088562.18016081310219277241696724313658.185318.520825.18828183826738.701206105.70523895016.019203.779412.26344192249.64543614988789941733037107125.224323.621469.385241822438932.27930532.741197745.62123931616.447203.9293959.83216726717544871818648249567.076326.320817.284581812423882.36026539.341206865.72225913116.387203.75940130.36376711999398011695300020125.612318.820691.58359181831019.811199805.96626309416.774204.229402.3924181256.287177730506366461074437310607.512780.851093.4203336510670171.49222418.651759353.2953213499.161206.46941169.748635126711324563694399100401.7571095.472872.1195486195839881.19149812.863628314.64250950016.148205.5194148.805206753981355701OpenBenchmarking.org

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.0Algorithm: SHA256XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS2000M4000M6000M8000M10000MSE +/- 4064000.36, N = 3SE +/- 664193.75, N = 3SE +/- 4517236.92, N = 3SE +/- 7574201.44, N = 3SE +/- 5593250.35, N = 3SE +/- 30814745.08, N = 12SE +/- 14460466.96, N = 336943991001074437310918493551016967243131695300020181864824917330371071. (CC) gcc options: -pthread -O3 -lssl -lcrypto

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS140280420560700SE +/- 5.15, N = 3SE +/- 1.39, N = 3SE +/- 0.04, N = 3SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 1.48, N = 3SE +/- 0.45, N = 3401.76607.5188.01658.19125.61567.08125.221. (CC) gcc options: -O2 -lz -lpthread

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.0Algorithm: RSA4096XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS400800120016002000SE +/- 11.14, N = 13SE +/- 0.74, N = 3SE +/- 0.03, N = 3SE +/- 1.22, N = 3SE +/- 1.59, N = 3SE +/- 2.80, N = 3SE +/- 1.89, N = 31095.4780.81748.8318.5318.8326.3323.61. (CC) gcc options: -pthread -O3 -lssl -lcrypto

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.0Algorithm: RSA4096XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS20K40K60K80K100KSE +/- 728.16, N = 13SE +/- 104.96, N = 3SE +/- 40.47, N = 3SE +/- 37.37, N = 3SE +/- 74.87, N = 3SE +/- 84.84, N = 3SE +/- 695.73, N = 372872.151093.4113146.420825.120691.520817.221469.31. (CC) gcc options: -pthread -O3 -lssl -lcrypto

7-Zip Compression

Compress Speed Test

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 16.02Compress Speed TestXCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS9K18K27K36K45KSE +/- 139.45, N = 3SE +/- 4.91, N = 3SE +/- 413.92, N = 6SE +/- 9.61, N = 3SE +/- 55.19, N = 3SE +/- 45.92, N = 3SE +/- 54.58, N = 319548203334339188288359845885241. (CXX) g++ options: -pipe -lpthread

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.9.0-jumbo-1Test: BlowfishXCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS2K4K6K8K10KSE +/- 45.34, N = 3SE +/- 7.22, N = 3SE +/- 82.40, N = 15SE +/- 3.33, N = 3SE +/- 13.86, N = 3SE +/- 2.19, N = 3SE +/- 4.36, N = 36195651088671838181818121822-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lpcap-lpcap1. (CC) gcc options: -m64 -fopenmp

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read OnlyXCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS40K80K120K160K200KSE +/- 24.29, N = 3SE +/- 120.61, N = 3SE +/- 1738.86, N = 3SE +/- 144.69, N = 3SE +/- 475.16, N = 383988670172046494238843893-lpq-lpq-lpq1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lexecinfo -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average LatencyXCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS0.5311.0621.5932.1242.655SE +/- 0.000, N = 3SE +/- 0.003, N = 3SE +/- 0.004, N = 3SE +/- 0.008, N = 3SE +/- 0.025, N = 31.1911.4920.4892.3602.279-lpq-lpq-lpq1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lexecinfo -lm

Apache HTTP Server

Concurrent Requests: 100

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 100XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS20K40K60K80K100KSE +/- 615.93, N = 4SE +/- 46.86, N = 3SE +/- 357.41, N = 3SE +/- 284.16, N = 5SE +/- 345.94, N = 4SE +/- 363.45, N = 3SE +/- 367.83, N = 449812.8622418.65104396.2726738.7031019.8126539.3430532.741. (CC) gcc options: -shared -fPIC -O2

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.9.0-jumbo-1Test: MD5XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS80K160K240K320K400KSE +/- 348.38, N = 3SE +/- 863.36, N = 3SE +/- 3778.81, N = 3SE +/- 579.82, N = 3SE +/- 628.29, N = 3SE +/- 394.82, N = 3SE +/- 313.45, N = 3362831175935310526120610119980120686119774-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lssl -lcrypto -lgmp -pthread -lm -lz -ldl -lcrypt -lbz2-lpcap-lpcap1. (CC) gcc options: -m64 -fopenmp

t-test1

Threads: 2

OpenBenchmarking.orgSeconds, Fewer Is Bettert-test1 2017-01-13Threads: 2XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS1.34242.68484.02725.36966.712SE +/- 0.067, N = 15SE +/- 0.006, N = 3SE +/- 0.025, N = 7SE +/- 0.063, N = 3SE +/- 0.020, N = 3SE +/- 0.071, N = 15SE +/- 0.058, N = 154.6423.2952.6915.7055.9665.7225.6211. (CC) gcc options: -pthread

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark SuiteXCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS110K220K330K440K550KSE +/- 319.82, N = 3SE +/- 44.94, N = 3SE +/- 360.51, N = 3SE +/- 953.42, N = 3SE +/- 1108.50, N = 3SE +/- 814.65, N = 3SE +/- 668.88, N = 3509500321349457046238950263094259131239316

t-test1

Threads: 1

OpenBenchmarking.orgSeconds, Fewer Is Bettert-test1 2017-01-13Threads: 1XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS48121620SE +/- 0.053, N = 3SE +/- 0.037, N = 3SE +/- 0.030, N = 3SE +/- 0.029, N = 3SE +/- 0.121, N = 3SE +/- 0.069, N = 3SE +/- 0.033, N = 316.1489.1618.25016.01916.77416.38716.4471. (CC) gcc options: -pthread

nginx

Concurrent Requests: 100

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 100XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS50100150200250SE +/- 0.85, N = 3SE +/- 1.11, N = 3SE +/- 6.73, N = 12SE +/- 0.99, N = 3SE +/- 0.63, N = 3SE +/- 0.96, N = 3SE +/- 1.15, N = 3205.51206.46224.70203.77204.22203.75203.921. (CC) gcc options: -lcrypt -lz -O3 -march=native

iPerf

Server Address: 192.168.1.27 - Server Port: 5201 - Duration: 360 Seconds - Test: TCP - Parallel: 20

OpenBenchmarking.orgMbits/sec, More Is BetteriPerf 3.7Server Address: 192.168.1.27 - Server Port: 5201 - Duration: 360 Seconds - Test: TCP - Parallel: 20XCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS2004006008001000SE +/- 36.26, N = 9SE +/- 0.33, N = 39419418859419409409391. (CC) gcc options: -O3 -march=native -lssl -lcrypto -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 14.0Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average LatencyHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFS0.53821.07641.61462.15282.691SE +/- 0.007, N = 3SE +/- 0.007, N = 32.2632.3921. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lexecinfo -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 14.0Scaling Factor: 1 - Clients: 100 - Mode: Read OnlyHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFS9K18K27K36K45KSE +/- 141.62, N = 3SE +/- 125.66, N = 344192418121. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lexecinfo -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 14.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average LatencyHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFS50100150200250SE +/- 22.82, N = 9SE +/- 0.62, N = 3249.6556.291. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lexecinfo -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 14.0Scaling Factor: 1 - Clients: 100 - Mode: Read WriteHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFS400800120016002000SE +/- 48.63, N = 9SE +/- 19.81, N = 343617771. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lexecinfo -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average LatencyXCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS4080120160200SE +/- 1.27, N = 15SE +/- 12.35, N = 15SE +/- 0.13, N = 3SE +/- 1.59, N = 3SE +/- 0.41, N = 348.81169.7562.18130.3659.83-lpq-lpq-lpq1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lexecinfo -lm

PostgreSQL pgbench

Scaling Factor: 1 - Clients: 100 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 13.0Scaling Factor: 1 - Clients: 100 - Mode: Read WriteXCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS400800120016002000SE +/- 50.23, N = 15SE +/- 48.39, N = 15SE +/- 3.35, N = 3SE +/- 9.40, N = 3SE +/- 11.36, N = 3206763516087671672-lpq-lpq-lpq1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lexecinfo -lm

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteXCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS3K6K9K12K15KSE +/- 2643.32, N = 3SE +/- 383.67, N = 3SE +/- 1135.65, N = 3SE +/- 211.50, N = 2SE +/- 495.20, N = 353981267131021498305011996711. (CC) gcc options: -O2 -pthread

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadXCP-ng 8.2 ZFSProxmox 7 ZFSPhysicalHyper-V Server 2022 gen2 ZFS #1Hyper-V Server 2022 gen2 UFSHyper-V Server 2019 gen2 ZFSHyper-V Server 2019 gen2 UFS400K800K1200K1600K2000KSE +/- 69015.49, N = 9SE +/- 119452.26, N = 9SE +/- 20896.13, N = 5SE +/- 68010.49, N = 6SE +/- 62232.41, N = 6SE +/- 51240.74, N = 9SE +/- 37468.76, N = 121355701113245619277248789946366469398017544871. (CC) gcc options: -O2 -pthread

Phoronix Test Suite v10.8.5