9654 new

2 x AMD EPYC 9654 96-Core testing with a AMD Titanite_4G (RTI1004D BIOS) and llvmpipe on Red Hat Enterprise Linux 9.1 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2303114-NE-9654NEW5019
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Timed Code Compilation 2 Tests
C/C++ Compiler Tests 5 Tests
CPU Massive 5 Tests
Creator Workloads 8 Tests
Database Test Suite 3 Tests
Encoding 4 Tests
HPC - High Performance Computing 4 Tests
Common Kernel Benchmarks 2 Tests
Machine Learning 3 Tests
Multi-Core 12 Tests
Intel oneAPI 4 Tests
Programmer / Developer System Benchmarks 3 Tests
Python Tests 2 Tests
Server 3 Tests
Server CPU Tests 4 Tests
Video Encoding 4 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
March 09 2023
  2 Hours, 22 Minutes
b
March 10 2023
  2 Hours, 23 Minutes
c
March 10 2023
  2 Hours, 22 Minutes
no smt a
March 10 2023
  2 Hours, 24 Minutes
no smt b
March 10 2023
  2 Hours, 24 Minutes
smt a
March 11 2023
  2 Hours, 30 Minutes
smt b
March 11 2023
  2 Hours, 30 Minutes
smt c
March 11 2023
  2 Hours, 30 Minutes
smt d
March 11 2023
  2 Hours, 30 Minutes
Invert Hiding All Results Option
  2 Hours, 26 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

9654 new 2 x AMD EPYC 9654 96-Core testing with a AMD Titanite_4G (RTI1004D BIOS) and llvmpipe on Red Hat Enterprise Linux 9.1 via the Phoronix Test Suite. ,,"a","b","c","no smt a","no smt b","smt a","smt b","smt c","smt d" Processor,,AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads),AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads),AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads),2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores),2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores),2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads),2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads),2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads),2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads) Motherboard,,AMD Titanite_4G (RTI1004D BIOS),AMD Titanite_4G (RTI1004D BIOS),AMD Titanite_4G (RTI1004D BIOS),AMD Titanite_4G (RTI1004D BIOS),AMD Titanite_4G (RTI1004D BIOS),AMD Titanite_4G (RTI1004D BIOS),AMD Titanite_4G (RTI1004D BIOS),AMD Titanite_4G (RTI1004D BIOS),AMD Titanite_4G (RTI1004D BIOS) Chipset,,AMD Device 14a4,AMD Device 14a4,AMD Device 14a4,AMD Device 14a4,AMD Device 14a4,AMD Device 14a4,AMD Device 14a4,AMD Device 14a4,AMD Device 14a4 Memory,,768GB,768GB,768GB,1520GB,1520GB,1520GB,1520GB,1520GB,1520GB Disk,,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007,2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 Graphics,,ASPEED,ASPEED,ASPEED,llvmpipe,llvmpipe,llvmpipe,llvmpipe,llvmpipe,llvmpipe Monitor,,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI,VGA HDMI Network,,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe,Broadcom NetXtreme BCM5720 PCIe OS,,Red Hat Enterprise Linux 9.1,Red Hat Enterprise Linux 9.1,Red Hat Enterprise Linux 9.1,Red Hat Enterprise Linux 9.1,Red Hat Enterprise Linux 9.1,Red Hat Enterprise Linux 9.1,Red Hat Enterprise Linux 9.1,Red Hat Enterprise Linux 9.1,Red Hat Enterprise Linux 9.1 Kernel,,5.14.0-162.6.1.el9_1.x86_64 (x86_64),5.14.0-162.6.1.el9_1.x86_64 (x86_64),5.14.0-162.6.1.el9_1.x86_64 (x86_64),5.14.0-162.6.1.el9_1.x86_64 (x86_64),5.14.0-162.6.1.el9_1.x86_64 (x86_64),5.14.0-162.6.1.el9_1.x86_64 (x86_64),5.14.0-162.6.1.el9_1.x86_64 (x86_64),5.14.0-162.6.1.el9_1.x86_64 (x86_64),5.14.0-162.6.1.el9_1.x86_64 (x86_64) Desktop,,GNOME Shell 40.10,GNOME Shell 40.10,GNOME Shell 40.10,GNOME Shell 40.10,GNOME Shell 40.10,GNOME Shell 40.10,GNOME Shell 40.10,GNOME Shell 40.10,GNOME Shell 40.10 Display Server,,X Server 1.20.11,X Server 1.20.11,X Server 1.20.11,X Server 1.20.11,X Server 1.20.11,X Server 1.20.11,X Server 1.20.11,X Server 1.20.11,X Server 1.20.11 Compiler,,GCC 11.3.1 20220421,GCC 11.3.1 20220421,GCC 11.3.1 20220421,GCC 11.3.1 20220421,GCC 11.3.1 20220421,GCC 11.3.1 20220421,GCC 11.3.1 20220421,GCC 11.3.1 20220421,GCC 11.3.1 20220421 File-System,,xfs,xfs,xfs,xfs,xfs,xfs,xfs,xfs,xfs Screen Resolution,,1600x1200,1600x1200,1600x1200,1024x768,1024x768,1024x768,1024x768,1024x768,1024x768 OpenGL,,,,,4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits),4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits),4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits),4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits),4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits),4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits) ,,"a","b","c","no smt a","no smt b","smt a","smt b","smt c","smt d" "Stress-NG - Test: Zlib ()",,,,,,,,,, "Stress-NG - Test: IO_uring ()",,,,,,,,,, "Stress-NG - Test: x86_64 RdRand ()",,,,,,,,,, "Stress-NG - Test: Hash (Bogo Ops/s)",HIB,18954936,18955118.1,18961773.18,27408413.1,27422305.53,41966139.67,41989522.68,41972765.93,41965286.06 "Stress-NG - Test: MMAP (Bogo Ops/s)",HIB,1663.08,1664.75,1668.92,4520.48,3591.71,8360.76,9017.12,7633.16,7273.19 "Stress-NG - Test: NUMA (Bogo Ops/s)",HIB,483.9,498.67,478.05,20.51,19.78,24.82,24.77,24.79,24.71 "Stress-NG - Test: Poll (Bogo Ops/s)",HIB,12653709.64,12661687.46,12676101.41,10458275.24,10393402.01,15359471.73,15341564.16,15228320.07,15403597.24 "Stress-NG - Test: Futex (Bogo Ops/s)",HIB,2794694.37,2805836.52,2794473.75,3746361.52,3802292.6,2333781.39,2396325.93,2067499.58,2077119.76 "Stress-NG - Test: MEMFD (Bogo Ops/s)",HIB,518.46,507.74,507.97,303.56,308.67,464.7,564.05,413.34,394.49 "Stress-NG - Test: Mutex (Bogo Ops/s)",HIB,59479783.64,60031543.97,59929401.4,63581395.67,65500297.73,136339636.91,135855921.28,138939958.5,137579874.56 "Stress-NG - Test: Atomic (Bogo Ops/s)",HIB,174.72,223.29,183.33,400.03,395.95,184.34,186.64,184.24,182.8 "Stress-NG - Test: Crypto (Bogo Ops/s)",HIB,203073.15,203147.15,203095.44,435615.35,437065.75,466292.12,466609.22,468159.21,468006 "Stress-NG - Test: Malloc (Bogo Ops/s)",HIB,312709034.05,314418461.02,313768771.26,456657338.84,456651508.04,634718750.41,634995429.66,639757070.52,640853365.54 "Stress-NG - Test: Forking (Bogo Ops/s)",HIB,58156.36,58664.97,64299.62,43094.96,45685.28,36266.02,36020.16,34917.39,34685.85 "Stress-NG - Test: Pthread (Bogo Ops/s)",HIB,109397.78,109356.78,109609.15,68076.03,67451.3,74978.51,180407.59,77834.39,91735.75 "Stress-NG - Test: SENDFILE (Bogo Ops/s)",HIB,1950323.96,1913590.77,1891202.37,3284433.2,3282827.5,4329963.26,4329824.38,4351871.12,4351920.42 "Stress-NG - Test: CPU Cache (Bogo Ops/s)",HIB,77.51,67.21,97.04,40.94,55.84,47.58,44.38,42.55,40.56 "Stress-NG - Test: CPU Stress (Bogo Ops/s)",HIB,205134.87,217072.27,217304.19,328297.04,326819.72,487359.39,487987.32,490300.48,489998.75 "Stress-NG - Test: Semaphores (Bogo Ops/s)",HIB,18128283.29,18100474.36,18088584.67,13141129.68,13192391.85,20047519.05,19927313.52,19866440.86,19842969.28 "Stress-NG - Test: Matrix Math (Bogo Ops/s)",HIB,382305.69,382304.04,382328.5,932248.18,925984.24,946032.88,946660.88,952461.48,951700.17 "Stress-NG - Test: Vector Math (Bogo Ops/s)",HIB,556875.59,556797.27,556833.5,920216.27,920642.34,1291689.33,1291704.57,1295970.28,1300693.93 "Stress-NG - Test: Function Call (Bogo Ops/s)",HIB,621015.34,621003.92,621041.93,829106.63,829445.38,1414423.65,1413555.44,1422505.51,1425621.44 "Stress-NG - Test: Memory Copying (Bogo Ops/s)",HIB,20106.51,20340.4,20297.91,11342.69,10949.9,15914.1,15430.18,15077.69,13370.33 "Stress-NG - Test: Socket Activity (Bogo Ops/s)",HIB,8873.58,8851.65,8876.1,8968.28,8924.1,8748.99,8750.61,8747.83,8864.78 "Stress-NG - Test: Context Switching (Bogo Ops/s)",HIB,18941003.97,16313126.86,16862185.54,47222624.49,44683906.68,12895047.73,12221058.34,12328933.65,12728401.45 "Stress-NG - Test: Glibc C String Functions (Bogo Ops/s)",HIB,16257100.25,16168655.17,16537965.14,26755146.69,28009942.56,35687958.37,35996976.13,34602827.77,36111781.82 "Stress-NG - Test: Glibc Qsort Data Sorting (Bogo Ops/s)",HIB,1122.39,1132.35,1125.86,1978.8,1963.75,2564.48,2520.38,2517.26,2516.09 "Stress-NG - Test: System V Message Passing (Bogo Ops/s)",HIB,10473084.09,10471889.97,10475486.39,7402514.74,7372780.72,10103952.13,8586858.51,8609357.68,12418451.71 "OpenVINO - Model: Face Detection FP16 - Device: CPU (FPS)",HIB,49.72,49.72,49.77,109.08,109.04,108.93,108.89,109.36,109.23 "OpenVINO - Model: Person Detection FP16 - Device: CPU (FPS)",HIB,28.47,28.42,28.33,57.58,57.49,57.72,57.67,58.05,58 "OpenVINO - Model: Person Detection FP32 - Device: CPU (FPS)",HIB,27.97,28.23,27.89,57.18,57.19,57.29,57.31,57.71,57.62 "OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (FPS)",HIB,2941.47,3085.53,3174.04,7979.05,7979.82,7953.21,7949.05,7993.18,7990.47 "OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (FPS)",HIB,95.76,95.48,95.59,208.82,210.14,208.13,208.19,210.19,209.24 "OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (FPS)",HIB,5908.89,5894.27,5898.79,12119.66,12128.38,12117.16,12109.64,12168.05,12172.92 "OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (FPS)",HIB,4914.17,4915.42,4910.13,10556.93,10549.24,10544.03,10549.15,10603.84,10587.3 "OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (FPS)",HIB,540.41,541.03,535.78,1045.81,1048.74,1049.16,1050.37,1058.57,1057.74 "OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (FPS)",HIB,9494.22,9496.95,9485.65,20836.1,20849.75,20610.23,20610.62,20684.29,20679.68 "OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (FPS)",HIB,5750.74,5720.9,5724.81,9784.09,9758.74,9746.08,9680.44,9773.26,9767.99 "OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (FPS)",HIB,112346.36,111378.39,112186.25,160545.41,162294.47,173926.92,175754.35,173620.31,172228.34 "OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (FPS)",HIB,74495.17,74353.41,74486.08,127833.52,127770.39,148316.88,147582.87,148047.13,149647.68 "Embree - Binary: Pathtracer - Model: Crown (FPS)",HIB,,,,,,,,, "Embree - Binary: Pathtracer ISPC - Model: Crown (FPS)",HIB,,,,,,,,, "Embree - Binary: Pathtracer - Model: Asian Dragon (FPS)",HIB,,,,,,,,, "Embree - Binary: Pathtracer - Model: Asian Dragon Obj (FPS)",HIB,,,,,,,,, "Embree - Binary: Pathtracer ISPC - Model: Asian Dragon (FPS)",HIB,,,,,,,,, "Embree - Binary: Pathtracer ISPC - Model: Asian Dragon Obj (FPS)",HIB,,,,,,,,, "Kvazaar - Video Input: Bosphorus 4K - Video Preset: Slow (FPS)",HIB,40.63,40.86,40.76,47.13,47.43,64.63,66.22,65.49,66.08 "Kvazaar - Video Input: Bosphorus 4K - Video Preset: Medium (FPS)",HIB,41.4,41.39,41.47,47.97,47.93,65.56,65.69,65.59,65.49 "Kvazaar - Video Input: Bosphorus 1080p - Video Preset: Slow (FPS)",HIB,139.92,139.07,140.1,155.56,159.79,132.67,136.33,135.8,135.56 "Kvazaar - Video Input: Bosphorus 1080p - Video Preset: Medium (FPS)",HIB,143.31,144.21,143.81,159.63,161.4,140.78,138.33,140.89,136.42 "Kvazaar - Video Input: Bosphorus 4K - Video Preset: Very Fast (FPS)",HIB,80.9,81.61,80.31,70.02,69.94,75.91,74.11,73.57,73.24 "Kvazaar - Video Input: Bosphorus 4K - Video Preset: Super Fast (FPS)",HIB,81.9,80.68,84.55,75.5,74.03,76.64,76.7,78.72,75.5 "Kvazaar - Video Input: Bosphorus 4K - Video Preset: Ultra Fast (FPS)",HIB,83.45,84.77,82.7,76.05,74.37,77.96,77,76.14,78.85 "Kvazaar - Video Input: Bosphorus 1080p - Video Preset: Very Fast (FPS)",HIB,296.93,290.59,291.03,269.62,268.77,250.71,274.63,243.36,270.76 "Kvazaar - Video Input: Bosphorus 1080p - Video Preset: Super Fast (FPS)",HIB,307.49,303.99,301.4,288.41,280.18,296.72,267.04,288.09,256.45 "Kvazaar - Video Input: Bosphorus 1080p - Video Preset: Ultra Fast (FPS)",HIB,310.73,305.52,309.64,278.62,271.45,302.55,295.18,303.43,303.63 "uvg266 - Video Input: Bosphorus 4K - Video Preset: Slow (FPS)",HIB,29.37,29.29,29.41,34.59,34.68,45.56,46.25,46.34,46.25 "uvg266 - Video Input: Bosphorus 4K - Video Preset: Medium (FPS)",HIB,33.03,33.13,33.1,38.38,38.65,47.56,46.62,46.57,46.21 "uvg266 - Video Input: Bosphorus 1080p - Video Preset: Slow (FPS)",HIB,81.16,81.41,81.1,87.15,88.13,80.17,79.95,79.63,80 "uvg266 - Video Input: Bosphorus 1080p - Video Preset: Medium (FPS)",HIB,91.37,91.47,91.29,98.21,96.67,89.4,89.7,89.16,88.91 "uvg266 - Video Input: Bosphorus 4K - Video Preset: Very Fast (FPS)",HIB,68.82,68.79,69.04,57.13,58.09,59.3,57.86,57.44,57.52 "uvg266 - Video Input: Bosphorus 4K - Video Preset: Super Fast (FPS)",HIB,69.33,69,69.92,59.83,58.33,59.06,59.2,58.34,58.66 "uvg266 - Video Input: Bosphorus 4K - Video Preset: Ultra Fast (FPS)",HIB,70.56,70.68,71.13,57.78,57.23,57.96,57.51,57.33,58.76 "uvg266 - Video Input: Bosphorus 1080p - Video Preset: Very Fast (FPS)",HIB,234.95,234.68,237.44,196.25,183.75,183.99,209.55,192.25,181.83 "uvg266 - Video Input: Bosphorus 1080p - Video Preset: Super Fast (FPS)",HIB,238.68,239.92,237.96,181.67,216.15,178.49,220.79,178.78,218.91 "uvg266 - Video Input: Bosphorus 1080p - Video Preset: Ultra Fast (FPS)",HIB,240.98,240.91,238.77,186.24,209.85,216.15,179.56,218.28,224.31 "VP9 libvpx Encoding - Speed: Speed 0 - Input: Bosphorus 4K (FPS)",HIB,7.68,7.71,7.7,7.04,7.16,7.24,6.97,6.92,7.15 "VP9 libvpx Encoding - Speed: Speed 5 - Input: Bosphorus 4K (FPS)",HIB,17.36,17.37,17.46,14.48,14.5,13.9,14.27,15.38,15.11 "VP9 libvpx Encoding - Speed: Speed 0 - Input: Bosphorus 1080p (FPS)",HIB,14.69,14.67,14.76,14.28,13.72,14.08,13.57,13.97,13.68 "VP9 libvpx Encoding - Speed: Speed 5 - Input: Bosphorus 1080p (FPS)",HIB,29.37,29.5,29.46,29.62,29.71,29.54,29.6,29.54,29.66 "VVenC - Video Input: Bosphorus 4K - Video Preset: Fast (FPS)",HIB,5.82,5.809,5.808,5.89,5.895,,,, "VVenC - Video Input: Bosphorus 4K - Video Preset: Faster (FPS)",HIB,12.336,12.391,12.399,12.477,12.31,,,, "VVenC - Video Input: Bosphorus 1080p - Video Preset: Fast (FPS)",HIB,12.44,12.399,12.441,12.357,12.374,,,, "VVenC - Video Input: Bosphorus 1080p - Video Preset: Faster (FPS)",HIB,30.039,29.845,30.081,28.689,28.52,,,, "OpenVKL - Benchmark: vklBenchmark ISPC (Items / Sec)",HIB,1089,1075,1066,1098,1108,1318,1243,1235,1238 "OpenVKL - Benchmark: vklBenchmark Scalar (Items / Sec)",HIB,556,557,549,647,652,764,810,793,781 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,42.9893,42.897,42.7433,97.4442,97.3838,97.0249,96.906,96.9975,96.7169 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,34.8262,35.0962,35.1188,31.9146,29.7544,31.7592,31.7806,31.9277,30.2494 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1566.564,1573.7496,1571.8281,3107.2957,3086.3591,3114.6848,3114.4293,3132.3838,3116.0909 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (items/sec)",HIB,197.1018,196.5414,197.6601,191.2605,175.3199,188.5826,188.4147,189.4054,183.949 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,401.7766,401.2053,400.0427,813.9832,817.6313,817.7536,822.1552,818.6037,816.7562 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (items/sec)",HIB,99.1493,98.6175,98.5922,72.1298,71.8878,77.8827,77.4096,70.1418,75.524 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,440.8533,439.0373,438.4372,941.2443,938.9084,929.0246,927.679,937.992,931.8223 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (items/sec)",HIB,104.1178,104.2908,113.5057,101.0095,100.509,121.9232,119.5964,96.1737,106.6518 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,1009.8486,1012.3494,1013.7357,2204.7533,2203.1573,2230.3099,2245.8036,2253.1411,2255.422 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,188.5378,181.8123,181.7243,166.2725,164.8126,139.0973,136.8324,163.7111,139.8241 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,619.7531,619.9442,625.5512,1291.9733,1292.8038,1306.6677,1306.5839,1305.7137,1301.1811 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,192.8806,193.5305,193.3119,131.7586,155.7357,132.8655,145.1736,135.8907,141.4705 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,149.7446,149.8207,149.6905,308.4294,308.3033,314.6186,314.2452,315.3318,316.0328 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,60.2522,59.9222,60.4884,48.1849,48.9257,47.506,45.9642,48.772,46.7815 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,314.8361,316.2907,316.6282,649.302,647.7596,658.2111,658.341,662.2585,660.2132 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (items/sec)",HIB,87.9631,89.3355,89.547,69.1063,69.3266,73.2924,68.2924,70.3828,66.083 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,42.9581,42.8348,42.9152,97.3996,97.3441,97.2916,97.3528,96.9077,97.8908 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,34.9289,34.8189,34.9937,31.3187,31.07,30.9572,31.0093,29.4163,31.0727 "Zstd Compression - Compression Level: 3 - Compression Speed (MB/s)",HIB,3033.9,3095,3049.4,2804.2,2865.9,2795.1,2513.4,2604.6,2528.7 "Zstd Compression - Compression Level: 3 - Decompression Speed (MB/s)",HIB,1514.8,1516.6,1517.4,1500.4,1511.5,1515.6,1519.1,1516.2,1513.5 "Zstd Compression - Compression Level: 8 - Compression Speed (MB/s)",HIB,1233.8,1239.3,1241.1,1227.5,1234.2,1023.9,1122.4,1005.8,1024.8 "Zstd Compression - Compression Level: 8 - Decompression Speed (MB/s)",HIB,1669.3,1651,1661.9,1669.7,1667.6,1664.3,1671,1664,1664.2 "Zstd Compression - Compression Level: 12 - Compression Speed (MB/s)",HIB,330.8,332,330.1,279.9,278.2,254.1,259.1,249.8,256.2 "Zstd Compression - Compression Level: 12 - Decompression Speed (MB/s)",HIB,1704.8,1716.7,1715.6,1728,1727.8,1723.7,1726.3,1732.3,1731.2 "Zstd Compression - Compression Level: 19 - Compression Speed (MB/s)",HIB,19.1,19.1,19.1,19.8,19.8,18.8,19.5,19.2,19.6 "Zstd Compression - Compression Level: 19 - Decompression Speed (MB/s)",HIB,1472.6,1467.8,1470.5,1483.1,1483.8,1495.2,1483.5,1475.2,1479.1 "Zstd Compression - Compression Level: 3, Long Mode - Compression Speed (MB/s)",HIB,892.7,909.4,916.9,955.6,1032.3,1051.4,1038.9,1046.6,1059 "Zstd Compression - Compression Level: 3, Long Mode - Decompression Speed (MB/s)",HIB,1536.6,1537.5,1540.9,1542.5,1538.8,1539.5,1540.4,1540.9,1543.6 "Zstd Compression - Compression Level: 8, Long Mode - Compression Speed (MB/s)",HIB,938.5,910.8,926.9,859.9,892,853.8,852.7,860.8,879.6 "Zstd Compression - Compression Level: 8, Long Mode - Decompression Speed (MB/s)",HIB,1677.9,1673.7,1675.4,1684.8,1682.8,1682.5,1676.5,1683.7,1677.6 "Zstd Compression - Compression Level: 19, Long Mode - Compression Speed (MB/s)",HIB,9.22,9.29,9.3,9.39,9.76,9.78,9.87,9.82,9.81 "Zstd Compression - Compression Level: 19, Long Mode - Decompression Speed (MB/s)",HIB,1383.7,1378.2,1384,1395.8,1397.6,1393.5,1392.4,1389,1391.7 "GROMACS - Implementation: MPI CPU - Input: water_GMX50_bare (Ns/Day)",HIB,10.569,10.609,10.587,19.175,18.837,18.818,19.015,19.045,19.077 "RocksDB - Test: Random Fill (Op/s)",HIB,533927,534681,536551,478629,468210,423027,417882,416006,415428 "RocksDB - Test: Random Read (Op/s)",HIB,468231434,466888888,468069792,1209611055,1213540299,1225662852,1231168093,1234570512,1231916197 "RocksDB - Test: Update Random (Op/s)",HIB,544384,545556,543572,462018,452228,413199,411513,419985,420514 "RocksDB - Test: Sequential Fill (Op/s)",HIB,542256,545396,544565,465700,464044,414168,413708,414282,414047 "RocksDB - Test: Random Fill Sync (Op/s)",HIB,376601,373002,356922,350673,344040,388052,401295,394852,404463 "RocksDB - Test: Read While Writing (Op/s)",HIB,9296185,8620352,8316379,7643831,7913568,15317250,13830689,13948914,13098097 "RocksDB - Test: Read Random Write Random (Op/s)",HIB,2926458,2891962,2910023,2079804,2063831,1787682,1761416,1613913,1752904 "Memcached - Set To Get Ratio: 1:5 (Ops/sec)",HIB,4143044.21,4162812.47,4155273.46,2444886.82,2460416.33,2520253,2507331.29,2517750.47,2527084.87 "Memcached - Set To Get Ratio: 1:10 (Ops/sec)",HIB,6861088.89,6792746.34,6839975.87,4244908.83,4220522.49,4530948.62,4392934.75,4549313.42,4569476.86 "Memcached - Set To Get Ratio: 1:100 (Ops/sec)",HIB,4878860,4876951.36,4852421.67,3192061.68,3216133.91,4383314.65,4357453.76,4394194.49,4403267.42 "ClickHouse - 100M Rows Hits Dataset, First Run / Cold Cache (Queries/min, Geo Mean)",HIB,600.70,610.79,614.24,635.48,622.73,500.13,516.09,495.85,500.118340751 "ClickHouse - 100M Rows Hits Dataset, Second Run (Queries/min, Geo Mean)",HIB,625.91,627.20,621.88,666.43,649.52,524.04,527.88,524.75,515.11 "ClickHouse - 100M Rows Hits Dataset, Third Run (Queries/min, Geo Mean)",HIB,625.16,628.37,636.18,665.00,662.01,534.82,538.63,530.47,527.80 "oneDNN - Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU (ms)",LIB,2.01581,1.9234,1.88686,2.04003,1.93126,7.60566,7.4227,9.34981,8.26078 "oneDNN - Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU (ms)",LIB,1.56461,1.56257,1.56742,2.19645,2.12379,3.39151,3.49453,3.60194,3.50563 "oneDNN - Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,3.11497,4.27858,4.3972,4.87883,4.79302,11.4326,7.30147,12.013,12.1571 "oneDNN - Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,0.53445,0.513068,0.546991,0.556069,0.629026,0.975357,0.971704,0.99571,0.975091 "oneDNN - Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,8.74576,9.1957,3.83017,6.19257,7.98861,15.421,19.549,18.6594,11.7573 "oneDNN - Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,1.87777,1.72975,1.6386,2.02286,2.02833,3.38833,3.59643,3.36535,2.97427 "oneDNN - Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU (ms)",LIB,0.693367,0.689064,0.692667,0.40359,0.400325,0.538539,0.551783,0.545118,0.63063 "oneDNN - Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU (ms)",LIB,7.35746,7.28243,7.38116,9.25292,9.31751,20.2695,20.572,21.0301,20.9726 "oneDNN - Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU (ms)",LIB,1.17004,1.16696,1.16919,0.664295,0.651301,0.97859,0.973555,0.972863,0.973984 "oneDNN - Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,0.311405,0.312721,0.312289,0.254845,0.255796,0.40743,0.408074,0.394377,0.389223 "oneDNN - Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,0.555277,0.551966,0.556851,0.664359,0.670574,1.20049,1.18135,1.20146,1.2334 "oneDNN - Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,0.304972,0.305731,0.305599,0.160361,0.164845,0.279638,0.291087,0.275917,0.247825 "oneDNN - Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU (ms)",LIB,907.489,903.272,906.139,1148.26,1124.75,1912.16,1890.28,1888.21,1957.77 "oneDNN - Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU (ms)",LIB,674.088,671.654,669.146,930.257,901.044,3187,3034.62,3011.21,3349.36 "oneDNN - Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,911.245,912.114,915.084,1151.25,1119.17,1830.41,1937.65,1926.15,1883.76 "oneDNN - Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,0.415446,0.578466,0.417188,0.291687,0.291229,0.451472,0.450261,0.44782,0.457554 "oneDNN - Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,1.83147,1.84172,1.82264,1.65041,1.70057,2.70807,2.7614,2.70235,2.67303 "oneDNN - Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,0.711588,0.712495,0.708563,0.462386,0.461174,0.672585,0.672768,0.676798,0.680395 "oneDNN - Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,671.69,670.202,671.233,913.201,903.358,3269.05,3249.28,3153.22,3171.15 "oneDNN - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU (ms)",LIB,0.357017,0.356875,0.353175,0.342836,0.347231,0.674455,0.675664,0.676124,0.672115 "oneDNN - Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,909.691,917.077,911.762,1147.34,1139.63,1888.1,1894.07,1925.68,1912.74 "oneDNN - Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,675.915,668.952,667.95,973.318,939.547,3133.65,3222.93,3185.64,3172.19 "oneDNN - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU (ms)",LIB,0.263997,0.263373,0.26292,0.316665,0.293564,0.591738,0.600199,0.593299,0.602831 "oneDNN - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU (ms)",LIB,0.2902,0.291387,0.285432,0.316779,0.340498,0.621776,0.620907,0.634992,0.627133 "OpenVINO - Model: Face Detection FP16 - Device: CPU (ms)",LIB,962.1,962.63,962.15,438.29,438.99,439.41,439.5,437.51,437.68 "OpenVINO - Model: Person Detection FP16 - Device: CPU (ms)",LIB,1671.46,1675.96,1679.03,828.67,830.04,827.07,827.03,821.93,822.5 "OpenVINO - Model: Person Detection FP32 - Device: CPU (ms)",LIB,1701.7,1685.26,1704.02,833.99,834.17,833.15,832.7,826.67,828.01 "OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (ms)",LIB,16.3,15.54,15.1,6.01,6.01,6.02,6.03,5.99,6 "OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (ms)",LIB,499.32,500.83,500.3,229.46,228.01,230.21,230.06,227.93,228.94 "OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (ms)",LIB,8.11,8.13,8.13,3.95,3.95,3.95,3.96,3.93,3.93 "OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (ms)",LIB,9.76,9.75,9.76,4.54,4.54,4.54,4.54,4.52,4.52 "OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (ms)",LIB,88.71,88.61,89.46,45.86,45.73,45.71,45.66,45.31,45.34 "OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (ms)",LIB,10.1,10.1,10.11,9.18,9.18,9.28,9.28,9.25,9.26 "OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (ms)",LIB,8.34,8.38,8.37,4.9,4.91,4.92,4.95,4.9,4.91 "OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (ms)",LIB,0.65,0.66,0.66,0.57,0.58,0.53,0.53,0.53,0.53 "OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (ms)",LIB,1.09,1.09,1.09,1.01,1.01,0.97,0.97,0.96,0.97 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,1115.7602,1118.4383,1122.0584,955.1631,955.2386,972.5163,975.504,971.8988,974.985 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,28.7077,28.4866,28.4687,31.327,33.6012,31.4805,31.4593,31.3146,33.0514 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,30.5924,30.4608,30.4911,30.4213,30.6403,30.7462,30.7508,30.5784,30.7247 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.0715,5.0859,5.0573,5.2262,5.7015,5.3004,5.3053,5.2773,5.4341 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,119.2067,119.3799,119.7026,116.1532,115.6369,117.1233,116.4813,116.9689,117.2219 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,10.0811,10.136,10.1384,13.8559,13.9039,12.8322,12.9106,14.2486,13.2331 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,108.6775,109.1129,109.2467,100.2418,100.4198,103.0888,103.1902,102.0999,102.7646 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (ms/batch)",LIB,9.5962,9.5793,8.8004,9.8899,9.9395,8.1914,8.3506,10.3852,9.3656 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,47.464,47.3532,47.2942,42.805,42.8393,42.9515,42.6536,42.5521,42.4798 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.3018,5.498,5.5007,6.0118,6.065,7.1865,7.3054,6.1057,7.149 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,77.3363,77.305,76.6181,73.1993,73.2087,73.306,73.3496,73.3407,73.6196 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,5.1812,5.1633,5.1696,7.5856,6.4174,7.5225,6.8844,7.355,7.064 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,319.9815,319.9648,320.0504,304.2075,303.7377,303.3272,304.0782,303.2549,301.9192 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,16.5828,16.6745,16.5185,20.7385,20.4223,21.0323,21.7398,20.4884,21.3593 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,152.1377,151.6003,151.3899,145.3548,145.3627,145.3966,145.2745,144.4661,144.9144 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,11.362,11.1872,11.1605,14.4638,14.4178,13.637,14.6356,14.2011,15.126 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,1116.426,1116.2899,1117.7323,956.0088,955.3438,970.2202,969.2122,971.6677,966.7606 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,28.6233,28.7137,28.5698,31.9229,32.1778,32.2956,32.2415,33.9879,32.1758 "Timed FFmpeg Compilation - Time To Compile (sec)",LIB,12.569,12.434,12.465,10.597,10.662,10.381,10.259,10.407,10.373 "Timed Linux Kernel Compilation - Build: defconfig (sec)",LIB,25.768,25.749,25.68,17.606,17.586,17.376,17.017,17.053,17.079 "Timed Linux Kernel Compilation - Build: allmodconfig (sec)",LIB,,,,,,,,,