x265 ffmpeg llama
Intel Xeon Silver 4216 testing with a TYAN S7100AG2NR (V4.02 BIOS) and ASPEED on Debian 12 via the Phoronix Test Suite.


Intel Xeon Silver 4216: 

	Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 6 x 8 GB DDR4-2400MT/s, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350

	OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Display Server: X Server, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768

b: 

	Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 6 x 8 GB DDR4-2400MT/s, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350

	OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Display Server: X Server, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768

c: 

	Processor: Intel Xeon Silver 4216 @ 3.20GHz (16 Cores / 32 Threads), Motherboard: TYAN S7100AG2NR (V4.02 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 6 x 8 GB DDR4-2400MT/s, Disk: 240GB Corsair Force MP500, Graphics: ASPEED, Audio: Realtek ALC892, Network: 2 x Intel I350

	OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Display Server: X Server, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768


FFmpeg 7.0
Encoder: libx264 - Scenario: Live
FPS > Higher Is Better
Intel Xeon Silver 4216 . 128.96 |==============================================
b ...................... 128.48 |==============================================
c ...................... 129.70 |==============================================


FFmpeg 7.0
Encoder: libx265 - Scenario: Live
FPS > Higher Is Better
Intel Xeon Silver 4216 . 37.71 |===============================================
b ...................... 37.59 |===============================================
c ...................... 37.56 |===============================================


FFmpeg 7.0
Encoder: libx264 - Scenario: Upload
FPS > Higher Is Better
Intel Xeon Silver 4216 . 8.58 |================================================
b ...................... 8.57 |================================================
c ...................... 8.57 |================================================


FFmpeg 7.0
Encoder: libx265 - Scenario: Upload
FPS > Higher Is Better
Intel Xeon Silver 4216 . 9.25 |===============================================
b ...................... 9.21 |===============================================
c ...................... 9.36 |================================================


FFmpeg 7.0
Encoder: libx264 - Scenario: Platform
FPS > Higher Is Better
Intel Xeon Silver 4216 . 31.98 |===============================================
b ...................... 31.93 |===============================================
c ...................... 32.01 |===============================================


FFmpeg 7.0
Encoder: libx265 - Scenario: Platform
FPS > Higher Is Better
Intel Xeon Silver 4216 . 18.09 |===============================================
b ...................... 18.21 |===============================================
c ...................... 18.10 |===============================================


FFmpeg 7.0
Encoder: libx264 - Scenario: Video On Demand
FPS > Higher Is Better
Intel Xeon Silver 4216 . 32.01 |===============================================
b ...................... 31.94 |===============================================
c ...................... 31.94 |===============================================


FFmpeg 7.0
Encoder: libx265 - Scenario: Video On Demand
FPS > Higher Is Better
Intel Xeon Silver 4216 . 18.09 |===============================================
b ...................... 18.07 |===============================================
c ...................... 18.16 |===============================================


x265 3.6
Video Input: Bosphorus 4K
Frames Per Second > Higher Is Better
Intel Xeon Silver 4216 . 14.54 |==============================================
b ...................... 14.72 |==============================================
c ...................... 14.96 |===============================================


x265 3.6
Video Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
Intel Xeon Silver 4216 . 33.83 |===============================================
b ...................... 34.08 |===============================================
c ...................... 33.69 |==============================================


Timed FFmpeg Compilation 7.0
Time To Compile
Seconds < Lower Is Better
Intel Xeon Silver 4216 . 70.88 |===============================================
b ...................... 71.39 |===============================================
c ...................... 70.95 |===============================================


Llamafile 0.7
Test: llava-v1.5-7b-q4 - Acceleration: CPU
Tokens Per Second > Higher Is Better
Intel Xeon Silver 4216 . 12.79 |==============================================
b ...................... 12.94 |===============================================
c ...................... 12.73 |==============================================


Llamafile 0.7
Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU
Tokens Per Second > Higher Is Better
Intel Xeon Silver 4216 . 10.05 |==============================================
b ...................... 10.21 |===============================================
c ...................... 10.03 |==============================================


Llamafile 0.7
Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU
Tokens Per Second > Higher Is Better
Intel Xeon Silver 4216 . 2.82 |================================================
b ...................... 2.81 |================================================
c ...................... 2.82 |================================================