Intel Core i7-12700H + NVIDIA GeForce RTX 3070 Ti Laptop GPU 8GB + System76 Oryx Pro (2023-09-08_42bf7a6 BIOS)

Various open-source benchmarks by the Phoronix Test Suite v10.8.5.

HTML result view exported from: https://openbenchmarking.org/result/2405165-NE-INTELCORE53&grt.

Intel Core i7-12700H + NVIDIA GeForce RTX 3070 Ti Laptop GPU 8GB + System76 Oryx Pro (2023-09-08_42bf7a6 BIOS)ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverCompilerFile-SystemScreen ResolutionNVIDIA GeForce RTX 3070 Ti Laptop GPUIntel Core i7-12700H @ 4.60GHz (14 Cores / 20 Threads)System76 Oryx Pro (2023-09-08_42bf7a6 BIOS)Intel Alder Lake PCH2 x 16GB DDR4-3200MT/s Crucial2 x Samsung SSD 980 PRO 500GBNVIDIA GeForce RTX 3070 Ti Laptop GPU 8GBRealtek ALC1220Realtek RTL8111/8168/8411 + Intel Alder Lake-P PCH CNVi WiFiPop 22.046.8.0-76060800daily20240311-generic (x86_64)GNOME Shell 42.9X Server 1.21.1.4NVIDIA 550.67GCC 11.4.0ext41920x1080OpenBenchmarking.org- Transparent Huge Pages: madvise- Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x430 - Thermald 2.4.9- BAR1 / Visible vRAM Size: 8192 MiB - vBIOS Version: 94.04.81.00.13- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Intel Core i7-12700H + NVIDIA GeForce RTX 3070 Ti Laptop GPU 8GB + System76 Oryx Pro (2023-09-08_42bf7a6 BIOS)llamafile: mistral-7b-instruct-v0.2.Q8_0 - CPUllamafile: mistral-7b-instruct-v0.2.Q8_0 - GPU AUTOunigine-heaven: 800 x 600 - Windowed - OpenGLunigine-heaven: 800 x 600 - Fullscreen - OpenGLNVIDIA GeForce RTX 3070 Ti Laptop GPU5.265.09392.119193.661OpenBenchmarking.org

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPUNVIDIA GeForce RTX 3070 Ti Laptop GPU1.18352.3673.55054.7345.9175SE +/- 0.01, N = 35.26

Llamafile

Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: GPU AUTO

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.7Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: GPU AUTONVIDIA GeForce RTX 3070 Ti Laptop GPU1.14532.29063.43594.58125.7265SE +/- 0.08, N = 125.09

Unigine Heaven

Resolution: 800 x 600 - Mode: Windowed - Renderer: OpenGL

OpenBenchmarking.orgFrames Per Second, More Is BetterUnigine Heaven 4.0Resolution: 800 x 600 - Mode: Windowed - Renderer: OpenGLNVIDIA GeForce RTX 3070 Ti Laptop GPU90180270360450SE +/- 3.17, N = 3392.12

Unigine Heaven

Resolution: 800 x 600 - Mode: Fullscreen - Renderer: OpenGL

OpenBenchmarking.orgFrames Per Second, More Is BetterUnigine Heaven 4.0Resolution: 800 x 600 - Mode: Fullscreen - Renderer: OpenGLNVIDIA GeForce RTX 3070 Ti Laptop GPU4080120160200SE +/- 0.27, N = 3193.66

Phoronix Test Suite v10.8.5