Minisforum MS-01

mini PC spreadsheet
https://docs.google.com/spreadsheets/d/1d1zfG17iT3XK_DY2S0PADf98Vgnzz8yd3O9myNA8i6g/edit?pli=1&gid=0#gid=0

Network

Minisforum MS-01 network

Before configuring cluster network, I bough two cables and tested them between two identical Macbook Air M1 Thunderbolt 3 speed.
Now I know cables and my macbooks together are capable of over 21 Gbps speed.

BIOS update

DL URL https://www.minisforum.cn/new/support?lang=en#/support/page/download/108

https://www.minisforum.com/new/support?lang=en#/support/page/download/108
https://www.virtualizationhowto.com/2024/09/how-to-upgrade-the-minisforum-ms-01-bios/

Some instability on Proxmox?
Related to BIOS, microcode and/or hardware? BIOS upgrade via UEFI, noWindows necessary https://forums.servethehome.com/index.php?threads/minisforum-ms-01-bios-update-on-linux.45079/
https://forums.servethehome.com/index.php?threads/minisforum-ms-01-bios.43328/page-5#post-445485

yep - make sure the CPU microcode is fully up todate (there’s a non-free enterprise firmware repository that can be enabled for this).

Otherwse you could run into issues due to the performance/efficiency core mix which seems to play havoc with hypervisors.

There’s a couple of craft computing videos on on youtube on the subject (the first is on the MS01, the second doesnn’t have a blindingly obvious name but is linked in the description of the first).
https://old.reddit.com/r/homelab/comments/1cg6zfm/ms01_gonna_run_proxmox/

BIOS upgrade

Unzip file to root of FAT32 format disk.
Disable “secure boot” in BIOS
Boot into U disk, with uefi shell(F7 to choose boot disk)
Use “FS1:” “FS2:” to find your BIOS udisk. (you can use command “ls” to check files exists)
Run AfuEfiFlash.nsh
source: https://forums.servethehome.com/index.php?threads/minisforum-ms-01-pcie-card-and-ram-compatibility-thread.42785/post-436955
source: https://github.com/linucksrox/proxmox-cluster/blob/main/ms-01-setup.md

https://forum.proxmox.com/threads/proxmox-install-on-minisforum-ms-01.154110/

Copy shell to USB to be able to run UEFI shell from BIOS, best post about BIOS upgrade
https://forums.servethehome.com/index.php?threads/minisforum-ms-01-bios.43328/post-445485

I used my USB drive with unraid to store BIOS upgrade files

? Alt+F5 power user mode?

Test host stability

Misc

Setup
https://github.com/linucksrox/proxmox-cluster/blob/main/ms-01-setup.md
https://gist.github.com/scyto/76e94832927a89d977ea989da157e9dc
https://github.com/amanusk/s-tui
Setup - update BIOS
Setup disk - update firmware for Samsung 990 Pro

Intel Gen 12th Iris Xe vGPU on Proxmox
SR-IOV virtualization, creating up to 7 vGPU instances
https://old.reddit.com/r/Proxmox/comments/1ayer8w/intel_gen_12th_iris_xe_vgpu_on_proxmox/
https://spaceterran.com/posts/igpu-vgpu-passthrough-on-ms-01-proxmox-ubuntu-plex-docker-transcoding/

GPU passthrough
https://forum.proxmox.com/threads/ms-01-i9-13900h-xe-igpu-full-passthrouh.146487/
https://forum.level1techs.com/t/i915-sr-iov-on-i9-13900h-minisforum-ms-01-proxmox-pve-kernel-6-5-jellyfin-full-hardware-accelerated-lxc/209943

Opinions, seems like a lot of people want it for homelab with Proxmox
https://old.reddit.com/r/homelab/comments/1bnuqbn/thinking_about_proxmox_ha_w_ceph_on_a_minisforum/

Network problems, probably something easy to fix, related to AMT
https://forum.proxmox.com/threads/minisforum-ms-01-problems-installing-proxmox-8-2.149973/

Enabling vPro / AMT (look at comments)
https://spaceterran.com/posts/step-by-step-guide-enabling-intel-vpro-on-your-minisforum-ms-01-bios/

BIOS / UEFI via vPro onmacOS - use Fn + Backspace during boot to send Delete key
It works via MeshCentral
https://meshcentral.com/downloads.html

Network
During Debian → Proxmox conversion, after reboot network card SFP+ changes name

Support experience

I opened support page for MS-01 and warranty terms tab didn’t inspire confidence :D
https://www.minisforum.com/new/support?lang=en#/support/page/terms/108

Max out hardware

RAM 96GB

Crucial CT48G56C46S5 I use it and it’s great! Few days and no stability issues.
- https://forums.servethehome.com/index.php?threads/minisforum-ms-01-pcie-card-and-ram-compatibility-thread.42785/
Crucial CT2K48G56C46S5
- https://old.reddit.com/r/MiniPCs/comments/1cdx0pr/96gb_ddr5_ram_kit_for_ms01/

You can use 96GB RAM max and GPU with 20GB VRAM.
3x NVMe drives

Use wifi card slot for disk
https://forums.servethehome.com/index.php?threads/minisforum-ms-01-pcie-card-and-ram-compatibility-thread.42785/post-446681
https://forums.servethehome.com/index.php?threads/minisforum-ms-01-pcie-card-and-ram-compatibility-thread.42785/post-436778

Storage

For ZFS Samsung 990 Pro 4 TB should be ok.
For Ceph it needs datacenter SSDs, please don’t use consumer disks.

JBOD for external HDDs
https://www.servethehome.com/qnap-tl-d400s-review-4-bay-sata-jbod-das-enclosure/

Power usage

With 2x48GB DDR5, connected 1x2.5G, 1xSFP+ (Mikrotik DAC), 1xNVME Samsung 990 Pro 4TB
I got around 17,8 - 19,8W on idle Proxmox connected to cluster.
This includes ASPM Auto on all options and Wifi Off.

During about 24h of almost all workload moved from 3 other mini PCs looked like this

WIP: Let’s see how switching Advanced → CPU Configuration → Boot performance mode will affect power usage.
I switched from Turbo Performance to Max Non-Turbo Performance.

After switching it, on idle Proxmox without running VMs
22,4 - 24,6W.
I disconnected from KVM remote session and it dropped to 18,4 - 21,5W so similar to previous setting.

CPU frequency scaling

apt-get install linux-cpupower
cpupower frequency-info

analyzing CPU 0:
  driver: intel_pstate
  CPUs which run at the same hardware frequency: 0
  CPUs which need to have their frequency coordinated by software: 0
  maximum transition latency:  Cannot determine or is not supported.
  hardware limits: 400 MHz - 4.90 GHz
  available cpufreq governors: performance powersave
  current policy: frequency should be within 400 MHz and 4.90 GHz.
                  The governor "performance" may decide which speed to use
                  within this range.
  current CPU frequency: Unable to call hardware
  current CPU frequency: 400 MHz (asserted by call to kernel)
  boost state support:
    Supported: yes
    Active: yes

cpupower frequency-set -g powersave
cpupower frequency-info

analyzing CPU 0:
  driver: intel_pstate
  CPUs which run at the same hardware frequency: 0
  CPUs which need to have their frequency coordinated by software: 0
  maximum transition latency:  Cannot determine or is not supported.
  hardware limits: 400 MHz - 4.90 GHz
  available cpufreq governors: performance powersave
  current policy: frequency should be within 400 MHz and 4.90 GHz.
                  The governor "powersave" may decide which speed to use
                  within this range.
  current CPU frequency: Unable to call hardware
  current CPU frequency: 975 MHz (asserted by call to kernel)
  boost state support:
    Supported: yes
    Active: yes

I switched frequency scaling from performance to powersave but it doesn’t seem to have much difference on still idle without VMs 17,8W. Probably difference will be noticeable with workload, should be less peak-y.

Ok so after 12am workload returned to normal.
Peak usage seems the same but most of time spent is in much lower power state it seems.

TODO check

cpupower idle-info
powertop
 
apt-get install cpufrequtils
cpufreq-info
 
cat /sys/devices/system/cpu/cpu0/cpufreq/

GPU

Nvidia RTX A2000 SFF and Nvidia RTX A4000 SFF are compatible.
You just need custom 1 slot cooling and more powerful PSU it recommended.

Nvidia RTX A2000 SFF

A2000 can be inserted without closing fan if you remove fan and then mount fan after inserting card
https://forums.servethehome.com/index.php?threads/minisforum-ms-01-pcie-card-and-ram-compatibility-thread.42785/post-412802

Nvidia RTX A4000 SFF

Example 240W PSU https://www.amazon.com/dp/B0CQYL186K

How it works, video: https://www.youtube.com/watch?v=keAFTWkGX0Q

Cost

PC

Most sensible version is with Intel Core i9-12900H. Better deal than i9-13900H and it skips raptor lake fiasco.
Barebone costs around 589 EUR - 2024.10.23

https://store.minisforum.de/en/products/ms-01?variant=42097212489911

plus RAM 2x32GB = 2x 389 PLN = 778 PLN
https://allegro.pl/produkt/kingston-fury-32gb-1x32gb-4800mhz-ddr5-cl38-sodimm-91130a40-5975-4e81-81b9-a5cea85f08dd?

disk around 500 PLN

So PC + RAM + disk
2550 + 778 + 500 = 3828 PLN

A2000

open chassis with Nvidia RTX A2000 SFF 12 GB VRAM
3828 + 2500 = 6328 PLN

with custom cooler
6328 + 350 = 6678 PLN

A4000

open chassis with Nvidia RTX A4000 SFF
3828 + 5600 = 9428 PLN

with custom cooler
9428 + 350 = 9778 PLN

Almost 10k for proper high performance, closed chassis setup.
This doesn’t include a lot of tinkering and GPU warranty voiding!

Rack mount

TODO find some 3d models

https://www.amazon.de/-/en/Rackmunt-MiniSforum-Injection-Molded-Printed/dp/B0DHRXX8XP
https://www.amazon.de/-/en/Rack-Mount-MiniSforum-MS-01-Dual/dp/B0DL4C9KH3

📝 SystemZ's notes

Explorer

Recent Notes

Blurry games

COOP games

Chivalry 2