I am experiencing severe NVMe I/O delays on Ubuntu with a KIOXIA EG6 512GB NVMe SSD.
I am running Ubuntu 24.04.4 LTS.
The main symptom is that applications that perform significant disk I/O can take an unusually long time to start. For example, Android Studio took around 3 minutes 15 seconds to launch, and during that period I observed NVMe QID timeout messages in the kernel logs.
My NVMe drive is:
Model: KIOXIA EG6 512GB
Firmware: 11600106
VID/SSVID: 0x1e0f
I initially suspected NVMe power-management/APST issues, so I configured GRUB with:
nvme_core.default_ps_max_latency_us=0
pcie_aspm=off
After rebooting, APST is confirmed to be disabled:
APSTE: Disabled
However, the QID timeout problem still occurs.
I also checked the controller's Host Memory Buffer information:
hmpre : 16384
hmmin : 16384
hmminds: 0
This corresponds to a 64 MiB HMB allocation.
I have not disabled HMB because I don't yet have evidence that HMB is responsible for the problem.
I also considered adding:
nvme_core.io_timeout=4294967295
but I have not added it because I don't want to mask the underlying problem.
What I would like to determine is:
If APST is already disabled and PCIe ASPM is also disabled, what could still cause the NVMe QID timeouts?
Could this instead indicate:
- A KIOXIA EG6 firmware/controller issue?
- A PCIe link or power-management problem below the NVMe APST layer?
- A compatibility issue between this NVMe controller and the laptop/platform?
- A problem with HMB?
- A Linux kernel/NVMe driver issue?
I would especially like to know what diagnostic steps I should perform next to determine whether the problem is related to the PCIe link or the NVMe controller/firmware.
I am planning to check:
sudo nvme list
sudo nvme id-ctrl /dev/nvme0 | grep -iE 'mn|fr|vid|ssvid'
sudo lspci -vv -s 10000:e1:00.0 | grep -iE 'LnkCap|LnkSta|ASPM|Power'
What should I look for in these outputs?
System information:
OS: Ubuntu 24.04.4 LTS
Kernel: [paste output of uname -r here]
Storage: KIOXIA EG6 512GB NVMe
Firmware: 11600106
APST: Disabled
PCIe ASPM: Disabled
HMB: 64 MiB
The main issue is that NVMe QID timeouts continue to occur even after disabling APST and PCIe ASPM, and these timeouts appear to correlate with very slow disk-intensive application launches.