Motherboard model: PRIME X470-PRO
UEFI Version: 5204
CPU: Ryzen 2700X
Memory kit part number (s) and amount in GB: G-Skill F4-3200C16-8GVGB x 4 = 32 GB
GPU: EVGA GTX 980
SSD/HDDs/Optical drives: Samsung 970 EVO plus 1TB
PSU: EVGA Supernova G2 850W
USB Devices (model/version number):
Monitor: AOC G2460P
CPU Cooler: AMD Wraith Prism
PC CASE:
Operating system: Debian 10
Drivers Installed (include version): Linux 4.19.37-5+deb10u1
Any third Party temp/voltage software installed:
System Overclocked (provide details)? Using DOCP to run RAM at 3200 MHz
Issue
Hello first time poster here. I just upgraded from an ASUS Z97-AR with Core i5 4590 to the above mentioned hardware. After upgrading I can no longer use IOMMU/AMD-Vi to pass my GPU through to virtual machines with vfio.
When I start a VM that has the GPU assigned to it the display attached to the GPU does not power on as before. When this happens I get this error in my logs (more log messages below):
Aug 03 23:37:42 hill kernel: vfio-pci 0000:0a:00.1: Refused to change power state, currently in D3
I'm posting to the forum because from what I've read elsewhere it seems that others using my motherboard (and indeed other X470 users) are having the same problem, and it started after an AGESA update. I would like to know if there are any plans to fix the issue.
Needless to say I'm disappointed with my upgrade so far.
Relevant log entries:
Aug 03 21:01:03 hill kernel: AMD-Vi: IOMMU performance counters supported
Aug 03 21:01:03 hill kernel: iommu: Adding device 0000:0a:00.0 to group 17
Aug 03 21:01:03 hill kernel: AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40
Aug 03 21:01:03 hill kernel: AMD-Vi: Extended features (0xf77ef22294ada):
Aug 03 21:01:03 hill kernel: PPR NX GT IA GA PC GA_vAPIC
Aug 03 21:01:03 hill kernel: AMD-Vi: Interrupt remapping enabled
Aug 03 21:01:03 hill kernel: AMD-Vi: virtual APIC enabled
Aug 03 21:01:03 hill kernel: AMD-Vi: Lazy IO/TLB flushing enabled
Aug 03 23:40:13 hill kernel: vfio-pci 0000:0a:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none
Aug 03 23:40:13 hill kernel: vfio_pci: add [10de:13c0[ffff:ffff]] class 0x000000/00000000
Aug 03 23:40:13 hill kernel: vfio_pci: add [10de:0fbb[ffff:ffff]] class 0x000000/00000000
Aug 03 23:36:24 hill kernel: vfio-pci 0000:0a:00.0: enabling device (0000 -> 0003)
Aug 03 23:36:24 hill kernel: vfio_ecap_init: 0000:0a:00.0 hiding ecap 0x1e@0x258
Aug 03 23:36:24 hill kernel: vfio_ecap_init: 0000:0a:00.0 hiding ecap 0x19@0x900
Aug 03 23:36:24 hill kernel: vfio-pci 0000:0a:00.1: enabling device (0000 -> 0002)
Aug 03 23:36:26 hill kernel: vfio_bar_restore: 0000:0a:00.1 reset recovery - restoring bars
Aug 03 23:36:26 hill kernel: vfio_bar_restore: 0000:0a:00.0 reset recovery - restoring bars
Aug 03 23:36:27 hill kernel: vfio_bar_restore: 0000:0a:00.0 reset recovery - restoring bars
Aug 03 23:36:27 hill kernel: vfio_bar_restore: 0000:0a:00.1 reset recovery - restoring bars
…
Aug 03 23:37:42 hill kernel: vfio-pci 0000:0a:00.1: Refused to change power state, currently in D3
Aug 03 23:37:43 hill libvirtd[945]: internal error: Unknown PCI header type '127'
Aug 03 23:37:43 hill libvirtd[945]: Failed to reset PCI device: internal error: Unknown PCI header type '127'
Aug 03 23:37:43 hill libvirtd[945]: internal error: Unknown PCI header type '127'
Aug 03 23:37:43 hill libvirtd[945]: Failed to reset PCI device: internal error: Unknown PCI header type '127'
