I am new to pci passthrough, and this project was inspired by this: youtube link
I also followed along this link: PCI Passthrough guide
I am using a ryzen 3950x with x570. Posted system info below. From what I gathered, I have managed to capture my rtx 2080 that im trying to send to my win10 VM, and I am using my gtx 1080 as the system gpu. I had issues which seems to be common among multiple nvidia gpu with monitors setups, but i solved this by just using the 430xx nvidia drivers.So now when I boot manjaro the two monitors connected to my 2080 are blank, and I am currently using the one connected to my 1080. Now my problem is that I seem to have successfully captured the 2080 for passthrough, however when I try to launch my VM it makes both of my displays connected to it light up, but only with a blank screen. I then used spice to atleast install windows, and made an attempt at installing drivers, but it doesn't seem like windows in the VM even recognizes that it has a 2080, only that it has a PCI device.
I have seen another method than the one I have been using, but it didn't seem like the guide I needed, since once following the steps to where I would previously boot up to only my 1080 working, it would now boot up as "normal" with my 2080 still being usable by manjaro. If I am mistaken in this, and the method has changed a bit since I started the project, please let me know to just follow these guides to a tee. Guide
System: Kernel: 5.4.43-1-MANJARO x86_64 bits: 64 compiler: gcc v: 10.1.0 Console: tty 2
wm: kwin_x11 dm: SDDM Distro: Manjaro Linux
Machine: Type: Desktop Mobo: ASUSTeK model: ROG STRIX X570-E GAMING v: Rev X.0x serial: <filter>
UEFI: American Megatrends v: 1408 date: 04/01/2020
Memory: RAM: total: 31.28 GiB used: 3.30 GiB (10.6%)
Array-1: capacity: 128 GiB slots: 4 EC: None max module size: 32 GiB note: est.
Device-1: DIMM_A1 size: 8 GiB speed: 3200 MT/s type: DDR4
detail: synchronous unbuffered (unregistered) bus width: 64 bits total: 64 bits
manufacturer: Corsair part-no: CMW16GX4M2C3000C15 serial: N/A
Device-2: DIMM_A2 size: 8 GiB speed: 3200 MT/s type: DDR4
detail: synchronous unbuffered (unregistered) bus width: 64 bits total: 64 bits
manufacturer: Corsair part-no: CMW16GX4M2C3000C15 serial: N/A
Device-3: DIMM_B1 size: 8 GiB speed: 3200 MT/s type: DDR4
detail: synchronous unbuffered (unregistered) bus width: 64 bits total: 64 bits
manufacturer: Corsair part-no: CMW16GX4M2C3000C15 serial: N/A
Device-4: DIMM_B2 size: 8 GiB speed: 3200 MT/s type: DDR4
detail: synchronous unbuffered (unregistered) bus width: 64 bits total: 64 bits
manufacturer: Corsair part-no: CMW16GX4M2C3000C15 serial: N/A
CPU: Topology: 16-Core (2-Die) model: AMD Ryzen 9 3950X bits: 64 type: MT MCP MCM arch: Zen
L1 cache: 1024 KiB L2 cache: 8192 KiB L3 cache: 64.0 MiB bogomips: 223652
Speed: 3593 MHz min/max: 2200/3500 MHz boost: enabled Core speeds (MHz): 1: 3594
2: 2052 3: 2196 4: 2191 5: 2195 6: 2194 7: 2195 8: 2195 9: 3588 10: 2008 11: 2050
12: 3593 13: 2053 14: 2193 15: 2192 16: 2194 17: 2196 18: 2193 19: 2191 20: 2192
21: 2189 22: 2189 23: 2190 24: 4046 25: 2192 26: 2191 27: 2195 28: 2195 29: 2196
30: 2193 31: 2193 32: 2196
Flags: 3dnowprefetch abm adx aes aperfmperf apic arat avic avx avx2 bmi1 bmi2 bpext
cat_l3 cdp_l3 clflush clflushopt clwb clzero cmov cmp_legacy constant_tsc cpb cpuid cqm
cqm_llc cqm_mbm_local cqm_mbm_total cqm_occup_llc cr8_legacy cx16 cx8 de decodeassists
extapic extd_apicid f16c flushbyasid fma fpu fsgsbase fxsr fxsr_opt ht hw_pstate ibpb
ibs irperf lahf_lm lbrv lm mba mca mce misalignsse mmx mmxext monitor movbe msr mtrr
mwaitx nonstop_tsc nopl npt nrip_save nx osvw overflow_recov pae pat pausefilter
pclmulqdq pdpe1gb perfctr_core perfctr_llc perfctr_nb pfthreshold pge pni popcnt pse
pse36 rdpid rdrand rdseed rdt_a rdtscp rep_good sep sev sha_ni skinit smap smca sme
smep ssbd sse sse2 sse4_1 sse4_2 sse4a ssse3 stibp succor svm svm_lock syscall tce
topoext tsc tsc_scale umip v_vmsave_vmload vgif vmcb_clean vme vmmcall wbnoinvd wdt
xgetbv1 xsave xsavec xsaveerptr xsaveopt xsaves
Graphics: Device-1: NVIDIA TU104 [GeForce RTX 2080 Rev. A] vendor: ZOTAC driver: vfio-pci v: 0.2
bus ID: 0b:00.0 chip ID: 10de:1e87
Device-2: NVIDIA GP104 [GeForce GTX 1080] vendor: ZOTAC driver: nvidia v: 430.64
bus ID: 0c:00.0 chip ID: 10de:1b80
Display: server: X.Org 1.20.8 driver: nvidia compositor: kwin_x11 tty: N/A
OpenGL: renderer: GeForce GTX 1080/PCIe/SSE2 v: 4.6.0 NVIDIA 430.64 direct render: Yes
Audio: Device-1: NVIDIA TU104 HD Audio vendor: ZOTAC driver: vfio-pci v: 0.2 bus ID: 0b:00.1
chip ID: 10de:10f8
Device-2: NVIDIA GP104 High Definition Audio vendor: ZOTAC driver: snd_hda_intel
v: kernel bus ID: 0c:00.1 chip ID: 10de:10f0
Device-3: AMD Starship/Matisse HD Audio vendor: ASUSTeK driver: snd_hda_intel v: kernel
bus ID: 0e:00.4 chip ID: 1022:1487
Device-4: Logitech HD Pro Webcam C920 type: USB driver: snd-usb-audio,uvcvideo
bus ID: 1-4.2:9 chip ID: 046d:082d serial: <filter>
Device-5: SteelSeries ApS type: USB driver: hid-generic,snd-usb-audio,usbhid
bus ID: 1-1.3:6 chip ID: 1038:1294
Device-6: Valve type: USB driver: cdc_acm,hid-generic,usbhid bus ID: 1-3.3.3:13
chip ID: 28de:2102 serial: <filter>
Device-7: Valve type: USB driver: hid-generic,snd-usb-audio,usbhid
Sound Server: ALSA v: k5.4.43-1-MANJARO
Network: Device-1: Intel Wi-Fi 6 AX200 driver: iwlwifi v: kernel bus ID: 05:00.0
chip ID: 8086:2723
IF: wlp5s0 state: down mac: <filter>
Device-2: Realtek RTL8125 2.5GbE vendor: ASUSTeK driver: r8169 v: kernel port: d000
bus ID: 06:00.0 chip ID: 10ec:8125
IF: enp6s0 state: up speed: 1000 Mbps duplex: full mac: <filter>
IP v4: <filter> type: dynamic noprefixroute scope: global broadcast: <filter>
IP v6: <filter> type: dynamic noprefixroute scope: global
IP v6: <filter> type: noprefixroute scope: link
Device-3: Intel I211 Gigabit Network vendor: ASUSTeK driver: igb v: 5.6.0-k port: c000
bus ID: 07:00.0 chip ID: 8086:1539
IF: enp7s0 state: up speed: 100 Mbps duplex: full mac: <filter>
IF-ID-1: virbr0 state: down mac: <filter>
IP v4: <filter> scope: global broadcast: <filter>
IF-ID-2: virbr0-nic state: down mac: <filter>
WAN IP: <filter>
Drives: Local Storage: total: 3.18 TiB used: 927.93 GiB (28.5%)
ID-1: /dev/nvme0n1 vendor: Corsair model: Force MP600 size: 931.51 GiB speed: 63.2 Gb/s
lanes: 4 serial: <filter> rev: EGFM11.3 scheme: GPT
ID-2: /dev/nvme1n1 vendor: Samsung model: SSD 960 EVO 250GB size: 232.89 GiB
speed: 31.6 Gb/s lanes: 4 serial: <filter> rev: 3B7QCXE7 scheme: GPT
ID-3: /dev/sda vendor: Samsung model: SSD 850 EVO 250GB size: 232.89 GiB
speed: 6.0 Gb/s serial: <filter> rev: 2B6Q scheme: MBR
ID-4: /dev/sdb vendor: Samsung model: SSD 850 EVO 250GB size: 232.89 GiB
speed: 6.0 Gb/s serial: <filter> rev: 1B6Q scheme: GPT
ID-5: /dev/sdc vendor: Western Digital model: WD1002FAEX-00Z3A0 size: 931.51 GiB
speed: 6.0 Gb/s serial: <filter> rev: 1D05 scheme: GPT
ID-6: /dev/sdd vendor: Western Digital model: WD10EADS-00L5B1 size: 931.51 GiB
speed: 3.0 Gb/s serial: <filter> rev: 1A01 scheme: MBR
Message: No Optical or Floppy data was found.
RAID: Message: No RAID data was found.
Partition: ID-1: / size: 219.28 GiB used: 17.71 GiB (8.1%) fs: ext4 dev: /dev/nvme1n1p2 label: N/A
uuid: 6d38f41a-8af5-46b3-b6e6-58368a2e4762
ID-2: /boot/efi size: 299.4 MiB used: 280 KiB (0.1%) fs: vfat dev: /dev/nvme1n1p1
label: N/A uuid: 9402-977B
ID-3: /run/media/matrucious/VM size: 915.89 GiB used: 910.21 GiB (99.4%) fs: ext4
dev: /dev/nvme0n1p1 label: VM uuid: d0374de9-2171-4d35-99f3-061967a1045d
ID-4: swap-1 size: 8.80 GiB used: 0 KiB (0.0%) fs: swap dev: /dev/nvme1n1p3 label: N/A
uuid: 8533fc31-7599-451c-93eb-0ed6c0bc4777
Unmounted: ID-1: /dev/sdc1 size: 931.51 GiB fs: ntfs label: Data uuid: 0058B1C858B1BCAA
ID-2: /dev/sdd1 size: 931.51 GiB fs: ntfs label: Backup uuid: 7AAA0C7BAA0C3663
USB: Hub: 1-0:1 info: Full speed (or root) Hub ports: 6 rev: 2.0 speed: 480 Mb/s
chip ID: 1d6b:0002
Hub: 1-1:2 info: Texas Instruments TUSB2036 Hub ports: 3 rev: 1.1 speed: 12 Mb/s
chip ID: 0451:2036
Device-1: 1-1.2:4 info: SteelSeries ApS type: HID driver: hid-generic,usbhid
interfaces: 2 rev: 2.0 speed: 12 Mb/s chip ID: 1038:1290
Device-2: 1-1.3:6 info: SteelSeries ApS type: Audio,HID
driver: hid-generic,snd-usb-audio,usbhid interfaces: 6 rev: 1.1 speed: 12 Mb/s
chip ID: 1038:1294
Hub: 1-3:3 info: Valve ports: 3 rev: 2.0 speed: 480 Mb/s chip ID: 28de:2613
Hub: 1-3.3:7 info: Microchip (formerly SMSC) Hub ports: 5 rev: 2.1 speed: 480 Mb/s
chip ID: 0424:2744
Device-3: 1-3.3.1:10 info: Valve General Purpose USB Hub type: HID
driver: hid-generic,usbhid interfaces: 3 rev: 2.0 speed: 12 Mb/s chip ID: 28de:2300
serial: <filter>
Device-4: 1-3.3.2:12 info: Valve type: HID,Abstract (modem),CDC-Data
driver: cdc_acm,hid-generic,usbhid interfaces: 3 rev: 2.0 speed: 12 Mb/s
chip ID: 28de:2102 serial: <filter>
Device-5: 1-3.3.3:13 info: Valve type: HID,Audio
driver: hid-generic,snd-usb-audio,usbhid interfaces: 3 rev: 2.0 speed: 12 Mb/s
chip ID: 28de:2102 serial: <filter>
Device-6: 1-3.3.5:14 info: Microchip (formerly SMSC) USB2.0 Hub type: <vendor specific>
driver: N/A interfaces: 1 rev: 2.0 speed: 480 Mb/s chip ID: 0424:2740
Hub: 1-4:5 info: Genesys Logic 4-port hub ports: 4 rev: 2.0 speed: 480 Mb/s
chip ID: 05e3:0610
Device-7: 1-4.2:9 info: Logitech HD Pro Webcam C920 type: Video,Audio
driver: snd-usb-audio,uvcvideo interfaces: 4 rev: 2.0 speed: 480 Mb/s
chip ID: 046d:082d serial: <filter>
Device-8: 1-4.3:15 info: Micro Star type: HID driver: hid-generic,usbhid interfaces: 1
rev: 1.1 speed: 12 Mb/s chip ID: 1462:3fa4 serial: <filter>
Hub: 1-5:8 info: Genesys Logic 4-port hub ports: 4 rev: 2.0 speed: 480 Mb/s
chip ID: 05e3:0610
Device-9: 1-6:11 info: Intel type: Bluetooth driver: btusb interfaces: 2 rev: 2.0
speed: 12 Mb/s chip ID: 8087:0029
Hub: 2-0:1 info: Full speed (or root) Hub ports: 4 rev: 3.1 speed: 10 Gb/s
chip ID: 1d6b:0003
Hub: 2-3:2 info: Microchip (formerly SMSC) Hub ports: 4 rev: 3.2 speed: 5 Gb/s
chip ID: 0424:5744
Device-10: 2-3.1:3 info: Valve type: Video driver: uvcvideo interfaces: 2 rev: 3.2
speed: 5 Gb/s chip ID: 28de:2400 serial: <filter>
Hub: 3-0:1 info: Full speed (or root) Hub ports: 6 rev: 2.0 speed: 480 Mb/s
chip ID: 1d6b:0002
Device-11: 3-1:2 info: Logitech G3 Laser Mouse type: Mouse,HID
driver: hid-generic,usbhid interfaces: 2 rev: 2.0 speed: 12 Mb/s chip ID: 046d:c042
Device-12: 3-2:3 info: Chesen Keyboard type: Keyboard,HID driver: hid-generic,usbhid
interfaces: 2 rev: 1.1 speed: 1.5 Mb/s chip ID: 0a81:0101
Device-13: 3-4:4 info: ASUSTek AURA LED Controller type: <vendor specific>
driver: hid-generic,usbhid interfaces: 2 rev: 2.0 speed: 12 Mb/s chip ID: 0b05:18f3
serial: <filter>
Hub: 3-5:5 info: Genesys Logic 4-port hub ports: 4 rev: 2.0 speed: 480 Mb/s
chip ID: 05e3:0610
Device-14: 3-6:6 info: Corsair Commander PRO type: HID driver: hid-generic,usbhid
interfaces: 1 rev: 2.0 speed: 12 Mb/s chip ID: 1b1c:0c10 serial: <filter>
Hub: 4-0:1 info: Full speed (or root) Hub ports: 4 rev: 3.1 speed: 10 Gb/s
chip ID: 1d6b:0003
Hub: 5-0:1 info: Full speed (or root) Hub ports: 4 rev: 2.0 speed: 480 Mb/s
chip ID: 1d6b:0002
Device-15: 5-1:2 info: Logitech USB Receiver type: Keyboard,Mouse,HID
driver: logitech-djreceiver,usbhid interfaces: 3 rev: 2.0 speed: 12 Mb/s
chip ID: 046d:c539
Device-16: 5-2:3 info: Razer USA Razer BlackWidow Chroma V2 type: Keyboard,Mouse
driver: hid-generic,usbhid interfaces: 3 rev: 2.0 speed: 12 Mb/s chip ID: 1532:0221
Hub: 6-0:1 info: Full speed (or root) Hub ports: 4 rev: 3.1 speed: 10 Gb/s
chip ID: 1d6b:0003
Sensors: System Temperatures: cpu: 50.0 C mobo: N/A gpu: nvidia temp: 34 C
Fan Speeds (RPM): N/A gpu: nvidia fan: 0%
Info: Processes: 488 Uptime: 21h 51m Init: systemd v: 245 Compilers: gcc: 10.1.0
Shell: bash (sudo) v: 5.0.17 running in: konsole inxi: 3.0.37
Here is the XML config for the VM. I have seen people have some sort of issue with nvidia gpus in VMs so i have added kvm hidden state.
<domain type="kvm">
<name>win10</name>
<uuid>d8ac75b7-2dde-4a9f-94d4-4968af96d9ab</uuid>
<metadata>
<libosinfo:libosinfo xmlns:libosinfo="http://libosinfo.org/xmlns/libvirt/domain/1.0">
<libosinfo:os id="http://microsoft.com/win/10"/>
</libosinfo:libosinfo>
</metadata>
<memory unit="KiB">16384000</memory>
<currentMemory unit="KiB">16384000</currentMemory>
<vcpu placement="static">16</vcpu>
<os>
<type arch="x86_64" machine="pc-q35-5.0">hvm</type>
<loader readonly="yes" type="pflash">/usr/share/edk2-ovmf/x64/OVMF_CODE.fd</loader>
<nvram>/var/lib/libvirt/qemu/nvram/win10_VARS.fd</nvram>
</os>
<features>
<acpi/>
<apic/>
<hyperv>
<relaxed state="on"/>
<vapic state="on"/>
<spinlocks state="on" retries="8191"/>
</hyperv>
<kvm>
<hidden state="on"/>
</kvm>
<vmport state="off"/>
</features>
<cpu mode="host-model" check="partial"/>
<clock offset="localtime">
<timer name="rtc" tickpolicy="catchup"/>
<timer name="pit" tickpolicy="delay"/>
<timer name="hpet" present="no"/>
<timer name="hypervclock" present="yes"/>
</clock>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>destroy</on_crash>
<pm>
<suspend-to-mem enabled="no"/>
<suspend-to-disk enabled="no"/>
</pm>
<devices>
<emulator>/usr/bin/qemu-system-x86_64</emulator>
<disk type="file" device="disk">
<driver name="qemu" type="qcow2"/>
<source file="/run/media/matrucious/VM/win10.qcow2"/>
<target dev="vda" bus="virtio"/>
<boot order="1"/>
<address type="pci" domain="0x0000" bus="0x03" slot="0x00" function="0x0"/>
</disk>
<disk type="file" device="cdrom">
<driver name="qemu" type="raw"/>
<source file="/home/matrucious/Downloads/virtio-win-0.1.171.iso"/>
<target dev="sdc" bus="sata"/>
<readonly/>
<address type="drive" controller="0" bus="0" target="0" unit="2"/>
</disk>
<controller type="usb" index="0" model="qemu-xhci" ports="15">
<address type="pci" domain="0x0000" bus="0x02" slot="0x00" function="0x0"/>
</controller>
<controller type="sata" index="0">
<address type="pci" domain="0x0000" bus="0x00" slot="0x1f" function="0x2"/>
</controller>
<controller type="pci" index="0" model="pcie-root"/>
<controller type="pci" index="1" model="pcie-root-port">
<model name="pcie-root-port"/>
<target chassis="1" port="0x10"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x0" multifunction="on"/>
</controller>
<controller type="pci" index="2" model="pcie-root-port">
<model name="pcie-root-port"/>
<target chassis="2" port="0x11"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x1"/>
</controller>
<controller type="pci" index="3" model="pcie-root-port">
<model name="pcie-root-port"/>
<target chassis="3" port="0x12"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x2"/>
</controller>
<controller type="pci" index="4" model="pcie-root-port">
<model name="pcie-root-port"/>
<target chassis="4" port="0x13"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x3"/>
</controller>
<controller type="pci" index="5" model="pcie-root-port">
<model name="pcie-root-port"/>
<target chassis="5" port="0x14"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x4"/>
</controller>
<controller type="pci" index="6" model="pcie-root-port">
<model name="pcie-root-port"/>
<target chassis="6" port="0x15"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x5"/>
</controller>
<controller type="pci" index="7" model="pcie-root-port">
<model name="pcie-root-port"/>
<target chassis="7" port="0x16"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x6"/>
</controller>
<controller type="pci" index="8" model="pcie-root-port">
<model name="pcie-root-port"/>
<target chassis="8" port="0x17"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x7"/>
</controller>
<interface type="direct">
<mac address="52:54:00:7e:80:50"/>
<source dev="enp7s0" mode="passthrough"/>
<model type="e1000e"/>
<address type="pci" domain="0x0000" bus="0x01" slot="0x00" function="0x0"/>
</interface>
<input type="mouse" bus="ps2"/>
<input type="keyboard" bus="ps2"/>
<hostdev mode="subsystem" type="pci" managed="yes">
<source>
<address domain="0x0000" bus="0x0b" slot="0x00" function="0x0"/>
</source>
<address type="pci" domain="0x0000" bus="0x05" slot="0x00" function="0x0"/>
</hostdev>
<hostdev mode="subsystem" type="pci" managed="yes">
<source>
<address domain="0x0000" bus="0x0b" slot="0x00" function="0x1"/>
</source>
<address type="pci" domain="0x0000" bus="0x06" slot="0x00" function="0x0"/>
</hostdev>
<hostdev mode="subsystem" type="pci" managed="yes">
<source>
<address domain="0x0000" bus="0x0b" slot="0x00" function="0x2"/>
</source>
<address type="pci" domain="0x0000" bus="0x07" slot="0x00" function="0x0"/>
</hostdev>
<hostdev mode="subsystem" type="pci" managed="yes">
<source>
<address domain="0x0000" bus="0x0b" slot="0x00" function="0x3"/>
</source>
<address type="pci" domain="0x0000" bus="0x08" slot="0x00" function="0x0"/>
</hostdev>
<hostdev mode="subsystem" type="usb" managed="yes">
<source>
<vendor id="0x1532"/>
<product id="0x0221"/>
</source>
<address type="usb" bus="0" port="3"/>
</hostdev>
<hostdev mode="subsystem" type="usb" managed="yes">
<source>
<vendor id="0x046d"/>
<product id="0xc539"/>
</source>
<address type="usb" bus="0" port="4"/>
</hostdev>
<redirdev bus="usb" type="spicevmc">
<address type="usb" bus="0" port="1"/>
</redirdev>
<redirdev bus="usb" type="spicevmc">
<address type="usb" bus="0" port="2"/>
</redirdev>
<memballoon model="virtio">
<address type="pci" domain="0x0000" bus="0x04" slot="0x00" function="0x0"/>
</memballoon>
</devices>
</domain>
I have seen around the forums about people not passing through their PCIe controller.. but all of those that I have seen have used Intel CPUs, and their controllers have been in the same IOMMU group. However I don't see a specific PCIe controller in my groups, and I have captured and passed through all of the IDs from group 30:
IOMMU Group 0:
00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 1:
00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 10:
00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 11:
00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 12:
00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 13:
00:08.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 14:
00:08.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 15:
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 16:
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 0 [1022:1440]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 1 [1022:1441]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 2 [1022:1442]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 3 [1022:1443]
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 4 [1022:1444]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 5 [1022:1445]
00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 6 [1022:1446]
00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 7 [1022:1447]
IOMMU Group 17:
01:00.0 Non-Volatile memory controller [0108]: Phison Electronics Corporation E16 PCIe4 NVMe Controller [1987:5016] (rev 01)
IOMMU Group 18:
02:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse Switch Upstream [1022:57ad]
IOMMU Group 19:
03:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 2:
00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 20:
03:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 21:
03:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 22:
03:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 23:
03:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
08:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
08:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
08:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
IOMMU Group 24:
03:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
09:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 25:
03:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
0a:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 26:
04:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM961/PM961 [144d:a804]
IOMMU Group 27:
05:00.0 Network controller [0280]: Intel Corporation Wi-Fi 6 AX200 [8086:2723] (rev 1a)
IOMMU Group 28:
06:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller [10ec:8125]
IOMMU Group 29:
07:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
IOMMU Group 3:
00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 30:
0b:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU104 [GeForce RTX 2080 Rev. A] [10de:1e87] (rev a1)
0b:00.1 Audio device [0403]: NVIDIA Corporation TU104 HD Audio Controller [10de:10f8] (rev a1)
0b:00.2 USB controller [0c03]: NVIDIA Corporation TU104 USB 3.1 Host Controller [10de:1ad8] (rev a1)
0b:00.3 Serial bus controller [0c80]: NVIDIA Corporation TU104 USB Type-C UCSI Controller [10de:1ad9] (rev a1)
IOMMU Group 31:
0c:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP104 [GeForce GTX 1080] [10de:1b80] (rev a1)
0c:00.1 Audio device [0403]: NVIDIA Corporation GP104 High Definition Audio Controller [10de:10f0] (rev a1)
IOMMU Group 32:
0d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
IOMMU Group 33:
0e:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
IOMMU Group 34:
0e:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
IOMMU Group 35:
0e:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
IOMMU Group 36:
0e:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
IOMMU Group 37:
0f:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 38:
10:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 4:
00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 5:
00:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 6:
00:03.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 7:
00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 8:
00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 9:
00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
Some extra info:
/etc/modprobe.d/vfio.conf
options vfio-pci ids=10de:1e87,10de:10f8,10de:1ad8,10de:1ad9
/etc/mkinitcpio.conf
MODULES=(vfio_pci vfio vfio_iommu_type1 vfio_virqfd)
HOOKS="base udev autodetect modconf block keyboard keymap resume filesystems"
lspci -nnk
0b:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU104 [GeForce RTX 2080 Rev. A] [10de:1e87] (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. TU104 [GeForce RTX 2080 Rev. A] [19da:3507]
Kernel driver in use: vfio-pci
Kernel modules: nouveau, nvidia_drm, nvidia
0b:00.1 Audio device [0403]: NVIDIA Corporation TU104 HD Audio Controller [10de:10f8] (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. TU104 HD Audio Controller [19da:3507]
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
0b:00.2 USB controller [0c03]: NVIDIA Corporation TU104 USB 3.1 Host Controller [10de:1ad8] (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. TU104 USB 3.1 Host Controller [19da:3507]
Kernel driver in use: vfio-pci
Kernel modules: xhci_pci
0b:00.3 Serial bus controller [0c80]: NVIDIA Corporation TU104 USB Type-C UCSI Controller [10de:1ad9] (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. TU104 USB Type-C UCSI Controller [19da:3507]
Kernel driver in use: vfio-pci
Kernel modules: i2c_nvidia_gpu
0c:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP104 [GeForce GTX 1080] [10de:1b80] (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. GP104 [GeForce GTX 1080] [19da:1425]
Kernel driver in use: nvidia
Kernel modules: nouveau, nvidia_drm, nvidia
0c:00.1 Audio device [0403]: NVIDIA Corporation GP104 High Definition Audio Controller [10de:10f0] (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. GP104 High Definition Audio Controller [19da:1425]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
Edit: forgot to add a couple of things
Heres a small snippit of cat command for what i assume is the log for the VM
cat /var/log/libvirt/qemu/win10.log
2020-06-12T14:42:09.402537Z qemu-system-x86_64: vfio_region_write(0000:0b:00.0:region1+0x888b8, 0x0,8) failed: Device or resource busy
2020-06-12T14:42:09.402544Z qemu-system-x86_64: vfio_region_write(0000:0b:00.0:region1+0x888c0, 0x98989800000000,8) failed: Device or resource busy
2020-06-12T14:42:09.402551Z qemu-system-x86_64: vfio_region_write(0000:0b:00.0:region1+0x888c8, 0x98989800989898,8) failed: Device or resource busy
2020-06-12T14:42:09.402557Z qemu-system-x86_64: vfio_region_write(0000:0b:00.0:region1+0x888d0, 0x989898,8) failed: Device or resource busy
2020-06-12T14:42:09.402565Z qemu-system-x86_64: vfio_region_write(0000:0b:00.0:region1+0x888d8, 0x0,8) failed: Device or resource busy
Here is what the PCI device is spitting out in the VM (Captured through spice server)
