blob: cf9431db873150d38a3d2477280d481ff42bfa83 [file] [log] [blame]
Keshavamurthy, Anil Sba395922007-10-21 16:41:49 -07001Linux IOMMU Support
2===================
3
4The architecture spec can be obtained from the below location.
5
6http://www.intel.com/technology/virtualization/
7
8This guide gives a quick cheat sheet for some basic understanding.
9
10Some Keywords
11
12DMAR - DMA remapping
13DRHD - DMA Engine Reporting Structure
14RMRR - Reserved memory Region Reporting Structure
15ZLR - Zero length reads from PCI devices
16IOVA - IO Virtual address.
17
18Basic stuff
19-----------
20
21ACPI enumerates and lists the different DMA engines in the platform, and
22device scope relationships between PCI devices and which DMA engine controls
23them.
24
25What is RMRR?
26-------------
27
28There are some devices the BIOS controls, for e.g USB devices to perform
29PS2 emulation. The regions of memory used for these devices are marked
30reserved in the e820 map. When we turn on DMA translation, DMA to those
31regions will fail. Hence BIOS uses RMRR to specify these regions along with
32devices that need to access these regions. OS is expected to setup
33unity mappings for these regions for these devices to access these regions.
34
35How is IOVA generated?
36---------------------
37
38Well behaved drivers call pci_map_*() calls before sending command to device
39that needs to perform DMA. Once DMA is completed and mapping is no longer
40required, device performs a pci_unmap_*() calls to unmap the region.
41
42The Intel IOMMU driver allocates a virtual address per domain. Each PCIE
43device has its own domain (hence protection). Devices under p2p bridges
44share the virtual address with all devices under the p2p bridge due to
45transaction id aliasing for p2p bridges.
46
47IOVA generation is pretty generic. We used the same technique as vmalloc()
48but these are not global address spaces, but separate for each domain.
49Different DMA engines may support different number of domains.
50
Matt LaPlanted9195882008-07-25 19:45:33 -070051We also allocate guard pages with each mapping, so we can attempt to catch
Keshavamurthy, Anil Sba395922007-10-21 16:41:49 -070052any overflow that might happen.
53
54
55Graphics Problems?
56------------------
57If you encounter issues with graphics devices, you can try adding
58option intel_iommu=igfx_off to turn off the integrated graphics engine.
David Woodhouse0c02a202009-09-19 09:37:23 -070059If this fixes anything, please ensure you file a bug reporting the problem.
Keshavamurthy, Anil Se8204822007-10-21 16:41:55 -070060
Keshavamurthy, Anil Sba395922007-10-21 16:41:49 -070061Some exceptions to IOVA
62-----------------------
63Interrupt ranges are not address translated, (0xfee00000 - 0xfeefffff).
64The same is true for peer to peer transactions. Hence we reserve the
65address from PCI MMIO ranges so they are not allocated for IOVA addresses.
66
Keshavamurthy, Anil S3460a6d2007-10-21 16:41:54 -070067
68Fault reporting
69---------------
70When errors are reported, the DMA engine signals via an interrupt. The fault
71reason and device that caused it with fault reason is printed on console.
72
73See below for sample.
74
75
Keshavamurthy, Anil Sba395922007-10-21 16:41:49 -070076Boot Message Sample
77-------------------
78
79Something like this gets printed indicating presence of DMAR tables
80in ACPI.
81
82ACPI: DMAR (v001 A M I OEMDMAR 0x00000001 MSFT 0x00000097) @ 0x000000007f5b5ef0
83
84When DMAR is being processed and initialized by ACPI, prints DMAR locations
85and any RMRR's processed.
86
87ACPI DMAR:Host address width 36
88ACPI DMAR:DRHD (flags: 0x00000000)base: 0x00000000fed90000
89ACPI DMAR:DRHD (flags: 0x00000000)base: 0x00000000fed91000
90ACPI DMAR:DRHD (flags: 0x00000001)base: 0x00000000fed93000
91ACPI DMAR:RMRR base: 0x00000000000ed000 end: 0x00000000000effff
92ACPI DMAR:RMRR base: 0x000000007f600000 end: 0x000000007fffffff
93
94When DMAR is enabled for use, you will notice..
95
96PCI-DMA: Using DMAR IOMMU
97
Keshavamurthy, Anil S3460a6d2007-10-21 16:41:54 -070098Fault reporting
99---------------
100
101DMAR:[DMA Write] Request device [00:02.0] fault addr 6df084000
102DMAR:[fault reason 05] PTE Write access is not set
103DMAR:[DMA Write] Request device [00:02.0] fault addr 6df084000
104DMAR:[fault reason 05] PTE Write access is not set
105
Keshavamurthy, Anil Sba395922007-10-21 16:41:49 -0700106TBD
107----
108
109- For compatibility testing, could use unity map domain for all devices, just
110 provide a 1-1 for all useful memory under a single domain for all devices.
Matt LaPlanted9195882008-07-25 19:45:33 -0700111- API for paravirt ops for abstracting functionality for VMM folks.