Max Krasnyansky | 1840475 | 2008-05-29 11:02:52 -0700 | [diff] [blame] | 1 | ChangeLog: |
| 2 | Started by Ingo Molnar <mingo@redhat.com> |
| 3 | Update by Max Krasnyansky <maxk@qualcomm.com> |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 4 | |
Max Krasnyansky | 1840475 | 2008-05-29 11:02:52 -0700 | [diff] [blame] | 5 | SMP IRQ affinity |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 6 | |
Mike Travis | 4b06042 | 2011-05-24 17:13:12 -0700 | [diff] [blame] | 7 | /proc/irq/IRQ#/smp_affinity and /proc/irq/IRQ#/smp_affinity_list specify |
| 8 | which target CPUs are permitted for a given IRQ source. It's a bitmask |
| 9 | (smp_affinity) or cpu list (smp_affinity_list) of allowed CPUs. It's not |
| 10 | allowed to turn off all CPUs, and if an IRQ controller does not support |
| 11 | IRQ affinity then the value will not change from the default of all cpus. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 12 | |
Max Krasnyansky | 1840475 | 2008-05-29 11:02:52 -0700 | [diff] [blame] | 13 | /proc/irq/default_smp_affinity specifies default affinity mask that applies |
| 14 | to all non-active IRQs. Once IRQ is allocated/activated its affinity bitmask |
| 15 | will be set to the default mask. It can then be changed as described above. |
| 16 | Default mask is 0xffffffff. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 17 | |
Max Krasnyansky | 1840475 | 2008-05-29 11:02:52 -0700 | [diff] [blame] | 18 | Here is an example of restricting IRQ44 (eth1) to CPU0-3 then restricting |
| 19 | it to CPU4-7 (this is an 8-CPU SMP box): |
| 20 | |
| 21 | [root@moon 44]# cd /proc/irq/44 |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 22 | [root@moon 44]# cat smp_affinity |
| 23 | ffffffff |
Max Krasnyansky | 1840475 | 2008-05-29 11:02:52 -0700 | [diff] [blame] | 24 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 25 | [root@moon 44]# echo 0f > smp_affinity |
| 26 | [root@moon 44]# cat smp_affinity |
| 27 | 0000000f |
| 28 | [root@moon 44]# ping -f h |
| 29 | PING hell (195.4.7.3): 56 data bytes |
| 30 | ... |
| 31 | --- hell ping statistics --- |
| 32 | 6029 packets transmitted, 6027 packets received, 0% packet loss |
| 33 | round-trip min/avg/max = 0.1/0.1/0.4 ms |
Max Krasnyansky | 1840475 | 2008-05-29 11:02:52 -0700 | [diff] [blame] | 34 | [root@moon 44]# cat /proc/interrupts | grep 'CPU\|44:' |
| 35 | CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 |
| 36 | 44: 1068 1785 1785 1783 0 0 0 0 IO-APIC-level eth1 |
| 37 | |
| 38 | As can be seen from the line above IRQ44 was delivered only to the first four |
| 39 | processors (0-3). |
| 40 | Now lets restrict that IRQ to CPU(4-7). |
| 41 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 42 | [root@moon 44]# echo f0 > smp_affinity |
Max Krasnyansky | 1840475 | 2008-05-29 11:02:52 -0700 | [diff] [blame] | 43 | [root@moon 44]# cat smp_affinity |
| 44 | 000000f0 |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 45 | [root@moon 44]# ping -f h |
| 46 | PING hell (195.4.7.3): 56 data bytes |
| 47 | .. |
| 48 | --- hell ping statistics --- |
| 49 | 2779 packets transmitted, 2777 packets received, 0% packet loss |
| 50 | round-trip min/avg/max = 0.1/0.5/585.4 ms |
Max Krasnyansky | 1840475 | 2008-05-29 11:02:52 -0700 | [diff] [blame] | 51 | [root@moon 44]# cat /proc/interrupts | 'CPU\|44:' |
| 52 | CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 |
| 53 | 44: 1068 1785 1785 1783 1784 1069 1070 1069 IO-APIC-level eth1 |
| 54 | |
| 55 | This time around IRQ44 was delivered only to the last four processors. |
| 56 | i.e counters for the CPU0-3 did not change. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 57 | |
Mike Travis | 4b06042 | 2011-05-24 17:13:12 -0700 | [diff] [blame] | 58 | Here is an example of limiting that same irq (44) to cpus 1024 to 1031: |
| 59 | |
Hu Tao | 884ad3f | 2013-08-07 22:51:09 -0700 | [diff] [blame] | 60 | [root@moon 44]# echo 1024-1031 > smp_affinity_list |
| 61 | [root@moon 44]# cat smp_affinity_list |
Mike Travis | 4b06042 | 2011-05-24 17:13:12 -0700 | [diff] [blame] | 62 | 1024-1031 |
| 63 | |
| 64 | Note that to do this with a bitmask would require 32 bitmasks of zero |
| 65 | to follow the pertinent one. |