blob: e4991fb1eedcd4efcd258a7b1290fd087e5f9923 [file] [log] [blame]
Masami Hiramatsu77b44d12009-11-03 19:12:47 -05001 Kprobe-based Event Tracing
2 ==========================
Masami Hiramatsud8ec9182009-08-19 21:13:57 +02003
4 Documentation is written by Masami Hiramatsu
5
6
7Overview
8--------
Masami Hiramatsu77b44d12009-11-03 19:12:47 -05009These events are similar to tracepoint based events. Instead of Tracepoint,
10this is based on kprobes (kprobe and kretprobe). So it can probe wherever
11kprobes can probe (this means, all functions body except for __kprobes
12functions). Unlike the Tracepoint based event, this can be added and removed
13dynamically, on the fly.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020014
Liu Bo9c33c512012-09-27 11:50:41 +080015To enable this feature, build your kernel with CONFIG_KPROBE_EVENT=y.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020016
Masami Hiramatsu77b44d12009-11-03 19:12:47 -050017Similar to the events tracer, this doesn't need to be activated via
18current_tracer. Instead of that, add probe points via
19/sys/kernel/debug/tracing/kprobe_events, and enable it via
20/sys/kernel/debug/tracing/events/kprobes/<EVENT>/enabled.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020021
22
23Synopsis of kprobe_events
24-------------------------
Masami Hiramatsu61424312011-06-27 16:26:56 +090025 p[:[GRP/]EVENT] [MOD:]SYM[+offs]|MEMADDR [FETCHARGS] : Set a probe
26 r[:[GRP/]EVENT] [MOD:]SYM[+0] [FETCHARGS] : Set a return probe
Motohiro KOSAKIdf3ab702010-01-18 21:35:12 -050027 -:[GRP/]EVENT : Clear a probe
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020028
Masami Hiramatsuf52487e2009-09-10 19:53:53 -040029 GRP : Group name. If omitted, use "kprobes" for it.
Masami Hiramatsu2fba0c82009-09-10 19:53:14 -040030 EVENT : Event name. If omitted, the event name is generated
Masami Hiramatsu61424312011-06-27 16:26:56 +090031 based on SYM+offs or MEMADDR.
32 MOD : Module name which has given SYM.
33 SYM[+offs] : Symbol+offset where the probe is inserted.
Masami Hiramatsu2fba0c82009-09-10 19:53:14 -040034 MEMADDR : Address where the probe is inserted.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020035
Masami Hiramatsu2fba0c82009-09-10 19:53:14 -040036 FETCHARGS : Arguments. Each probe can have up to 128 args.
Masami Hiramatsu2e06ff62009-10-07 18:27:59 -040037 %REG : Fetch register REG
38 @ADDR : Fetch memory at ADDR (ADDR should be in kernel)
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020039 @SYM[+|-offs] : Fetch memory at SYM +|- offs (SYM should be a data symbol)
Masami Hiramatsu2e06ff62009-10-07 18:27:59 -040040 $stackN : Fetch Nth entry of stack (N >= 0)
41 $stack : Fetch stack address.
Masami Hiramatsu14640102010-01-05 17:46:48 -050042 $retval : Fetch return value.(*)
Omar Sandoval35abb672016-06-08 18:38:02 -070043 $comm : Fetch current task comm.
Masami Hiramatsu14640102010-01-05 17:46:48 -050044 +|-offs(FETCHARG) : Fetch memory at FETCHARG +|- offs address.(**)
Masami Hiramatsu93ccae72010-04-12 13:17:08 -040045 NAME=FETCHARG : Set NAME as the argument name of FETCHARG.
46 FETCHARG:TYPE : Set TYPE as the type of FETCHARG. Currently, basic types
Masami Hiramatsu17ce3dc2016-08-18 17:57:50 +090047 (u8/u16/u32/u64/s8/s16/s32/s64), hexadecimal types
48 (x8/x16/x32/x64), "string" and bitfield are supported.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020049
Masami Hiramatsu14640102010-01-05 17:46:48 -050050 (*) only for return probe.
51 (**) this is useful for fetching a field of data structures.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020052
Masami Hiramatsu1ff511e2011-02-04 21:52:05 +090053Types
54-----
55Several types are supported for fetch-args. Kprobe tracer will access memory
56by given type. Prefix 's' and 'u' means those types are signed and unsigned
Masami Hiramatsubdca79c22016-08-18 17:59:21 +090057respectively. 'x' prefix implies it is unsigned. Traced arguments are shown
58in decimal ('s' and 'u') or hexadecimal ('x'). Without type casting, 'x32'
59or 'x64' is used depends on the architecture (e.g. x86-32 uses x32, and
60x86-64 uses x64).
Masami Hiramatsu1ff511e2011-02-04 21:52:05 +090061String type is a special type, which fetches a "null-terminated" string from
62kernel space. This means it will fail and store NULL if the string container
63has been paged out.
64Bitfield is another special type, which takes 3 parameters, bit-width, bit-
65offset, and container-size (usually 32). The syntax is;
66
67 b<bit-width>@<bit-offset>/<container-size>
68
Omar Sandoval35abb672016-06-08 18:38:02 -070069For $comm, the default type is "string"; any other type is invalid.
70
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020071
72Per-Probe Event Filtering
73-------------------------
74 Per-probe event filtering feature allows you to set different filter on each
75probe and gives you what arguments will be shown in trace buffer. If an event
Masami Hiramatsu77b44d12009-11-03 19:12:47 -050076name is specified right after 'p:' or 'r:' in kprobe_events, it adds an event
77under tracing/events/kprobes/<EVENT>, at the directory you can see 'id',
78'enabled', 'format' and 'filter'.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020079
80enabled:
81 You can enable/disable the probe by writing 1 or 0 on it.
82
83format:
Masami Hiramatsueca0d912009-09-10 19:53:38 -040084 This shows the format of this probe event.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020085
86filter:
Masami Hiramatsueca0d912009-09-10 19:53:38 -040087 You can write filtering rules of this event.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020088
Masami Hiramatsue08d1c62009-09-10 19:53:30 -040089id:
90 This shows the id of this probe event.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +020091
Masami Hiramatsu77b44d12009-11-03 19:12:47 -050092
Masami Hiramatsucd7e7bd2009-08-13 16:35:42 -040093Event Profiling
94---------------
95 You can check the total number of probe hits and probe miss-hits via
96/sys/kernel/debug/tracing/kprobe_profile.
97 The first column is event name, the second is the number of probe hits,
98the third is the number of probe miss-hits.
99
100
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200101Usage examples
102--------------
103To add a probe as a new event, write a new definition to kprobe_events
104as below.
105
Motohiro KOSAKI580d9e02010-01-18 21:35:05 -0500106 echo 'p:myprobe do_sys_open dfd=%ax filename=%dx flags=%cx mode=+4($stack)' > /sys/kernel/debug/tracing/kprobe_events
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200107
108 This sets a kprobe on the top of do_sys_open() function with recording
Masami Hiramatsu14640102010-01-05 17:46:48 -05001091st to 4th arguments as "myprobe" event. Note, which register/stack entry is
110assigned to each function argument depends on arch-specific ABI. If you unsure
111the ABI, please try to use probe subcommand of perf-tools (you can find it
112under tools/perf/).
113As this example shows, users can choose more familiar names for each arguments.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200114
Motohiro KOSAKI580d9e02010-01-18 21:35:05 -0500115 echo 'r:myretprobe do_sys_open $retval' >> /sys/kernel/debug/tracing/kprobe_events
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200116
117 This sets a kretprobe on the return point of do_sys_open() function with
Masami Hiramatsu99329c42009-10-07 18:27:48 -0400118recording return value as "myretprobe" event.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200119 You can see the format of these events via
120/sys/kernel/debug/tracing/events/kprobes/<EVENT>/format.
121
122 cat /sys/kernel/debug/tracing/events/kprobes/myprobe/format
123name: myprobe
Masami Hiramatsuec3a9032010-01-05 17:46:41 -0500124ID: 780
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200125format:
Masami Hiramatsuec3a9032010-01-05 17:46:41 -0500126 field:unsigned short common_type; offset:0; size:2; signed:0;
127 field:unsigned char common_flags; offset:2; size:1; signed:0;
128 field:unsigned char common_preempt_count; offset:3; size:1;signed:0;
129 field:int common_pid; offset:4; size:4; signed:1;
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200130
Masami Hiramatsuec3a9032010-01-05 17:46:41 -0500131 field:unsigned long __probe_ip; offset:12; size:4; signed:0;
132 field:int __probe_nargs; offset:16; size:4; signed:1;
133 field:unsigned long dfd; offset:20; size:4; signed:0;
134 field:unsigned long filename; offset:24; size:4; signed:0;
135 field:unsigned long flags; offset:28; size:4; signed:0;
136 field:unsigned long mode; offset:32; size:4; signed:0;
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200137
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200138
Masami Hiramatsuec3a9032010-01-05 17:46:41 -0500139print fmt: "(%lx) dfd=%lx filename=%lx flags=%lx mode=%lx", REC->__probe_ip,
140REC->dfd, REC->filename, REC->flags, REC->mode
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200141
Masami Hiramatsueca0d912009-09-10 19:53:38 -0400142 You can see that the event has 4 arguments as in the expressions you specified.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200143
144 echo > /sys/kernel/debug/tracing/kprobe_events
145
Masami Hiramatsu5a0d9052009-09-14 16:49:37 -0400146 This clears all probe points.
147
Motohiro KOSAKIdf3ab702010-01-18 21:35:12 -0500148 Or,
149
150 echo -:myprobe >> kprobe_events
151
152 This clears probe points selectively.
153
Masami Hiramatsu5a0d9052009-09-14 16:49:37 -0400154 Right after definition, each event is disabled by default. For tracing these
155events, you need to enable it.
156
157 echo 1 > /sys/kernel/debug/tracing/events/kprobes/myprobe/enable
158 echo 1 > /sys/kernel/debug/tracing/events/kprobes/myretprobe/enable
159
160 And you can see the traced information via /sys/kernel/debug/tracing/trace.
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200161
162 cat /sys/kernel/debug/tracing/trace
163# tracer: nop
164#
165# TASK-PID CPU# TIMESTAMP FUNCTION
166# | | | | |
Masami Hiramatsu6e9f23d2009-09-10 19:53:45 -0400167 <...>-1447 [001] 1038282.286875: myprobe: (do_sys_open+0x0/0xd6) dfd=3 filename=7fffd1ec4440 flags=8000 mode=0
Masami Hiramatsu2e06ff62009-10-07 18:27:59 -0400168 <...>-1447 [001] 1038282.286878: myretprobe: (sys_openat+0xc/0xe <- do_sys_open) $retval=fffffffffffffffe
Masami Hiramatsu6e9f23d2009-09-10 19:53:45 -0400169 <...>-1447 [001] 1038282.286885: myprobe: (do_sys_open+0x0/0xd6) dfd=ffffff9c filename=40413c flags=8000 mode=1b6
Masami Hiramatsu2e06ff62009-10-07 18:27:59 -0400170 <...>-1447 [001] 1038282.286915: myretprobe: (sys_open+0x1b/0x1d <- do_sys_open) $retval=3
Masami Hiramatsu6e9f23d2009-09-10 19:53:45 -0400171 <...>-1447 [001] 1038282.286969: myprobe: (do_sys_open+0x0/0xd6) dfd=ffffff9c filename=4041c6 flags=98800 mode=10
Masami Hiramatsu2e06ff62009-10-07 18:27:59 -0400172 <...>-1447 [001] 1038282.286976: myretprobe: (sys_open+0x1b/0x1d <- do_sys_open) $retval=3
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200173
174
Masami Hiramatsu6e9f23d2009-09-10 19:53:45 -0400175 Each line shows when the kernel hits an event, and <- SYMBOL means kernel
Masami Hiramatsud8ec9182009-08-19 21:13:57 +0200176returns from SYMBOL(e.g. "sys_open+0x1b/0x1d <- do_sys_open" means kernel
177returns from do_sys_open to sys_open+0x1b).
178