blob: c5521e4e9bd50fef8d760bd495aad5f93235daba [file] [log] [blame]
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +00001FileCheck - Flexible pattern matching file verifier
2===================================================
3
James Hendersona0566842019-06-27 13:24:46 +00004.. program:: FileCheck
5
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +00006SYNOPSIS
7--------
8
Dmitri Gribenkof589e242012-11-29 19:21:02 +00009:program:`FileCheck` *match-filename* [*--check-prefix=XXX*] [*--strict-whitespace*]
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000010
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000011DESCRIPTION
12-----------
13
Dmitri Gribenkof589e242012-11-29 19:21:02 +000014:program:`FileCheck` reads two files (one from standard input, and one
15specified on the command line) and uses one to verify the other. This
16behavior is particularly useful for the testsuite, which wants to verify that
17the output of some tool (e.g. :program:`llc`) contains the expected information
18(for example, a movsd from esp or whatever is interesting). This is similar to
19using :program:`grep`, but it is optimized for matching multiple different
20inputs in one file in a specific order.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000021
Dmitri Gribenkof589e242012-11-29 19:21:02 +000022The ``match-filename`` file specifies the file that contains the patterns to
Stephen Lina6e877f2013-07-14 18:12:25 +000023match. The file to verify is read from standard input unless the
24:option:`--input-file` option is used.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000025
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000026OPTIONS
27-------
28
Joel E. Denny24994d72018-11-06 22:07:03 +000029Options are parsed from the environment variable ``FILECHECK_OPTS``
30and from the command line.
31
Dmitri Gribenkof589e242012-11-29 19:21:02 +000032.. option:: -help
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000033
34 Print a summary of command line options.
35
Dmitri Gribenkof589e242012-11-29 19:21:02 +000036.. option:: --check-prefix prefix
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000037
Matt Arsenault13df4622013-11-10 02:04:09 +000038 FileCheck searches the contents of ``match-filename`` for patterns to
39 match. By default, these patterns are prefixed with "``CHECK:``".
40 If you'd like to use a different prefix (e.g. because the same input
41 file is checking multiple different tool or options), the
42 :option:`--check-prefix` argument allows you to specify one or more
43 prefixes to match. Multiple prefixes are useful for tests which might
44 change for different run options, but most lines remain the same.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000045
Daniel Sandersad875c22016-06-14 16:42:05 +000046.. option:: --check-prefixes prefix1,prefix2,...
47
48 An alias of :option:`--check-prefix` that allows multiple prefixes to be
49 specified as a comma separated list.
50
Dmitri Gribenkof589e242012-11-29 19:21:02 +000051.. option:: --input-file filename
Eli Bendersky8a7e80f2012-11-07 01:41:30 +000052
53 File to check (defaults to stdin).
54
James Y Knight85913cc2016-02-11 16:46:09 +000055.. option:: --match-full-lines
56
57 By default, FileCheck allows matches of anywhere on a line. This
58 option will require all positive matches to cover an entire
59 line. Leading and trailing whitespace is ignored, unless
60 :option:`--strict-whitespace` is also specified. (Note: negative
61 matches from ``CHECK-NOT`` are not affected by this option!)
62
63 Passing this option is equivalent to inserting ``{{^ *}}`` or
64 ``{{^}}`` before, and ``{{ *$}}`` or ``{{$}}`` after every positive
65 check pattern.
66
Dmitri Gribenkof589e242012-11-29 19:21:02 +000067.. option:: --strict-whitespace
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000068
69 By default, FileCheck canonicalizes input horizontal whitespace (spaces and
70 tabs) which causes it to ignore these differences (a space will match a tab).
Guy Benyei5ea04c32013-02-06 20:40:38 +000071 The :option:`--strict-whitespace` argument disables this behavior. End-of-line
Sean Silvab6bfbad2013-06-21 00:27:54 +000072 sequences are canonicalized to UNIX-style ``\n`` in all modes.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000073
Alexander Kornienko56ccdbb2014-07-11 12:39:32 +000074.. option:: --implicit-check-not check-pattern
75
76 Adds implicit negative checks for the specified patterns between positive
77 checks. The option allows writing stricter tests without stuffing them with
Dan Liewa762a132014-07-21 16:39:00 +000078 ``CHECK-NOT``\ s.
Alexander Kornienko56ccdbb2014-07-11 12:39:32 +000079
80 For example, "``--implicit-check-not warning:``" can be useful when testing
81 diagnostic messages from tools that don't have an option similar to ``clang
82 -verify``. With this option FileCheck will verify that input does not contain
83 warnings not covered by any ``CHECK:`` patterns.
84
Joel E. Denny3c5d2672018-12-18 00:01:39 +000085.. option:: --dump-input <mode>
86
87 Dump input to stderr, adding annotations representing currently enabled
88 diagnostics. Do this either 'always', on 'fail', or 'never'. Specify 'help'
89 to explain the dump format and quit.
90
George Karpenkov346dfbe2018-07-20 20:21:57 +000091.. option:: --dump-input-on-failure
92
Joel E. Denny3c5d2672018-12-18 00:01:39 +000093 When the check fails, dump all of the original input. This option is
94 deprecated in favor of `--dump-input=fail`.
George Karpenkov346dfbe2018-07-20 20:21:57 +000095
Artem Belevichf55e72a2017-03-09 17:59:04 +000096.. option:: --enable-var-scope
97
98 Enables scope for regex variables.
99
100 Variables with names that start with ``$`` are considered global and
101 remain set throughout the file.
102
103 All other variables get undefined after each encountered ``CHECK-LABEL``.
104
Alexander Richardson46e1fd62017-11-07 13:24:44 +0000105.. option:: -D<VAR=VALUE>
106
Thomas Preud'homme288ed912019-05-02 00:04:38 +0000107 Sets a filecheck pattern variable ``VAR`` with value ``VALUE`` that can be
108 used in ``CHECK:`` lines.
Alexander Richardson46e1fd62017-11-07 13:24:44 +0000109
Thomas Preud'homme4cd9b852019-07-24 12:38:22 +0000110.. option:: -D#<NUMVAR>=<NUMERIC EXPRESSION>
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000111
Thomas Preud'homme2a7f5202019-07-13 13:24:30 +0000112 Sets a filecheck numeric variable ``NUMVAR`` to the result of evaluating
Thomas Preud'homme4cd9b852019-07-24 12:38:22 +0000113 ``<NUMERIC EXPRESSION>`` that can be used in ``CHECK:`` lines. See section
114 ``FileCheck Numeric Variables and Expressions`` for details on supported
115 numeric expressions.
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000116
Dmitri Gribenkof589e242012-11-29 19:21:02 +0000117.. option:: -version
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000118
119 Show the version number of this program.
120
Joel E. Dennydc5ba312018-07-13 03:08:23 +0000121.. option:: -v
122
Joel E. Denny352695c2019-01-22 21:41:42 +0000123 Print good directive pattern matches. However, if ``-input-dump=fail`` or
124 ``-input-dump=always``, add those matches as input annotations instead.
Joel E. Dennydc5ba312018-07-13 03:08:23 +0000125
126.. option:: -vv
127
128 Print information helpful in diagnosing internal FileCheck issues, such as
129 discarded overlapping ``CHECK-DAG:`` matches, implicit EOF pattern matches,
130 and ``CHECK-NOT:`` patterns that do not have matches. Implies ``-v``.
Joel E. Denny352695c2019-01-22 21:41:42 +0000131 However, if ``-input-dump=fail`` or ``-input-dump=always``, just add that
132 information as input annotations instead.
Joel E. Dennydc5ba312018-07-13 03:08:23 +0000133
Joel E. Dennybcf5b442018-07-11 20:27:27 +0000134.. option:: --allow-deprecated-dag-overlap
135
136 Enable overlapping among matches in a group of consecutive ``CHECK-DAG:``
137 directives. This option is deprecated and is only provided for convenience
138 as old tests are migrated to the new non-overlapping ``CHECK-DAG:``
139 implementation.
140
Joel E. Denny3e665092018-10-24 21:46:42 +0000141.. option:: --color
142
143 Use colors in output (autodetected by default).
144
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000145EXIT STATUS
146-----------
147
Dmitri Gribenkof589e242012-11-29 19:21:02 +0000148If :program:`FileCheck` verifies that the file matches the expected contents,
149it exits with 0. Otherwise, if not, or if an error occurs, it will exit with a
150non-zero value.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000151
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000152TUTORIAL
153--------
154
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000155FileCheck is typically used from LLVM regression tests, being invoked on the RUN
156line of the test. A simple example of using FileCheck from a RUN line looks
157like this:
158
Dmitri Gribenkoa99fa5b2012-06-12 15:45:07 +0000159.. code-block:: llvm
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000160
161 ; RUN: llvm-as < %s | llc -march=x86-64 | FileCheck %s
162
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000163This syntax says to pipe the current file ("``%s``") into ``llvm-as``, pipe
164that into ``llc``, then pipe the output of ``llc`` into ``FileCheck``. This
165means that FileCheck will be verifying its standard input (the llc output)
166against the filename argument specified (the original ``.ll`` file specified by
167"``%s``"). To see how this works, let's look at the rest of the ``.ll`` file
168(after the RUN line):
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000169
Dmitri Gribenkoa99fa5b2012-06-12 15:45:07 +0000170.. code-block:: llvm
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000171
172 define void @sub1(i32* %p, i32 %v) {
173 entry:
174 ; CHECK: sub1:
175 ; CHECK: subl
176 %0 = tail call i32 @llvm.atomic.load.sub.i32.p0i32(i32* %p, i32 %v)
177 ret void
178 }
179
180 define void @inc4(i64* %p) {
181 entry:
182 ; CHECK: inc4:
183 ; CHECK: incq
184 %0 = tail call i64 @llvm.atomic.load.add.i64.p0i64(i64* %p, i64 1)
185 ret void
186 }
187
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000188Here you can see some "``CHECK:``" lines specified in comments. Now you can
189see how the file is piped into ``llvm-as``, then ``llc``, and the machine code
190output is what we are verifying. FileCheck checks the machine code output to
191verify that it matches what the "``CHECK:``" lines specify.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000192
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000193The syntax of the "``CHECK:``" lines is very simple: they are fixed strings that
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000194must occur in order. FileCheck defaults to ignoring horizontal whitespace
195differences (e.g. a space is allowed to match a tab) but otherwise, the contents
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000196of the "``CHECK:``" line is required to match some thing in the test file exactly.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000197
198One nice thing about FileCheck (compared to grep) is that it allows merging
199test cases together into logical groups. For example, because the test above
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000200is checking for the "``sub1:``" and "``inc4:``" labels, it will not match
201unless there is a "``subl``" in between those labels. If it existed somewhere
202else in the file, that would not count: "``grep subl``" matches if "``subl``"
203exists anywhere in the file.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000204
205The FileCheck -check-prefix option
206~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
207
Renato Golin124f2592016-07-20 12:16:38 +0000208The FileCheck `-check-prefix` option allows multiple test
Dmitri Gribenkof589e242012-11-29 19:21:02 +0000209configurations to be driven from one `.ll` file. This is useful in many
210circumstances, for example, testing different architectural variants with
211:program:`llc`. Here's a simple example:
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000212
Dmitri Gribenkoa99fa5b2012-06-12 15:45:07 +0000213.. code-block:: llvm
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000214
215 ; RUN: llvm-as < %s | llc -mtriple=i686-apple-darwin9 -mattr=sse41 \
Dmitri Gribenko19408a72012-06-12 00:48:47 +0000216 ; RUN: | FileCheck %s -check-prefix=X32
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000217 ; RUN: llvm-as < %s | llc -mtriple=x86_64-apple-darwin9 -mattr=sse41 \
Dmitri Gribenko19408a72012-06-12 00:48:47 +0000218 ; RUN: | FileCheck %s -check-prefix=X64
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000219
220 define <4 x i32> @pinsrd_1(i32 %s, <4 x i32> %tmp) nounwind {
221 %tmp1 = insertelement <4 x i32>; %tmp, i32 %s, i32 1
222 ret <4 x i32> %tmp1
223 ; X32: pinsrd_1:
224 ; X32: pinsrd $1, 4(%esp), %xmm0
225
226 ; X64: pinsrd_1:
227 ; X64: pinsrd $1, %edi, %xmm0
228 }
229
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000230In this case, we're testing that we get the expected code generation with
231both 32-bit and 64-bit code generation.
232
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000233The "CHECK-NEXT:" directive
234~~~~~~~~~~~~~~~~~~~~~~~~~~~
235
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000236Sometimes you want to match lines and would like to verify that matches
237happen on exactly consecutive lines with no other lines in between them. In
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000238this case, you can use "``CHECK:``" and "``CHECK-NEXT:``" directives to specify
239this. If you specified a custom check prefix, just use "``<PREFIX>-NEXT:``".
240For example, something like this works as you'd expect:
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000241
Dmitri Gribenkoa99fa5b2012-06-12 15:45:07 +0000242.. code-block:: llvm
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000243
Dmitri Gribenko19408a72012-06-12 00:48:47 +0000244 define void @t2(<2 x double>* %r, <2 x double>* %A, double %B) {
245 %tmp3 = load <2 x double>* %A, align 16
246 %tmp7 = insertelement <2 x double> undef, double %B, i32 0
247 %tmp9 = shufflevector <2 x double> %tmp3,
248 <2 x double> %tmp7,
249 <2 x i32> < i32 0, i32 2 >
250 store <2 x double> %tmp9, <2 x double>* %r, align 16
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000251 ret void
252
253 ; CHECK: t2:
254 ; CHECK: movl 8(%esp), %eax
255 ; CHECK-NEXT: movapd (%eax), %xmm0
256 ; CHECK-NEXT: movhpd 12(%esp), %xmm0
257 ; CHECK-NEXT: movl 4(%esp), %eax
258 ; CHECK-NEXT: movapd %xmm0, (%eax)
259 ; CHECK-NEXT: ret
260 }
261
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000262"``CHECK-NEXT:``" directives reject the input unless there is exactly one
Eli Bendersky2fef6b62012-11-21 22:40:52 +0000263newline between it and the previous directive. A "``CHECK-NEXT:``" cannot be
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000264the first directive in a file.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000265
Duncan P. N. Exon Smithcffbbe92015-03-05 17:00:05 +0000266The "CHECK-SAME:" directive
267~~~~~~~~~~~~~~~~~~~~~~~~~~~
268
269Sometimes you want to match lines and would like to verify that matches happen
270on the same line as the previous match. In this case, you can use "``CHECK:``"
271and "``CHECK-SAME:``" directives to specify this. If you specified a custom
272check prefix, just use "``<PREFIX>-SAME:``".
273
274"``CHECK-SAME:``" is particularly powerful in conjunction with "``CHECK-NOT:``"
275(described below).
276
277For example, the following works like you'd expect:
278
279.. code-block:: llvm
280
Duncan P. N. Exon Smitha9308c42015-04-29 16:38:44 +0000281 !0 = !DILocation(line: 5, scope: !1, inlinedAt: !2)
Duncan P. N. Exon Smithcffbbe92015-03-05 17:00:05 +0000282
Duncan P. N. Exon Smitha9308c42015-04-29 16:38:44 +0000283 ; CHECK: !DILocation(line: 5,
Duncan P. N. Exon Smithcffbbe92015-03-05 17:00:05 +0000284 ; CHECK-NOT: column:
285 ; CHECK-SAME: scope: ![[SCOPE:[0-9]+]]
286
287"``CHECK-SAME:``" directives reject the input if there are any newlines between
288it and the previous directive. A "``CHECK-SAME:``" cannot be the first
289directive in a file.
290
James Henderson5507f662018-06-26 15:15:45 +0000291The "CHECK-EMPTY:" directive
James Hendersonc307b002018-06-26 15:29:09 +0000292~~~~~~~~~~~~~~~~~~~~~~~~~~~~
James Henderson5507f662018-06-26 15:15:45 +0000293
294If you need to check that the next line has nothing on it, not even whitespace,
295you can use the "``CHECK-EMPTY:``" directive.
296
297.. code-block:: llvm
298
Chandler Carruthef705b72018-08-06 01:41:25 +0000299 declare void @foo()
James Henderson5507f662018-06-26 15:15:45 +0000300
Chandler Carruthef705b72018-08-06 01:41:25 +0000301 declare void @bar()
James Henderson5507f662018-06-26 15:15:45 +0000302 ; CHECK: foo
303 ; CHECK-EMPTY:
304 ; CHECK-NEXT: bar
305
306Just like "``CHECK-NEXT:``" the directive will fail if there is more than one
307newline before it finds the next blank line, and it cannot be the first
308directive in a file.
309
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000310The "CHECK-NOT:" directive
311~~~~~~~~~~~~~~~~~~~~~~~~~~
312
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000313The "``CHECK-NOT:``" directive is used to verify that a string doesn't occur
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000314between two matches (or before the first match, or after the last match). For
315example, to verify that a load is removed by a transformation, a test like this
316can be used:
317
Dmitri Gribenkoa99fa5b2012-06-12 15:45:07 +0000318.. code-block:: llvm
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000319
320 define i8 @coerce_offset0(i32 %V, i32* %P) {
321 store i32 %V, i32* %P
322
323 %P2 = bitcast i32* %P to i8*
324 %P3 = getelementptr i8* %P2, i32 2
325
326 %A = load i8* %P3
327 ret i8 %A
328 ; CHECK: @coerce_offset0
329 ; CHECK-NOT: load
330 ; CHECK: ret i8
331 }
332
Fedor Sergeev6c9e19b2018-11-13 00:46:13 +0000333The "CHECK-COUNT:" directive
Fedor Sergeev5bf0c152018-11-13 01:12:19 +0000334~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Fedor Sergeev6c9e19b2018-11-13 00:46:13 +0000335
336If you need to match multiple lines with the same pattern over and over again
337you can repeat a plain ``CHECK:`` as many times as needed. If that looks too
338boring you can instead use a counted check "``CHECK-COUNT-<num>:``", where
339``<num>`` is a positive decimal number. It will match the pattern exactly
340``<num>`` times, no more and no less. If you specified a custom check prefix,
341just use "``<PREFIX>-COUNT-<num>:``" for the same effect.
342Here is a simple example:
343
Fedor Sergeev8b078122018-11-13 05:47:01 +0000344.. code-block:: text
Fedor Sergeev6c9e19b2018-11-13 00:46:13 +0000345
346 Loop at depth 1
347 Loop at depth 1
348 Loop at depth 1
349 Loop at depth 1
350 Loop at depth 2
351 Loop at depth 3
352
353 ; CHECK-COUNT-6: Loop at depth {{[0-9]+}}
354 ; CHECK-NOT: Loop at depth {{[0-9]+}}
355
Michael Liao91a1b2c2013-05-14 20:34:12 +0000356The "CHECK-DAG:" directive
357~~~~~~~~~~~~~~~~~~~~~~~~~~
358
359If it's necessary to match strings that don't occur in a strictly sequential
360order, "``CHECK-DAG:``" could be used to verify them between two matches (or
361before the first match, or after the last match). For example, clang emits
362vtable globals in reverse order. Using ``CHECK-DAG:``, we can keep the checks
363in the natural order:
364
365.. code-block:: c++
366
367 // RUN: %clang_cc1 %s -emit-llvm -o - | FileCheck %s
368
369 struct Foo { virtual void method(); };
370 Foo f; // emit vtable
371 // CHECK-DAG: @_ZTV3Foo =
372
373 struct Bar { virtual void method(); };
374 Bar b;
375 // CHECK-DAG: @_ZTV3Bar =
376
Renato Golin58ab84a2013-10-11 18:50:22 +0000377``CHECK-NOT:`` directives could be mixed with ``CHECK-DAG:`` directives to
378exclude strings between the surrounding ``CHECK-DAG:`` directives. As a result,
379the surrounding ``CHECK-DAG:`` directives cannot be reordered, i.e. all
380occurrences matching ``CHECK-DAG:`` before ``CHECK-NOT:`` must not fall behind
381occurrences matching ``CHECK-DAG:`` after ``CHECK-NOT:``. For example,
382
383.. code-block:: llvm
384
385 ; CHECK-DAG: BEFORE
386 ; CHECK-NOT: NOT
387 ; CHECK-DAG: AFTER
388
389This case will reject input strings where ``BEFORE`` occurs after ``AFTER``.
Michael Liao91a1b2c2013-05-14 20:34:12 +0000390
391With captured variables, ``CHECK-DAG:`` is able to match valid topological
392orderings of a DAG with edges from the definition of a variable to its use.
393It's useful, e.g., when your test cases need to match different output
394sequences from the instruction scheduler. For example,
395
396.. code-block:: llvm
397
398 ; CHECK-DAG: add [[REG1:r[0-9]+]], r1, r2
399 ; CHECK-DAG: add [[REG2:r[0-9]+]], r3, r4
400 ; CHECK: mul r5, [[REG1]], [[REG2]]
401
402In this case, any order of that two ``add`` instructions will be allowed.
403
Renato Golin58ab84a2013-10-11 18:50:22 +0000404If you are defining `and` using variables in the same ``CHECK-DAG:`` block,
405be aware that the definition rule can match `after` its use.
406
407So, for instance, the code below will pass:
Michael Liao91a1b2c2013-05-14 20:34:12 +0000408
Renato Golin124f2592016-07-20 12:16:38 +0000409.. code-block:: text
Michael Liao91a1b2c2013-05-14 20:34:12 +0000410
Renato Golin58ab84a2013-10-11 18:50:22 +0000411 ; CHECK-DAG: vmov.32 [[REG2:d[0-9]+]][0]
412 ; CHECK-DAG: vmov.32 [[REG2]][1]
413 vmov.32 d0[1]
414 vmov.32 d0[0]
Michael Liao91a1b2c2013-05-14 20:34:12 +0000415
Renato Golin58ab84a2013-10-11 18:50:22 +0000416While this other code, will not:
417
Renato Golin124f2592016-07-20 12:16:38 +0000418.. code-block:: text
Renato Golin58ab84a2013-10-11 18:50:22 +0000419
420 ; CHECK-DAG: vmov.32 [[REG2:d[0-9]+]][0]
421 ; CHECK-DAG: vmov.32 [[REG2]][1]
422 vmov.32 d1[1]
423 vmov.32 d0[0]
424
425While this can be very useful, it's also dangerous, because in the case of
426register sequence, you must have a strong order (read before write, copy before
427use, etc). If the definition your test is looking for doesn't match (because
428of a bug in the compiler), it may match further away from the use, and mask
429real bugs away.
430
431In those cases, to enforce the order, use a non-DAG directive between DAG-blocks.
Michael Liao91a1b2c2013-05-14 20:34:12 +0000432
Joel E. Dennybcf5b442018-07-11 20:27:27 +0000433A ``CHECK-DAG:`` directive skips matches that overlap the matches of any
434preceding ``CHECK-DAG:`` directives in the same ``CHECK-DAG:`` block. Not only
435is this non-overlapping behavior consistent with other directives, but it's
436also necessary to handle sets of non-unique strings or patterns. For example,
437the following directives look for unordered log entries for two tasks in a
438parallel program, such as the OpenMP runtime:
439
440.. code-block:: text
441
442 // CHECK-DAG: [[THREAD_ID:[0-9]+]]: task_begin
443 // CHECK-DAG: [[THREAD_ID]]: task_end
444 //
445 // CHECK-DAG: [[THREAD_ID:[0-9]+]]: task_begin
446 // CHECK-DAG: [[THREAD_ID]]: task_end
447
448The second pair of directives is guaranteed not to match the same log entries
449as the first pair even though the patterns are identical and even if the text
450of the log entries is identical because the thread ID manages to be reused.
451
Stephen Linf8bd2e52013-07-12 14:51:05 +0000452The "CHECK-LABEL:" directive
Bill Wendlingc02da462013-07-30 08:26:24 +0000453~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Stephen Linf8bd2e52013-07-12 14:51:05 +0000454
455Sometimes in a file containing multiple tests divided into logical blocks, one
456or more ``CHECK:`` directives may inadvertently succeed by matching lines in a
457later block. While an error will usually eventually be generated, the check
458flagged as causing the error may not actually bear any relationship to the
459actual source of the problem.
460
461In order to produce better error messages in these cases, the "``CHECK-LABEL:``"
462directive can be used. It is treated identically to a normal ``CHECK``
Stephen Linb9464072013-07-18 23:26:58 +0000463directive except that FileCheck makes an additional assumption that a line
464matched by the directive cannot also be matched by any other check present in
465``match-filename``; this is intended to be used for lines containing labels or
466other unique identifiers. Conceptually, the presence of ``CHECK-LABEL`` divides
467the input stream into separate blocks, each of which is processed independently,
468preventing a ``CHECK:`` directive in one block matching a line in another block.
Artem Belevichf55e72a2017-03-09 17:59:04 +0000469If ``--enable-var-scope`` is in effect, all local variables are cleared at the
470beginning of the block.
471
Stephen Linb9464072013-07-18 23:26:58 +0000472For example,
Stephen Linf8bd2e52013-07-12 14:51:05 +0000473
474.. code-block:: llvm
475
476 define %struct.C* @C_ctor_base(%struct.C* %this, i32 %x) {
477 entry:
478 ; CHECK-LABEL: C_ctor_base:
479 ; CHECK: mov [[SAVETHIS:r[0-9]+]], r0
480 ; CHECK: bl A_ctor_base
481 ; CHECK: mov r0, [[SAVETHIS]]
482 %0 = bitcast %struct.C* %this to %struct.A*
483 %call = tail call %struct.A* @A_ctor_base(%struct.A* %0)
484 %1 = bitcast %struct.C* %this to %struct.B*
485 %call2 = tail call %struct.B* @B_ctor_base(%struct.B* %1, i32 %x)
486 ret %struct.C* %this
487 }
488
489 define %struct.D* @D_ctor_base(%struct.D* %this, i32 %x) {
490 entry:
491 ; CHECK-LABEL: D_ctor_base:
492
493The use of ``CHECK-LABEL:`` directives in this case ensures that the three
494``CHECK:`` directives only accept lines corresponding to the body of the
495``@C_ctor_base`` function, even if the patterns match lines found later in
Stephen Linb9464072013-07-18 23:26:58 +0000496the file. Furthermore, if one of these three ``CHECK:`` directives fail,
497FileCheck will recover by continuing to the next block, allowing multiple test
498failures to be detected in a single invocation.
Stephen Linf8bd2e52013-07-12 14:51:05 +0000499
500There is no requirement that ``CHECK-LABEL:`` directives contain strings that
501correspond to actual syntactic labels in a source or output language: they must
502simply uniquely match a single line in the file being verified.
503
504``CHECK-LABEL:`` directives cannot contain variable definitions or uses.
505
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000506FileCheck Regex Matching Syntax
507~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000508
Paul Robinson282b3d32015-03-05 23:04:26 +0000509All FileCheck directives take a pattern to match.
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000510For most uses of FileCheck, fixed string matching is perfectly sufficient. For
511some things, a more flexible form of matching is desired. To support this,
512FileCheck allows you to specify regular expressions in matching strings,
Sjoerd Meijer9a26a7e2017-10-13 14:02:36 +0000513surrounded by double braces: ``{{yourregex}}``. FileCheck implements a POSIX
514regular expression matcher; it supports Extended POSIX regular expressions
515(ERE). Because we want to use fixed string matching for a majority of what we
516do, FileCheck has been designed to support mixing and matching fixed string
517matching with regular expressions. This allows you to write things like this:
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000518
Dmitri Gribenkoa99fa5b2012-06-12 15:45:07 +0000519.. code-block:: llvm
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000520
521 ; CHECK: movhpd {{[0-9]+}}(%esp), {{%xmm[0-7]}}
522
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000523In this case, any offset from the ESP register will be allowed, and any xmm
524register will be allowed.
525
526Because regular expressions are enclosed with double braces, they are
527visually distinct, and you don't need to use escape characters within the double
528braces like you would in C. In the rare case that you want to match double
529braces explicitly from the input, you can use something ugly like
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000530``{{[{][{]}}`` as your pattern.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000531
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000532FileCheck String Substitution Blocks
533~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000534
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000535It is often useful to match a pattern and then verify that it occurs again
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000536later in the file. For codegen tests, this can be useful to allow any
537register, but verify that that register is used consistently later. To do
538this, :program:`FileCheck` supports string substitution blocks that allow
539string variables to be defined and substituted into patterns. Here is a simple
540example:
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000541
Dmitri Gribenkoa99fa5b2012-06-12 15:45:07 +0000542.. code-block:: llvm
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000543
544 ; CHECK: test5:
545 ; CHECK: notw [[REGISTER:%[a-z]+]]
Chad Rosierfd7469c2012-05-24 21:17:47 +0000546 ; CHECK: andw {{.*}}[[REGISTER]]
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000547
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000548The first check line matches a regex ``%[a-z]+`` and captures it into the
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000549string variable ``REGISTER``. The second line verifies that whatever is in
550``REGISTER`` occurs later in the file after an "``andw``". :program:`FileCheck`
551string substitution blocks are always contained in ``[[ ]]`` pairs, and string
552variable names can be formed with the regex ``[a-zA-Z_][a-zA-Z0-9_]*``. If a
553colon follows the name, then it is a definition of the variable; otherwise, it
554is a substitution.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000555
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000556:program:`FileCheck` variables can be defined multiple times, and substitutions
557always get the latest value. Variables can also be substituted later on the
558same line they were defined on. For example:
Eli Bendersky4ca99ba2012-12-01 22:03:57 +0000559
560.. code-block:: llvm
561
562 ; CHECK: op [[REG:r[0-9]+]], [[REG]]
563
564Can be useful if you want the operands of ``op`` to be the same register,
565and don't care exactly which register it is.
Dmitri Gribenkoa72e9f02012-11-14 19:42:32 +0000566
Artem Belevichf55e72a2017-03-09 17:59:04 +0000567If ``--enable-var-scope`` is in effect, variables with names that
568start with ``$`` are considered to be global. All others variables are
569local. All local variables get undefined at the beginning of each
570CHECK-LABEL block. Global variables are not affected by CHECK-LABEL.
571This makes it easier to ensure that individual tests are not affected
572by variables set in preceding tests.
573
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000574FileCheck Numeric Substitution Blocks
575~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000576
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000577:program:`FileCheck` also supports numeric substitution blocks that allow
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000578defining numeric variables and checking for numeric values that satisfy a
579numeric expression constraint based on those variables via a numeric
580substitution. This allows ``CHECK:`` directives to verify a numeric relation
581between two numbers, such as the need for consecutive registers to be used.
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000582
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000583The syntax to define a numeric variable is ``[[#<NUMVAR>:]]`` where
584``<NUMVAR>`` is the name of the numeric variable to define to the matching
585value.
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000586
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000587For example:
588
589.. code-block:: llvm
590
591 ; CHECK: mov r[[#REG:]], 42
592
593would match ``mov r5, 42`` and set ``REG`` to the value ``5``.
594
Thomas Preud'homme2a7f5202019-07-13 13:24:30 +0000595The syntax of a numeric substitution is ``[[#<expr>]]`` where ``<expr>`` is an
596expression. An expression is recursively defined as:
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000597
Thomas Preud'homme2a7f5202019-07-13 13:24:30 +0000598* a numeric operand, or
599* an expression followed by an operator and a numeric operand.
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000600
Thomas Preud'homme2a7f5202019-07-13 13:24:30 +0000601A numeric operand is a previously defined numeric variable, or an integer
602literal. The supported operators are ``+`` and ``-``. Spaces are accepted
603before, after and between any of these elements.
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000604
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000605For example:
606
607.. code-block:: llvm
608
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000609 ; CHECK: load r[[#REG:]], [r0]
610 ; CHECK: load r[[#REG+1]], [r1]
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000611
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000612The above example would match the text:
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000613
Thomas Preud'homme5c15dba2019-05-15 15:20:45 +0000614.. code-block:: gas
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000615
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000616 load r5, [r0]
617 load r6, [r1]
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000618
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000619but would not match the text:
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000620
Thomas Preud'homme5c15dba2019-05-15 15:20:45 +0000621.. code-block:: gas
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000622
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000623 load r5, [r0]
624 load r7, [r1]
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000625
626due to ``7`` being unequal to ``5 + 1``.
627
Thomas Preud'homme4cd9b852019-07-24 12:38:22 +0000628The syntax also supports an empty expression, equivalent to writing {{[0-9]+}},
629for cases where the input must contain a numeric value but the value itself
630does not matter:
631
632.. code-block:: gas
633
634 ; CHECK-NOT: mov r0, r[[#]]
635
636to check that a value is synthesized rather than moved around.
637
638A numeric variable can also be defined to the result of a numeric expression,
639in which case the numeric expression is checked and if verified the variable is
640assigned to the value. The unified syntax for both defining numeric variables
641and checking a numeric expression is thus ``[[#<NUMVAR>: <expr>]]`` with each
642element as described previously.
643
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000644The ``--enable-var-scope`` option has the same effect on numeric variables as
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000645on string variables.
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000646
Thomas Preud'hommea2ef1ba2019-06-19 23:47:24 +0000647Important note: In its current implementation, an expression cannot use a
Thomas Preud'homme4cd9b852019-07-24 12:38:22 +0000648numeric variable with a non-empty expression defined on the same line.
Thomas Preud'homme71d3f222019-06-06 13:21:06 +0000649
Thomas Preud'homme7b4ecdd2019-05-14 11:58:30 +0000650FileCheck Pseudo Numeric Variables
651~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Alexander Kornienko92987fb2012-11-14 21:07:37 +0000652
Thomas Preud'homme288ed912019-05-02 00:04:38 +0000653Sometimes there's a need to verify output that contains line numbers of the
Dmitri Gribenkof589e242012-11-29 19:21:02 +0000654match file, e.g. when testing compiler diagnostics. This introduces a certain
655fragility of the match file structure, as "``CHECK:``" lines contain absolute
656line numbers in the same file, which have to be updated whenever line numbers
657change due to text addition or deletion.
Alexander Kornienko92987fb2012-11-14 21:07:37 +0000658
Thomas Preud'hommea2ef1ba2019-06-19 23:47:24 +0000659To support this case, FileCheck expressions understand the ``@LINE`` pseudo
660numeric variable which evaluates to the line number of the CHECK pattern where
661it is found.
Alexander Kornienko92987fb2012-11-14 21:07:37 +0000662
663This way match patterns can be put near the relevant test lines and include
664relative line number references, for example:
665
666.. code-block:: c++
667
Thomas Preud'homme288ed912019-05-02 00:04:38 +0000668 // CHECK: test.cpp:[[# @LINE + 4]]:6: error: expected ';' after top level declarator
Alexander Kornienko92987fb2012-11-14 21:07:37 +0000669 // CHECK-NEXT: {{^int a}}
670 // CHECK-NEXT: {{^ \^}}
671 // CHECK-NEXT: {{^ ;}}
672 int a
673
Thomas Preud'homme1a944d22019-05-23 00:10:14 +0000674To support legacy uses of ``@LINE`` as a special string variable,
675:program:`FileCheck` also accepts the following uses of ``@LINE`` with string
676substitution block syntax: ``[[@LINE]]``, ``[[@LINE+<offset>]]`` and
Thomas Preud'homme288ed912019-05-02 00:04:38 +0000677``[[@LINE-<offset>]]`` without any spaces inside the brackets and where
678``offset`` is an integer.
679
Wolfgang Pieb0b4509e2016-06-27 23:59:00 +0000680Matching Newline Characters
681~~~~~~~~~~~~~~~~~~~~~~~~~~~
682
683To match newline characters in regular expressions the character class
684``[[:space:]]`` can be used. For example, the following pattern:
685
686.. code-block:: c++
687
688 // CHECK: DW_AT_location [DW_FORM_sec_offset] ([[DLOC:0x[0-9a-f]+]]){{[[:space:]].*}}"intd"
689
690matches output of the form (from llvm-dwarfdump):
691
Renato Golin124f2592016-07-20 12:16:38 +0000692.. code-block:: text
Wolfgang Pieb0b4509e2016-06-27 23:59:00 +0000693
694 DW_AT_location [DW_FORM_sec_offset] (0x00000233)
695 DW_AT_name [DW_FORM_strp] ( .debug_str[0x000000c9] = "intd")
696
697letting us set the :program:`FileCheck` variable ``DLOC`` to the desired value
698``0x00000233``, extracted from the line immediately preceding "``intd``".