blob: 4a8ce933e1a5ffad741dc02032635563c78fe73f [file] [log] [blame]
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +00001bugpoint - automatic test case reduction tool
2=============================================
3
James Hendersona0566842019-06-27 13:24:46 +00004.. program:: bugpoint
5
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +00006SYNOPSIS
7--------
8
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +00009**bugpoint** [*options*] [*input LLVM ll/bc files*] [*LLVM passes*] **--args**
10*program arguments*
11
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000012DESCRIPTION
13-----------
14
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000015**bugpoint** narrows down the source of problems in LLVM tools and passes. It
16can be used to debug three types of failures: optimizer crashes, miscompilations
17by optimizers, or bad native code generation (including problems in the static
18and JIT compilers). It aims to reduce large test cases to small, useful ones.
19For more information on the design and inner workings of **bugpoint**, as well as
Sean Silvac28b4952016-03-23 00:31:21 +000020advice for using bugpoint, see :doc:`/Bugpoint` in the LLVM
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000021distribution.
22
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000023OPTIONS
24-------
25
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000026**--additional-so** *library*
27
28 Load the dynamic shared object *library* into the test program whenever it is
29 run. This is useful if you are debugging programs which depend on non-LLVM
30 libraries (such as the X or curses libraries) to run.
31
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000032**--append-exit-code**\ =\ *{true,false}*
33
34 Append the test programs exit code to the output file so that a change in exit
35 code is considered a test failure. Defaults to false.
36
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000037**--args** *program args*
38
Dmitri Gribenko5cb3f102012-11-28 21:40:54 +000039 Pass all arguments specified after **--args** to the test program whenever it runs.
40 Note that if any of the *program args* start with a "``-``", you should use:
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000041
Dmitri Gribenko194d3682012-11-29 12:00:32 +000042 .. code-block:: bash
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000043
44 bugpoint [bugpoint args] --args -- [program args]
45
Dmitri Gribenko5cb3f102012-11-28 21:40:54 +000046 The "``--``" right after the **--args** option tells **bugpoint** to consider
47 any options starting with "``-``" to be part of the **--args** option, not as
48 options to **bugpoint** itself.
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000049
50**--tool-args** *tool args*
51
Dmitri Gribenko5cb3f102012-11-28 21:40:54 +000052 Pass all arguments specified after **--tool-args** to the LLVM tool under test
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000053 (**llc**, **lli**, etc.) whenever it runs. You should use this option in the
54 following way:
55
Dmitri Gribenko194d3682012-11-29 12:00:32 +000056 .. code-block:: bash
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000057
58 bugpoint [bugpoint args] --tool-args -- [tool args]
59
Dmitri Gribenko5cb3f102012-11-28 21:40:54 +000060 The "``--``" right after the **--tool-args** option tells **bugpoint** to
61 consider any options starting with "``-``" to be part of the **--tool-args**
62 option, not as options to **bugpoint** itself. (See **--args**, above.)
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000063
64**--safe-tool-args** *tool args*
65
66 Pass all arguments specified after **--safe-tool-args** to the "safe" execution
67 tool.
68
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000069**--gcc-tool-args** *gcc tool args*
70
71 Pass all arguments specified after **--gcc-tool-args** to the invocation of
72 **gcc**.
73
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000074**--opt-args** *opt args*
75
76 Pass all arguments specified after **--opt-args** to the invocation of **opt**.
77
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000078**--disable-{dce,simplifycfg}**
79
80 Do not run the specified passes to clean up and reduce the size of the test
81 program. By default, **bugpoint** uses these passes internally when attempting to
82 reduce test programs. If you're trying to find a bug in one of these passes,
83 **bugpoint** may crash.
84
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000085**--enable-valgrind**
86
87 Use valgrind to find faults in the optimization phase. This will allow
88 bugpoint to find otherwise asymptomatic problems caused by memory
89 mis-management.
90
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000091**-find-bugs**
92
93 Continually randomize the specified passes and run them on the test program
94 until a bug is found or the user kills **bugpoint**.
95
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +000096**-help**
97
98 Print a summary of command line options.
99
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000100**--input** *filename*
101
102 Open *filename* and redirect the standard input of the test program, whenever
103 it runs, to come from that file.
104
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000105**--load** *plugin*
106
107 Load the dynamic object *plugin* into **bugpoint** itself. This object should
108 register new optimization passes. Once loaded, the object will add new command
109 line options to enable various optimizations. To see the new complete list of
110 optimizations, use the **-help** and **--load** options together; for example:
111
112
Dmitri Gribenko194d3682012-11-29 12:00:32 +0000113 .. code-block:: bash
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000114
115 bugpoint --load myNewPass.so -help
116
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000117**--mlimit** *megabytes*
118
119 Specifies an upper limit on memory usage of the optimization and codegen. Set
120 to zero to disable the limit.
121
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000122**--output** *filename*
123
124 Whenever the test program produces output on its standard output stream, it
125 should match the contents of *filename* (the "reference output"). If you
126 do not use this option, **bugpoint** will attempt to generate a reference output
127 by compiling the program with the "safe" backend and running it.
128
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000129**--run-{int,jit,llc,custom}**
130
131 Whenever the test program is compiled, **bugpoint** should generate code for it
132 using the specified code generator. These options allow you to choose the
133 interpreter, the JIT compiler, the static native code compiler, or a
134 custom command (see **--exec-command**) respectively.
135
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000136**--safe-{llc,custom}**
137
138 When debugging a code generator, **bugpoint** should use the specified code
139 generator as the "safe" code generator. This is a known-good code generator
140 used to generate the "reference output" if it has not been provided, and to
141 compile portions of the program that as they are excluded from the testcase.
142 These options allow you to choose the
143 static native code compiler, or a custom command, (see **--exec-command**)
144 respectively. The interpreter and the JIT backends cannot currently
145 be used as the "safe" backends.
146
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000147**--exec-command** *command*
148
149 This option defines the command to use with the **--run-custom** and
150 **--safe-custom** options to execute the bitcode testcase. This can
151 be useful for cross-compilation.
152
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000153**--compile-command** *command*
154
155 This option defines the command to use with the **--compile-custom**
Sean Silva232c3312016-03-23 00:25:13 +0000156 option to compile the bitcode testcase. The command should exit with a
157 failure exit code if the file is "interesting" and should exit with a
158 success exit code (i.e. 0) otherwise (this is the same as if it crashed on
159 "interesting" inputs).
160
161 This can be useful for
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000162 testing compiler output without running any link or execute stages. To
163 generate a reduced unit test, you may add CHECK directives to the
164 testcase and pass the name of an executable compile-command script in this form:
165
Dmitri Gribenkoa99fa5b2012-06-12 15:45:07 +0000166 .. code-block:: sh
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000167
168 #!/bin/sh
169 llc "$@"
170 not FileCheck [bugpoint input file].ll < bugpoint-test-program.s
171
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000172 This script will "fail" as long as FileCheck passes. So the result
173 will be the minimum bitcode that passes FileCheck.
174
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000175**--safe-path** *path*
176
177 This option defines the path to the command to execute with the
178 **--safe-{int,jit,llc,custom}**
179 option.
180
Sebastian Pop8f7d0192016-07-15 23:15:06 +0000181**--verbose-errors**\ =\ *{true,false}*
182
183 The default behavior of bugpoint is to print "<crash>" when it finds a reduced
184 test that crashes compilation. This flag prints the output of the crashing
185 program to stderr. This is useful to make sure it is the same error being
186 tracked down and not a different error that happens to crash the compiler as
187 well. Defaults to false.
188
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000189EXIT STATUS
190-----------
191
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000192If **bugpoint** succeeds in finding a problem, it will exit with 0. Otherwise,
193if an error occurs, it will exit with a non-zero value.
194
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000195SEE ALSO
196--------
197
Daniel Dunbar8f4a8a62012-05-08 16:50:35 +0000198opt|opt