blob: 4d80a2a6e1638b27aafa21213ebec90042d3ecc8 [file] [log] [blame]
Mikhail Glushenkov270cae32008-05-30 06:25:24 +00001===================================
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +00002Customizing LLVMC: Reference Manual
3===================================
Mikhail Glushenkov23f522a2008-12-13 17:51:47 +00004..
5 This file was automatically generated by rst2html.
6 Please do not edit directly!
7 The ReST source lives in the directory 'tools/llvmc/doc'.
Mikhail Glushenkovd5652032008-12-13 02:28:58 +00008
9.. contents::
10
11.. raw:: html
12
13 <div class="doc_author">
14 <p>Written by <a href="mailto:foldr@codedgers.com">Mikhail Glushenkov</a></p>
15 </div>
16
17Introduction
18============
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000019
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +000020LLVMC is a generic compiler driver, designed to be customizable and
21extensible. It plays the same role for LLVM as the ``gcc`` program
22does for GCC - LLVMC's job is essentially to transform a set of input
23files into a set of targets depending on configuration rules and user
24options. What makes LLVMC different is that these transformation rules
25are completely customizable - in fact, LLVMC knows nothing about the
26specifics of transformation (even the command-line options are mostly
27not hard-coded) and regards the transformation structure as an
Mikhail Glushenkov83237482008-10-15 09:29:13 +000028abstract graph. The structure of this graph is completely determined
29by plugins, which can be either statically or dynamically linked. This
30makes it possible to easily adapt LLVMC for other purposes - for
31example, as a build tool for game resources.
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000032
Mikhail Glushenkovd5652032008-12-13 02:28:58 +000033Because LLVMC employs TableGen_ as its configuration language, you
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +000034need to be familiar with it to customize LLVMC.
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000035
Mikhail Glushenkov4aecec12009-06-17 02:56:08 +000036.. _TableGen: http://llvm.org/docs/TableGenFundamentals.html
Mikhail Glushenkov270cae32008-05-30 06:25:24 +000037
38
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +000039Compiling with LLVMC
Mikhail Glushenkov270cae32008-05-30 06:25:24 +000040====================
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000041
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +000042LLVMC tries hard to be as compatible with ``gcc`` as possible,
43although there are some small differences. Most of the time, however,
44you shouldn't be able to notice them::
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000045
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +000046 $ # This works as expected:
Mikhail Glushenkov113ec352008-11-25 21:38:12 +000047 $ llvmc -O3 -Wall hello.cpp
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +000048 $ ./a.out
49 hello
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000050
Mikhail Glushenkov4aecec12009-06-17 02:56:08 +000051One nice feature of LLVMC is that one doesn't have to distinguish between
52different compilers for different languages (think ``g++`` vs. ``gcc``) - the
53right toolchain is chosen automatically based on input language names (which
54are, in turn, determined from file extensions). If you want to force files
55ending with ".c" to compile as C++, use the ``-x`` option, just like you would
56do it with ``gcc``::
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000057
Mikhail Glushenkovebdeca72008-11-25 21:34:29 +000058 $ # hello.c is really a C++ file
Mikhail Glushenkov113ec352008-11-25 21:38:12 +000059 $ llvmc -x c++ hello.c
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +000060 $ ./a.out
61 hello
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000062
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +000063On the other hand, when using LLVMC as a linker to combine several C++
64object files you should provide the ``--linker`` option since it's
65impossible for LLVMC to choose the right linker in that case::
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000066
Mikhail Glushenkov113ec352008-11-25 21:38:12 +000067 $ llvmc -c hello.cpp
68 $ llvmc hello.o
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +000069 [A lot of link-time errors skipped]
Mikhail Glushenkov113ec352008-11-25 21:38:12 +000070 $ llvmc --linker=c++ hello.o
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +000071 $ ./a.out
72 hello
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +000073
Mikhail Glushenkove8e4d582009-06-30 00:16:22 +000074By default, LLVMC uses ``llvm-gcc`` to compile the source code. It is also
75possible to choose the ``clang`` compiler with the ``-clang`` option.
Mikhail Glushenkov4410e322008-12-07 16:47:42 +000076
Mikhail Glushenkov83237482008-10-15 09:29:13 +000077
Mikhail Glushenkov270cae32008-05-30 06:25:24 +000078Predefined options
79==================
80
81LLVMC has some built-in options that can't be overridden in the
Mikhail Glushenkov7e6d70a2008-11-26 22:59:45 +000082configuration libraries:
Mikhail Glushenkov270cae32008-05-30 06:25:24 +000083
84* ``-o FILE`` - Output file name.
85
86* ``-x LANGUAGE`` - Specify the language of the following input files
87 until the next -x option.
88
Mikhail Glushenkov83237482008-10-15 09:29:13 +000089* ``-load PLUGIN_NAME`` - Load the specified plugin DLL. Example:
90 ``-load $LLVM_DIR/Release/lib/LLVMCSimple.so``.
91
Mikhail Glushenkov270cae32008-05-30 06:25:24 +000092* ``-v`` - Enable verbose mode, i.e. print out all executed commands.
93
Mikhail Glushenkov294f5072009-06-25 18:20:44 +000094* ``--save-temps`` - Write temporary files to the current directory and do not
95 delete them on exit. This option can also take an argument: the
96 ``--save-temps=obj`` switch will write files into the directory specified with
97 the ``-o`` option. The ``--save-temps=cwd`` and ``--save-temps`` switches are
98 both synonyms for the default behaviour.
99
Mikhail Glushenkov09826e32009-07-11 19:27:40 +0000100* ``--temp-dir DIRECTORY`` - Store temporary files in the given directory. This
101 directory is deleted on exit unless ``--save-temps`` is specified. If
102 ``--save-temps=obj`` is also specified, ``--temp-dir`` is given the
103 precedence.
Mikhail Glushenkov792f1822009-07-09 19:39:16 +0000104
Mikhail Glushenkov4ad0d572009-03-27 12:58:29 +0000105* ``--check-graph`` - Check the compilation for common errors like mismatched
106 output/input language names, multiple default edges and cycles. Because of
Mikhail Glushenkov530f3992009-06-16 00:13:52 +0000107 plugins, these checks can't be performed at compile-time. Exit with code zero
108 if no errors were found, and return the number of found errors
109 otherwise. Hidden option, useful for debugging LLVMC plugins.
Mikhail Glushenkovf8c430b2009-01-09 16:16:27 +0000110
Mikhail Glushenkov4ad0d572009-03-27 12:58:29 +0000111* ``--view-graph`` - Show a graphical representation of the compilation graph
112 and exit. Requires that you have ``dot`` and ``gv`` programs installed. Hidden
113 option, useful for debugging LLVMC plugins.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000114
Mikhail Glushenkov4ad0d572009-03-27 12:58:29 +0000115* ``--write-graph`` - Write a ``compilation-graph.dot`` file in the current
116 directory with the compilation graph description in Graphviz format (identical
Mikhail Glushenkov530f3992009-06-16 00:13:52 +0000117 to the file used by the ``--view-graph`` option). The ``-o`` option can be
118 used to set the output file name. Hidden option, useful for debugging LLVMC
119 plugins.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000120
Mikhail Glushenkov73296102008-05-30 06:29:17 +0000121* ``--help``, ``--help-hidden``, ``--version`` - These options have
122 their standard meaning.
123
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000124Compiling LLVMC plugins
125=======================
126
127It's easiest to start working on your own LLVMC plugin by copying the
128skeleton project which lives under ``$LLVMC_DIR/plugins/Simple``::
129
130 $ cd $LLVMC_DIR/plugins
131 $ cp -r Simple MyPlugin
132 $ cd MyPlugin
133 $ ls
134 Makefile PluginMain.cpp Simple.td
135
136As you can see, our basic plugin consists of only two files (not
137counting the build script). ``Simple.td`` contains TableGen
138description of the compilation graph; its format is documented in the
139following sections. ``PluginMain.cpp`` is just a helper file used to
140compile the auto-generated C++ code produced from TableGen source. It
141can also contain hook definitions (see `below`__).
142
143__ hooks_
144
145The first thing that you should do is to change the ``LLVMC_PLUGIN``
146variable in the ``Makefile`` to avoid conflicts (since this variable
147is used to name the resulting library)::
148
149 LLVMC_PLUGIN=MyPlugin
150
151It is also a good idea to rename ``Simple.td`` to something less
152generic::
153
154 $ mv Simple.td MyPlugin.td
155
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000156To build your plugin as a dynamic library, just ``cd`` to its source
157directory and run ``make``. The resulting file will be called
Mikhail Glushenkov4aecec12009-06-17 02:56:08 +0000158``plugin_llvmc_$(LLVMC_PLUGIN).$(DLL_EXTENSION)`` (in our case,
159``plugin_llvmc_MyPlugin.so``). This library can be then loaded in with the
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000160``-load`` option. Example::
161
162 $ cd $LLVMC_DIR/plugins/Simple
163 $ make
Mikhail Glushenkov4aecec12009-06-17 02:56:08 +0000164 $ llvmc -load $LLVM_DIR/Release/lib/plugin_llvmc_Simple.so
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000165
Mikhail Glushenkov530f3992009-06-16 00:13:52 +0000166Compiling standalone LLVMC-based drivers
167========================================
168
169By default, the ``llvmc`` executable consists of a driver core plus several
170statically linked plugins (``Base`` and ``Clang`` at the moment). You can
171produce a standalone LLVMC-based driver executable by linking the core with your
172own plugins. The recommended way to do this is by starting with the provided
173``Skeleton`` example (``$LLVMC_DIR/example/Skeleton``)::
174
175 $ cd $LLVMC_DIR/example/
176 $ cp -r Skeleton mydriver
177 $ cd mydriver
178 $ vim Makefile
179 [...]
180 $ make
181
182If you're compiling LLVM with different source and object directories, then you
183must perform the following additional steps before running ``make``::
184
185 # LLVMC_SRC_DIR = $LLVM_SRC_DIR/tools/llvmc/
186 # LLVMC_OBJ_DIR = $LLVM_OBJ_DIR/tools/llvmc/
187 $ cp $LLVMC_SRC_DIR/example/mydriver/Makefile \
188 $LLVMC_OBJ_DIR/example/mydriver/
189 $ cd $LLVMC_OBJ_DIR/example/mydriver
190 $ make
191
192Another way to do the same thing is by using the following command::
193
194 $ cd $LLVMC_DIR
195 $ make LLVMC_BUILTIN_PLUGINS=MyPlugin LLVMC_BASED_DRIVER_NAME=mydriver
196
Mikhail Glushenkov4aecec12009-06-17 02:56:08 +0000197This works with both srcdir == objdir and srcdir != objdir, but assumes that the
Mikhail Glushenkov530f3992009-06-16 00:13:52 +0000198plugin source directory was placed under ``$LLVMC_DIR/plugins``.
199
Mikhail Glushenkovf80f0aa2008-11-25 21:34:01 +0000200Sometimes, you will want a 'bare-bones' version of LLVMC that has no
201built-in plugins. It can be compiled with the following command::
202
203 $ cd $LLVMC_DIR
Mikhail Glushenkov530f3992009-06-16 00:13:52 +0000204 $ make LLVMC_BUILTIN_PLUGINS=""
Mikhail Glushenkovf80f0aa2008-11-25 21:34:01 +0000205
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000206
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000207Customizing LLVMC: the compilation graph
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000208========================================
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000209
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000210Each TableGen configuration file should include the common
211definitions::
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000212
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000213 include "llvm/CompilerDriver/Common.td"
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +0000214
215Internally, LLVMC stores information about possible source
216transformations in form of a graph. Nodes in this graph represent
217tools, and edges between two nodes represent a transformation path. A
218special "root" node is used to mark entry points for the
219transformations. LLVMC also assigns a weight to each edge (more on
220this later) to choose between several alternative edges.
221
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000222The definition of the compilation graph (see file
223``plugins/Base/Base.td`` for an example) is just a list of edges::
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000224
225 def CompilationGraph : CompilationGraph<[
Mikhail Glushenkov01088772008-11-17 17:29:18 +0000226 Edge<"root", "llvm_gcc_c">,
227 Edge<"root", "llvm_gcc_assembler">,
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000228 ...
229
Mikhail Glushenkov01088772008-11-17 17:29:18 +0000230 Edge<"llvm_gcc_c", "llc">,
231 Edge<"llvm_gcc_cpp", "llc">,
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000232 ...
233
Mikhail Glushenkov536637f2008-11-25 21:34:53 +0000234 OptionalEdge<"llvm_gcc_c", "opt", (case (switch_on "opt"),
235 (inc_weight))>,
236 OptionalEdge<"llvm_gcc_cpp", "opt", (case (switch_on "opt"),
237 (inc_weight))>,
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000238 ...
239
Mikhail Glushenkov01088772008-11-17 17:29:18 +0000240 OptionalEdge<"llvm_gcc_assembler", "llvm_gcc_cpp_linker",
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +0000241 (case (input_languages_contain "c++"), (inc_weight),
242 (or (parameter_equals "linker", "g++"),
243 (parameter_equals "linker", "c++")), (inc_weight))>,
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000244 ...
245
246 ]>;
247
248As you can see, the edges can be either default or optional, where
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000249optional edges are differentiated by an additional ``case`` expression
Mikhail Glushenkov01088772008-11-17 17:29:18 +0000250used to calculate the weight of this edge. Notice also that we refer
Mikhail Glushenkovf80f0aa2008-11-25 21:34:01 +0000251to tools via their names (as strings). This makes it possible to add
252edges to an existing compilation graph in plugins without having to
253know about all tool definitions used in the graph.
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000254
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +0000255The default edges are assigned a weight of 1, and optional edges get a
256weight of 0 + 2*N where N is the number of tests that evaluated to
257true in the ``case`` expression. It is also possible to provide an
258integer parameter to ``inc_weight`` and ``dec_weight`` - in this case,
259the weight is increased (or decreased) by the provided value instead
Mikhail Glushenkov7e6d70a2008-11-26 22:59:45 +0000260of the default 2. It is also possible to change the default weight of
261an optional edge by using the ``default`` clause of the ``case``
262construct.
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +0000263
264When passing an input file through the graph, LLVMC picks the edge
265with the maximum weight. To avoid ambiguity, there should be only one
266default edge between two nodes (with the exception of the root node,
267which gets a special treatment - there you are allowed to specify one
268default edge *per language*).
269
Mikhail Glushenkov7e6d70a2008-11-26 22:59:45 +0000270When multiple plugins are loaded, their compilation graphs are merged
Mikhail Glushenkov3321b0f2008-11-28 00:12:09 +0000271together. Since multiple edges that have the same end nodes are not
272allowed (i.e. the graph is not a multigraph), an edge defined in
Mikhail Glushenkov7e6d70a2008-11-26 22:59:45 +0000273several plugins will be replaced by the definition from the plugin
274that was loaded last. Plugin load order can be controlled by using the
275plugin priority feature described above.
276
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +0000277To get a visual representation of the compilation graph (useful for
Mikhail Glushenkov113ec352008-11-25 21:38:12 +0000278debugging), run ``llvmc --view-graph``. You will need ``dot`` and
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +0000279``gsview`` installed for this to work properly.
280
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000281Describing options
282==================
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +0000283
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000284Command-line options that the plugin supports are defined by using an
285``OptionList``::
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000286
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000287 def Options : OptionList<[
288 (switch_option "E", (help "Help string")),
289 (alias_option "quiet", "q")
290 ...
291 ]>;
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000292
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000293As you can see, the option list is just a list of DAGs, where each DAG
294is an option description consisting of the option name and some
295properties. A plugin can define more than one option list (they are
296all merged together in the end), which can be handy if one wants to
297separate option groups syntactically.
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000298
299* Possible option types:
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000300
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000301 - ``switch_option`` - a simple boolean switch without arguments, for example
302 ``-O2`` or ``-time``. At most one occurrence is allowed.
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000303
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000304 - ``parameter_option`` - option that takes one argument, for example
305 ``-std=c99``. It is also allowed to use spaces instead of the equality
306 sign: ``-std c99``. At most one occurrence is allowed.
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000307
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000308 - ``parameter_list_option`` - same as the above, but more than one option
309 occurence is allowed.
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000310
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000311 - ``prefix_option`` - same as the parameter_option, but the option name and
312 argument do not have to be separated. Example: ``-ofile``. This can be also
313 specified as ``-o file``; however, ``-o=file`` will be parsed incorrectly
314 (``=file`` will be interpreted as option value). At most one occurrence is
315 allowed.
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000316
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000317 - ``prefix_list_option`` - same as the above, but more than one occurence of
318 the option is allowed; example: ``-lm -lpthread``.
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000319
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000320 - ``alias_option`` - a special option type for creating aliases. Unlike other
321 option types, aliases are not allowed to have any properties besides the
322 aliased option name. Usage example: ``(alias_option "preprocess", "E")``
Mikhail Glushenkov0ab8ac32008-05-30 06:28:00 +0000323
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000324
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000325* Possible option properties:
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000326
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000327 - ``help`` - help string associated with this option. Used for ``--help``
328 output.
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000329
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000330 - ``required`` - this option must be specified exactly once (or, in case of
331 the list options without the ``multi_val`` property, at least
332 once). Incompatible with ``zero_or_one`` and ``one_or_more``.
333
334 - ``one_or_more`` - the option must be specified at least one time. Useful
335 only for list options in conjunction with ``multi_val``; for ordinary lists
336 it is synonymous with ``required``. Incompatible with ``required`` and
337 ``zero_or_one``.
338
Mikhail Glushenkove4ac23a2009-12-15 03:04:52 +0000339 - ``optional`` - the option can be specified zero or one times. Useful only
340 for list options in conjunction with ``multi_val``. Incompatible with
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000341 ``required`` and ``one_or_more``.
Mikhail Glushenkov77ddce92008-05-06 18:17:19 +0000342
Mikhail Glushenkovf9b1d792009-01-15 02:42:40 +0000343 - ``hidden`` - the description of this option will not appear in
344 the ``--help`` output (but will appear in the ``--help-hidden``
345 output).
Mikhail Glushenkov739c7202008-11-28 00:13:25 +0000346
Mikhail Glushenkovf9b1d792009-01-15 02:42:40 +0000347 - ``really_hidden`` - the option will not be mentioned in any help
Mikhail Glushenkov739c7202008-11-28 00:13:25 +0000348 output.
349
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000350 - ``comma_separated`` - Indicates that any commas specified for an option's
351 value should be used to split the value up into multiple values for the
352 option. This property is valid only for list options. In conjunction with
353 ``forward_value`` can be used to implement option forwarding in style of
354 gcc's ``-Wa,``.
355
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000356 - ``multi_val n`` - this option takes *n* arguments (can be useful in some
357 special cases). Usage example: ``(parameter_list_option "foo", (multi_val
Mikhail Glushenkov4e613872009-10-21 02:13:52 +0000358 3))``; the command-line syntax is '-foo a b c'. Only list options can have
Mikhail Glushenkove4ac23a2009-12-15 03:04:52 +0000359 this attribute; you can, however, use the ``one_or_more``, ``optional``
Mikhail Glushenkov4e613872009-10-21 02:13:52 +0000360 and ``required`` properties.
Mikhail Glushenkov19d3e822009-01-28 03:47:20 +0000361
Mikhail Glushenkovdad78202009-07-07 16:09:29 +0000362 - ``init`` - this option has a default value, either a string (if it is a
Mikhail Glushenkov68d475a2009-12-15 03:03:37 +0000363 parameter), or a boolean (if it is a switch; as in C++, boolean constants
364 are called ``true`` and ``false``). List options can't have ``init``
365 attribute.
366 Usage examples: ``(switch_option "foo", (init true))``; ``(prefix_option
367 "bar", (init "baz"))``.
Mikhail Glushenkovdad78202009-07-07 16:09:29 +0000368
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000369 - ``extern`` - this option is defined in some other plugin, see `below`__.
370
371 __ extern_
372
373.. _extern:
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000374
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000375External options
376----------------
Mikhail Glushenkov0ab8ac32008-05-30 06:28:00 +0000377
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000378Sometimes, when linking several plugins together, one plugin needs to
379access options defined in some other plugin. Because of the way
Mikhail Glushenkovf9b1d792009-01-15 02:42:40 +0000380options are implemented, such options must be marked as
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000381``extern``. This is what the ``extern`` option property is
382for. Example::
Mikhail Glushenkov0ab8ac32008-05-30 06:28:00 +0000383
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000384 ...
385 (switch_option "E", (extern))
386 ...
Mikhail Glushenkov0ab8ac32008-05-30 06:28:00 +0000387
Mikhail Glushenkovbb41b2d2009-07-07 16:43:49 +0000388If an external option has additional attributes besides 'extern', they are
389ignored. See also the section on plugin `priorities`__.
Mikhail Glushenkov0ab8ac32008-05-30 06:28:00 +0000390
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000391__ priorities_
Mikhail Glushenkov0ab8ac32008-05-30 06:28:00 +0000392
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000393.. _case:
Mikhail Glushenkov83237482008-10-15 09:29:13 +0000394
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000395Conditional evaluation
396======================
Mikhail Glushenkov0ab8ac32008-05-30 06:28:00 +0000397
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000398The 'case' construct is the main means by which programmability is
399achieved in LLVMC. It can be used to calculate edge weights, program
400actions and modify the shell commands to be executed. The 'case'
401expression is designed after the similarly-named construct in
402functional languages and takes the form ``(case (test_1), statement_1,
403(test_2), statement_2, ... (test_N), statement_N)``. The statements
404are evaluated only if the corresponding tests evaluate to true.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000405
406Examples::
407
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000408 // Edge weight calculation
409
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000410 // Increases edge weight by 5 if "-A" is provided on the
411 // command-line, and by 5 more if "-B" is also provided.
412 (case
413 (switch_on "A"), (inc_weight 5),
414 (switch_on "B"), (inc_weight 5))
415
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000416
417 // Tool command line specification
418
419 // Evaluates to "cmdline1" if the option "-A" is provided on the
420 // command line; to "cmdline2" if "-B" is provided;
421 // otherwise to "cmdline3".
422
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000423 (case
424 (switch_on "A"), "cmdline1",
425 (switch_on "B"), "cmdline2",
426 (default), "cmdline3")
427
428Note the slight difference in 'case' expression handling in contexts
429of edge weights and command line specification - in the second example
430the value of the ``"B"`` switch is never checked when switch ``"A"`` is
431enabled, and the whole expression always evaluates to ``"cmdline1"`` in
432that case.
433
434Case expressions can also be nested, i.e. the following is legal::
435
436 (case (switch_on "E"), (case (switch_on "o"), ..., (default), ...)
437 (default), ...)
438
439You should, however, try to avoid doing that because it hurts
440readability. It is usually better to split tool descriptions and/or
441use TableGen inheritance instead.
442
443* Possible tests are:
444
Mikhail Glushenkov3e4102e2009-10-25 01:44:11 +0000445 - ``switch_on`` - Returns true if a given command-line switch is provided by
446 the user. Can be given a list as argument, in that case ``(switch_on ["foo",
447 "bar", "baz"])`` is equivalent to ``(and (switch_on "foo"), (switch_on
448 "bar"), (switch_on "baz"))``.
449 Example: ``(switch_on "opt")``.
450
451 - ``any_switch_on`` - Given a list of switch options, returns true if any of
452 the switches is turned on.
453 Example: ``(any_switch_on ["foo", "bar", "baz"])`` is equivalent to ``(or
454 (switch_on "foo"), (switch_on "bar"), (switch_on "baz"))``.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000455
456 - ``parameter_equals`` - Returns true if a command-line parameter equals
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000457 a given value.
458 Example: ``(parameter_equals "W", "all")``.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000459
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000460 - ``element_in_list`` - Returns true if a command-line parameter
461 list contains a given value.
Mikhail Glushenkov4227c0f2009-12-01 09:19:09 +0000462 Example: ``(element_in_list "l", "pthread")``.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000463
464 - ``input_languages_contain`` - Returns true if a given language
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000465 belongs to the current input language set.
466 Example: ``(input_languages_contain "c++")``.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000467
Mikhail Glushenkov3e4102e2009-10-25 01:44:11 +0000468 - ``in_language`` - Evaluates to true if the input file language is equal to
469 the argument. At the moment works only with ``cmd_line`` and ``actions`` (on
470 non-join nodes).
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000471 Example: ``(in_language "c++")``.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000472
Mikhail Glushenkov3e4102e2009-10-25 01:44:11 +0000473 - ``not_empty`` - Returns true if a given option (which should be either a
474 parameter or a parameter list) is set by the user. Like ``switch_on``, can
475 be also given a list as argument.
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000476 Example: ``(not_empty "o")``.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000477
Mikhail Glushenkov3e4102e2009-10-25 01:44:11 +0000478 - ``any_not_empty`` - Returns true if ``not_empty`` returns true for any of
479 the options in the list.
480 Example: ``(any_not_empty ["foo", "bar", "baz"])`` is equivalent to ``(or
481 (not_empty "foo"), (not_empty "bar"), (not_empty "baz"))``.
482
Mikhail Glushenkov5c2b6b22008-12-17 02:47:01 +0000483 - ``empty`` - The opposite of ``not_empty``. Equivalent to ``(not (not_empty
Mikhail Glushenkov3e4102e2009-10-25 01:44:11 +0000484 X))``. Provided for convenience. Can be given a list as argument.
485
486 - ``any_not_empty`` - Returns true if ``not_empty`` returns true for any of
487 the options in the list.
488 Example: ``(any_empty ["foo", "bar", "baz"])`` is equivalent to ``(not (and
489 (not_empty "foo"), (not_empty "bar"), (not_empty "baz")))``.
Mikhail Glushenkov5c2b6b22008-12-17 02:47:01 +0000490
Mikhail Glushenkovad981bf2009-09-28 01:16:42 +0000491 - ``single_input_file`` - Returns true if there was only one input file
492 provided on the command-line. Used without arguments:
493 ``(single_input_file)``.
494
495 - ``multiple_input_files`` - Equivalent to ``(not (single_input_file))`` (the
496 case of zero input files is considered an error).
497
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000498 - ``default`` - Always evaluates to true. Should always be the last
499 test in the ``case`` expression.
500
Mikhail Glushenkovd66e8de2009-09-28 01:16:07 +0000501 - ``and`` - A standard binary logical combinator that returns true iff all of
502 its arguments return true. Used like this: ``(and (test1), (test2),
503 ... (testN))``. Nesting of ``and`` and ``or`` is allowed, but not
504 encouraged.
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000505
Mikhail Glushenkovd66e8de2009-09-28 01:16:07 +0000506 - ``or`` - A binary logical combinator that returns true iff any of its
507 arguments returns true. Example: ``(or (test1), (test2), ... (testN))``.
508
509 - ``not`` - Standard unary logical combinator that negates its
510 argument. Example: ``(not (or (test1), (test2), ... (testN)))``.
511
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000512
Mikhail Glushenkovcd0858e2008-05-30 06:14:42 +0000513
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000514Writing a tool description
515==========================
516
517As was said earlier, nodes in the compilation graph represent tools,
518which are described separately. A tool definition looks like this
519(taken from the ``include/llvm/CompilerDriver/Tools.td`` file)::
520
521 def llvm_gcc_cpp : Tool<[
522 (in_language "c++"),
523 (out_language "llvm-assembler"),
524 (output_suffix "bc"),
525 (cmd_line "llvm-g++ -c $INFILE -o $OUTFILE -emit-llvm"),
526 (sink)
527 ]>;
528
529This defines a new tool called ``llvm_gcc_cpp``, which is an alias for
530``llvm-g++``. As you can see, a tool definition is just a list of
531properties; most of them should be self-explanatory. The ``sink``
532property means that this tool should be passed all command-line
533options that aren't mentioned in the option list.
534
535The complete list of all currently implemented tool properties follows.
536
537* Possible tool properties:
538
539 - ``in_language`` - input language name. Can be either a string or a
540 list, in case the tool supports multiple input languages.
541
Mikhail Glushenkovaba210b2009-10-09 05:45:38 +0000542 - ``out_language`` - output language name. Multiple output languages are not
543 allowed.
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000544
545 - ``output_suffix`` - output file suffix. Can also be changed
546 dynamically, see documentation on actions.
547
548 - ``cmd_line`` - the actual command used to run the tool. You can
549 use ``$INFILE`` and ``$OUTFILE`` variables, output redirection
550 with ``>``, hook invocations (``$CALL``), environment variables
551 (via ``$ENV``) and the ``case`` construct.
552
553 - ``join`` - this tool is a "join node" in the graph, i.e. it gets a
554 list of input files and joins them together. Used for linkers.
555
556 - ``sink`` - all command-line options that are not handled by other
557 tools are passed to this tool.
558
559 - ``actions`` - A single big ``case`` expression that specifies how
560 this tool reacts on command-line options (described in more detail
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000561 `below`__).
562
563__ actions_
564
565.. _actions:
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000566
567Actions
568-------
569
570A tool often needs to react to command-line options, and this is
571precisely what the ``actions`` property is for. The next example
572illustrates this feature::
573
574 def llvm_gcc_linker : Tool<[
575 (in_language "object-code"),
576 (out_language "executable"),
577 (output_suffix "out"),
578 (cmd_line "llvm-gcc $INFILE -o $OUTFILE"),
579 (join),
580 (actions (case (not_empty "L"), (forward "L"),
581 (not_empty "l"), (forward "l"),
582 (not_empty "dummy"),
583 [(append_cmd "-dummy1"), (append_cmd "-dummy2")])
584 ]>;
585
586The ``actions`` tool property is implemented on top of the omnipresent
587``case`` expression. It associates one or more different *actions*
588with given conditions - in the example, the actions are ``forward``,
589which forwards a given option unchanged, and ``append_cmd``, which
590appends a given string to the tool execution command. Multiple actions
591can be associated with a single condition by using a list of actions
592(used in the example to append some dummy options). The same ``case``
593construct can also be used in the ``cmd_line`` property to modify the
594tool command line.
595
596The "join" property used in the example means that this tool behaves
597like a linker.
598
599The list of all possible actions follows.
600
601* Possible actions:
602
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000603 - ``append_cmd`` - Append a string to the tool invocation command.
604 Example: ``(case (switch_on "pthread"), (append_cmd "-lpthread"))``.
Mikhail Glushenkov5c2b6b22008-12-17 02:47:01 +0000605
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000606 - ``error`` - Exit with error.
Mikhail Glushenkov5c2b6b22008-12-17 02:47:01 +0000607 Example: ``(error "Mixing -c and -S is not allowed!")``.
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000608
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000609 - ``warning`` - Print a warning.
Mikhail Glushenkov3e4102e2009-10-25 01:44:11 +0000610 Example: ``(warning "Specifying both -O1 and -O2 is meaningless!")``.
611
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000612 - ``forward`` - Forward the option unchanged.
613 Example: ``(forward "Wall")``.
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000614
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000615 - ``forward_as`` - Change the option's name, but forward the argument
616 unchanged.
Mikhail Glushenkove89331b2009-05-06 01:41:19 +0000617 Example: ``(forward_as "O0", "--disable-optimization")``.
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000618
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000619 - ``forward_value`` - Forward only option's value. Cannot be used with switch
620 options (since they don't have values), but works fine with lists.
621 Example: ``(forward_value "Wa,")``.
622
623 - ``forward_transformed_value`` - As above, but applies a hook to the
624 option's value before forwarding (see `below`__). When
625 ``forward_transformed_value`` is applied to a list
626 option, the hook must have signature
627 ``std::string hooks::HookName (const std::vector<std::string>&)``.
628 Example: ``(forward_transformed_value "m", "ConvertToMAttr")``.
629
630 __ hooks_
631
632 - ``output_suffix`` - Modify the output suffix of this tool.
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000633 Example: ``(output_suffix "i")``.
634
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000635 - ``stop_compilation`` - Stop compilation after this tool processes its
636 input. Used without arguments.
637 Example: ``(stop_compilation)``.
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000638
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000639
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000640Language map
Mikhail Glushenkov270cae32008-05-30 06:25:24 +0000641============
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000642
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000643If you are adding support for a new language to LLVMC, you'll need to
644modify the language map, which defines mappings from file extensions
645to language names. It is used to choose the proper toolchain(s) for a
646given input file set. Language map definition looks like this::
Anton Korobeynikovac67b7e2008-03-23 08:57:20 +0000647
648 def LanguageMap : LanguageMap<
649 [LangToSuffixes<"c++", ["cc", "cp", "cxx", "cpp", "CPP", "c++", "C"]>,
650 LangToSuffixes<"c", ["c"]>,
651 ...
652 ]>;
653
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000654For example, without those definitions the following command wouldn't work::
655
656 $ llvmc hello.cpp
657 llvmc: Unknown suffix: cpp
658
659The language map entries should be added only for tools that are
660linked with the root node. Since tools are not allowed to have
661multiple output languages, for nodes "inside" the graph the input and
662output languages should match. This is enforced at compile-time.
663
Mikhail Glushenkov3e4102e2009-10-25 01:44:11 +0000664Option preprocessor
665===================
666
667It is sometimes useful to run error-checking code before processing the
668compilation graph. For example, if optimization options "-O1" and "-O2" are
669implemented as switches, we might want to output a warning if the user invokes
670the driver with both of these options enabled.
671
672The ``OptionPreprocessor`` feature is reserved specially for these
673occasions. Example (adapted from the built-in Base plugin)::
674
675 def Preprocess : OptionPreprocessor<
676 (case (and (switch_on "O3"), (any_switch_on ["O0", "O1", "O2"])),
677 [(unset_option ["O0", "O1", "O2"]),
678 (warning "Multiple -O options specified, defaulted to -O3.")],
679 (and (switch_on "O2"), (any_switch_on ["O0", "O1"])),
680 (unset_option ["O0", "O1"]),
681 (and (switch_on "O1"), (switch_on "O0")),
682 (unset_option "O0"))
683 >;
684
685Here, ``OptionPreprocessor`` is used to unset all spurious optimization options
686(so that they are not forwarded to the compiler).
687
688``OptionPreprocessor`` is basically a single big ``case`` expression, which is
689evaluated only once right after the plugin is loaded. The only allowed actions
690in ``OptionPreprocessor`` are ``error``, ``warning`` and a special action
691``unset_option``, which, as the name suggests, unsets a given option. For
692convenience, ``unset_option`` also works on lists.
693
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000694
695More advanced topics
696====================
697
698.. _hooks:
699
700Hooks and environment variables
701-------------------------------
702
703Normally, LLVMC executes programs from the system ``PATH``. Sometimes,
Mikhail Glushenkova298bb72009-01-21 13:04:00 +0000704this is not sufficient: for example, we may want to specify tool paths
705or names in the configuration file. This can be easily achieved via
706the hooks mechanism. To write your own hooks, just add their
707definitions to the ``PluginMain.cpp`` or drop a ``.cpp`` file into the
708your plugin directory. Hooks should live in the ``hooks`` namespace
Mikhail Glushenkovb6b51412009-01-21 13:04:33 +0000709and have the signature ``std::string hooks::MyHookName ([const char*
Mikhail Glushenkova298bb72009-01-21 13:04:00 +0000710Arg0 [ const char* Arg2 [, ...]]])``. They can be used from the
711``cmd_line`` tool property::
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000712
713 (cmd_line "$CALL(MyHook)/path/to/file -o $CALL(AnotherHook)")
714
Mikhail Glushenkova298bb72009-01-21 13:04:00 +0000715To pass arguments to hooks, use the following syntax::
716
717 (cmd_line "$CALL(MyHook, 'Arg1', 'Arg2', 'Arg # 3')/path/to/file -o1 -o2")
718
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000719It is also possible to use environment variables in the same manner::
720
721 (cmd_line "$ENV(VAR1)/path/to/file -o $ENV(VAR2)")
722
723To change the command line string based on user-provided options use
724the ``case`` expression (documented `above`__)::
725
726 (cmd_line
727 (case
728 (switch_on "E"),
729 "llvm-g++ -E -x c $INFILE -o $OUTFILE",
730 (default),
731 "llvm-g++ -c -x c $INFILE -o $OUTFILE -emit-llvm"))
732
733__ case_
734
735.. _priorities:
736
737How plugins are loaded
738----------------------
739
740It is possible for LLVMC plugins to depend on each other. For example,
741one can create edges between nodes defined in some other plugin. To
742make this work, however, that plugin should be loaded first. To
743achieve this, the concept of plugin priority was introduced. By
744default, every plugin has priority zero; to specify the priority
745explicitly, put the following line in your plugin's TableGen file::
746
747 def Priority : PluginPriority<$PRIORITY_VALUE>;
748 # Where PRIORITY_VALUE is some integer > 0
749
750Plugins are loaded in order of their (increasing) priority, starting
751with 0. Therefore, the plugin with the highest priority value will be
752loaded last.
753
Mikhail Glushenkov9ecd30c2008-09-22 20:48:48 +0000754Debugging
Mikhail Glushenkov4410e322008-12-07 16:47:42 +0000755---------
Mikhail Glushenkov9ecd30c2008-09-22 20:48:48 +0000756
757When writing LLVMC plugins, it can be useful to get a visual view of
758the resulting compilation graph. This can be achieved via the command
Mikhail Glushenkovd5652032008-12-13 02:28:58 +0000759line option ``--view-graph``. This command assumes that Graphviz_ and
Mikhail Glushenkov4ad0d572009-03-27 12:58:29 +0000760Ghostview_ are installed. There is also a ``--write-graph`` option that
Mikhail Glushenkovd5652032008-12-13 02:28:58 +0000761creates a Graphviz source file (``compilation-graph.dot``) in the
Mikhail Glushenkov9ecd30c2008-09-22 20:48:48 +0000762current directory.
763
Mikhail Glushenkovf9b1d792009-01-15 02:42:40 +0000764Another useful ``llvmc`` option is ``--check-graph``. It checks the
765compilation graph for common errors like mismatched output/input
766language names, multiple default edges and cycles. These checks can't
767be performed at compile-time because the plugins can load code
768dynamically. When invoked with ``--check-graph``, ``llvmc`` doesn't
769perform any compilation tasks and returns the number of encountered
770errors as its status code.
Mikhail Glushenkovf8c430b2009-01-09 16:16:27 +0000771
Mikhail Glushenkovd5652032008-12-13 02:28:58 +0000772.. _Graphviz: http://www.graphviz.org/
773.. _Ghostview: http://pages.cs.wisc.edu/~ghost/
Mikhail Glushenkov68319f82008-12-11 23:24:40 +0000774
Mikhail Glushenkov875ace52009-06-30 00:16:00 +0000775Conditioning on the executable name
776-----------------------------------
777
778For now, the executable name (the value passed to the driver in ``argv[0]``) is
779accessible only in the C++ code (i.e. hooks). Use the following code::
780
781 namespace llvmc {
782 extern const char* ProgramName;
783 }
784
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000785 namespace hooks {
786
Mikhail Glushenkov875ace52009-06-30 00:16:00 +0000787 std::string MyHook() {
788 //...
789 if (strcmp(ProgramName, "mydriver") == 0) {
790 //...
791
792 }
793
Mikhail Glushenkovb59b0f82009-12-07 18:26:11 +0000794 } // end namespace hooks
795
Mikhail Glushenkov875ace52009-06-30 00:16:00 +0000796In general, you're encouraged not to make the behaviour dependent on the
797executable file name, and use command-line switches instead. See for example how
798the ``Base`` plugin behaves when it needs to choose the correct linker options
799(think ``g++`` vs. ``gcc``).
800
Mikhail Glushenkov68319f82008-12-11 23:24:40 +0000801.. raw:: html
Mikhail Glushenkovd5652032008-12-13 02:28:58 +0000802
803 <hr />
804 <address>
805 <a href="http://jigsaw.w3.org/css-validator/check/referer">
806 <img src="http://jigsaw.w3.org/css-validator/images/vcss-blue"
807 alt="Valid CSS" /></a>
808 <a href="http://validator.w3.org/check?uri=referer">
809 <img src="http://www.w3.org/Icons/valid-xhtml10-blue"
810 alt="Valid XHTML 1.0 Transitional"/></a>
811
812 <a href="mailto:foldr@codedgers.com">Mikhail Glushenkov</a><br />
813 <a href="http://llvm.org">LLVM Compiler Infrastructure</a><br />
814
815 Last modified: $Date: 2008-12-11 11:34:48 -0600 (Thu, 11 Dec 2008) $
816 </address>