Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 1 | <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" |
| 2 | "http://www.w3.org/TR/html4/strict.dtd"> |
| 3 | <html> |
| 4 | <head> |
| 5 | <title>LLVM gold plugin</title> |
| 6 | <link rel="stylesheet" href="llvm.css" type="text/css"> |
| 7 | </head> |
| 8 | <body> |
| 9 | |
NAKAMURA Takumi | 05d0265 | 2011-04-18 23:59:50 +0000 | [diff] [blame] | 10 | <h1>LLVM gold plugin</h1> |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 11 | <ol> |
| 12 | <li><a href="#introduction">Introduction</a></li> |
| 13 | <li><a href="#build">How to build it</a></li> |
Nick Lewycky | f3888ba | 2009-03-01 21:55:10 +0000 | [diff] [blame] | 14 | <li><a href="#usage">Usage</a> |
| 15 | <ul> |
| 16 | <li><a href="#example1">Example of link time optimization</a></li> |
Torok Edwin | 5641f8d | 2009-06-03 15:06:19 +0000 | [diff] [blame] | 17 | <li><a href="#lto_autotools">Quickstart for using LTO with autotooled projects</a></li> |
Nick Lewycky | f3888ba | 2009-03-01 21:55:10 +0000 | [diff] [blame] | 18 | </ul></li> |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 19 | <li><a href="#licensing">Licensing</a></li> |
| 20 | </ol> |
| 21 | <div class="doc_author">Written by Nick Lewycky</div> |
| 22 | |
| 23 | <!--=========================================================================--> |
NAKAMURA Takumi | 05d0265 | 2011-04-18 23:59:50 +0000 | [diff] [blame] | 24 | <h2><a name="introduction">Introduction</a></h2> |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 25 | <!--=========================================================================--> |
NAKAMURA Takumi | f5af6ad | 2011-04-23 00:30:22 +0000 | [diff] [blame] | 26 | <div> |
Duncan Sands | 10f0675 | 2009-03-01 15:19:03 +0000 | [diff] [blame] | 27 | <p>Building with link time optimization requires cooperation from the |
Nick Lewycky | fd97aa2 | 2009-03-01 09:51:07 +0000 | [diff] [blame] | 28 | system linker. LTO support on Linux systems requires that you use |
Duncan Sands | 10f0675 | 2009-03-01 15:19:03 +0000 | [diff] [blame] | 29 | the <a href="http://sourceware.org/binutils">gold linker</a> which supports |
Nick Lewycky | 5c21280 | 2010-04-17 07:00:24 +0000 | [diff] [blame] | 30 | LTO via plugins. This is the same mechanism used by the |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 31 | <a href="http://gcc.gnu.org/wiki/LinkTimeOptimization">GCC LTO</a> |
Duncan Sands | 10f0675 | 2009-03-01 15:19:03 +0000 | [diff] [blame] | 32 | project.</p> |
| 33 | <p>The LLVM gold plugin implements the |
| 34 | <a href="http://gcc.gnu.org/wiki/whopr/driver">gold plugin interface</a> |
| 35 | on top of |
NAKAMURA Takumi | 31c1806 | 2011-04-09 02:13:48 +0000 | [diff] [blame] | 36 | <a href="LinkTimeOptimization.html#lto">libLTO</a>. |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 37 | The same plugin can also be used by other tools such as <tt>ar</tt> and |
| 38 | <tt>nm</tt>. |
| 39 | </div> |
| 40 | <!--=========================================================================--> |
NAKAMURA Takumi | 05d0265 | 2011-04-18 23:59:50 +0000 | [diff] [blame] | 41 | <h2><a name="build">How to build it</a></h2> |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 42 | <!--=========================================================================--> |
NAKAMURA Takumi | f5af6ad | 2011-04-23 00:30:22 +0000 | [diff] [blame] | 43 | <div> |
Nick Lewycky | 5c21280 | 2010-04-17 07:00:24 +0000 | [diff] [blame] | 44 | <p>You need to have gold with plugin support and build the LLVMgold |
| 45 | plugin. Check whether you have gold running <tt>/usr/bin/ld -v</tt>. It will |
| 46 | report “GNU gold” or else “GNU ld” if not. If you have |
| 47 | gold, check for plugin support by running <tt>/usr/bin/ld -plugin</tt>. If it |
| 48 | complains “missing argument” then you have plugin support. If not, |
| 49 | such as an “unknown option” error then you will either need to |
| 50 | build gold or install a version with plugin support.</p> |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 51 | <ul> |
Nick Lewycky | 5c21280 | 2010-04-17 07:00:24 +0000 | [diff] [blame] | 52 | <li>To build gold with plugin support: |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 53 | <pre class="doc_code"> |
| 54 | mkdir binutils |
| 55 | cd binutils |
| 56 | cvs -z 9 -d :pserver:anoncvs@sourceware.org:/cvs/src login |
| 57 | <em>{enter "anoncvs" as the password}</em> |
Duncan Sands | ed7713d | 2010-10-06 06:45:11 +0000 | [diff] [blame] | 58 | cvs -z 9 -d :pserver:anoncvs@sourceware.org:/cvs/src co binutils |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 59 | mkdir build |
| 60 | cd build |
| 61 | ../src/configure --enable-gold --enable-plugins |
| 62 | make all-gold |
| 63 | </pre> |
Nick Lewycky | 5c21280 | 2010-04-17 07:00:24 +0000 | [diff] [blame] | 64 | That should leave you with <tt>binutils/build/gold/ld-new</tt> which supports the <tt>-plugin</tt> option. It also built would have |
| 65 | <tt>binutils/build/binutils/ar</tt> and <tt>nm-new</tt> which support plugins |
| 66 | but don't have a visible -plugin option, instead relying on the gold plugin |
| 67 | being present in <tt>../lib/bfd-plugins</tt> relative to where the binaries are |
| 68 | placed. |
Duncan Sands | 10f0675 | 2009-03-01 15:19:03 +0000 | [diff] [blame] | 69 | <li>Build the LLVMgold plugin: Configure LLVM with |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 70 | <tt>--with-binutils-include=/path/to/binutils/src/include</tt> and run |
| 71 | <tt>make</tt>. |
| 72 | </ul> |
| 73 | </div> |
| 74 | <!--=========================================================================--> |
NAKAMURA Takumi | 05d0265 | 2011-04-18 23:59:50 +0000 | [diff] [blame] | 75 | <h2><a name="usage">Usage</a></h2> |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 76 | <!--=========================================================================--> |
NAKAMURA Takumi | f5af6ad | 2011-04-23 00:30:22 +0000 | [diff] [blame] | 77 | <div> |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 78 | |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 79 | <p>The linker takes a <tt>-plugin</tt> option that points to the path of |
| 80 | the plugin <tt>.so</tt> file. To find out what link command <tt>gcc</tt> |
| 81 | would run in a given situation, run <tt>gcc -v <em>[...]</em></tt> and look |
| 82 | for the line where it runs <tt>collect2</tt>. Replace that with |
Rafael Espindola | 53843f8 | 2010-08-08 21:14:26 +0000 | [diff] [blame] | 83 | <tt>ld-new -plugin /path/to/LLVMgold.so</tt> to test it out. Once you're |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 84 | ready to switch to using gold, backup your existing <tt>/usr/bin/ld</tt> |
| 85 | then replace it with <tt>ld-new</tt>.</p> |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 86 | |
| 87 | <p>You can produce bitcode files from <tt>clang</tt> using |
Nick Lewycky | d66ff0f | 2009-03-01 20:58:07 +0000 | [diff] [blame] | 88 | <tt>-emit-llvm</tt> or <tt>-flto</tt>, or the <tt>-O4</tt> flag which is |
| 89 | synonymous with <tt>-O3 -flto</tt>.</p> |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 90 | |
| 91 | <p><tt>Clang</tt> has a <tt>-use-gold-plugin</tt> option which looks for the |
| 92 | gold plugin in the same directories as it looks for <tt>cc1</tt> and passes |
| 93 | the <tt>-plugin</tt> option to <tt>ld</tt>. It will not look for an alternate |
Nick Lewycky | 050147c | 2009-03-01 18:48:53 +0000 | [diff] [blame] | 94 | linker, which is why you need gold to be the installed system linker in your |
| 95 | path.</p> |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 96 | |
Nick Lewycky | 5c21280 | 2010-04-17 07:00:24 +0000 | [diff] [blame] | 97 | <p>If you want <tt>ar</tt> and <tt>nm</tt> to work seamlessly as well, install |
Rafael Espindola | 53843f8 | 2010-08-08 21:14:26 +0000 | [diff] [blame] | 98 | <tt>LLVMgold.so</tt> to <tt>/usr/lib/bfd-plugins</tt>. If you built your |
Nick Lewycky | 5c21280 | 2010-04-17 07:00:24 +0000 | [diff] [blame] | 99 | own gold, be sure to install the <tt>ar</tt> and <tt>nm-new</tt> you built to |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 100 | <tt>/usr/bin</tt>.<p> |
Nick Lewycky | f3888ba | 2009-03-01 21:55:10 +0000 | [diff] [blame] | 101 | |
| 102 | <!-- ======================================================================= --> |
NAKAMURA Takumi | 05d0265 | 2011-04-18 23:59:50 +0000 | [diff] [blame] | 103 | <h3> |
Nick Lewycky | f3888ba | 2009-03-01 21:55:10 +0000 | [diff] [blame] | 104 | <a name="example1">Example of link time optimization</a> |
NAKAMURA Takumi | 05d0265 | 2011-04-18 23:59:50 +0000 | [diff] [blame] | 105 | </h3> |
Nick Lewycky | f3888ba | 2009-03-01 21:55:10 +0000 | [diff] [blame] | 106 | |
NAKAMURA Takumi | f5af6ad | 2011-04-23 00:30:22 +0000 | [diff] [blame] | 107 | <div> |
Nick Lewycky | f3888ba | 2009-03-01 21:55:10 +0000 | [diff] [blame] | 108 | <p>The following example shows a worked example of the gold plugin mixing |
| 109 | LLVM bitcode and native code. |
| 110 | <pre class="doc_code"> |
| 111 | --- a.c --- |
| 112 | #include <stdio.h> |
| 113 | |
| 114 | extern void foo1(void); |
| 115 | extern void foo4(void); |
| 116 | |
| 117 | void foo2(void) { |
| 118 | printf("Foo2\n"); |
| 119 | } |
| 120 | |
| 121 | void foo3(void) { |
| 122 | foo4(); |
| 123 | } |
| 124 | |
| 125 | int main(void) { |
| 126 | foo1(); |
| 127 | } |
| 128 | |
| 129 | --- b.c --- |
| 130 | #include <stdio.h> |
| 131 | |
| 132 | extern void foo2(void); |
| 133 | |
| 134 | void foo1(void) { |
| 135 | foo2(); |
| 136 | } |
| 137 | |
| 138 | void foo4(void) { |
| 139 | printf("Foo4"); |
| 140 | } |
| 141 | |
| 142 | --- command lines --- |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 143 | $ clang -flto a.c -c -o a.o # <-- a.o is LLVM bitcode file |
Rafael Espindola | 91f935e | 2009-07-08 11:13:34 +0000 | [diff] [blame] | 144 | $ ar q a.a a.o # <-- a.a is an archive with LLVM bitcode |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 145 | $ clang b.c -c -o b.o # <-- b.o is native object file |
| 146 | $ clang -use-gold-plugin a.a b.o -o main # <-- link with LLVMgold plugin |
Nick Lewycky | f3888ba | 2009-03-01 21:55:10 +0000 | [diff] [blame] | 147 | </pre> |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 148 | |
Nick Lewycky | f3888ba | 2009-03-01 21:55:10 +0000 | [diff] [blame] | 149 | <p>Gold informs the plugin that foo3 is never referenced outside the IR, |
| 150 | leading LLVM to delete that function. However, unlike in the |
NAKAMURA Takumi | 31c1806 | 2011-04-09 02:13:48 +0000 | [diff] [blame] | 151 | <a href="LinkTimeOptimization.html#example1">libLTO |
Nick Lewycky | f3888ba | 2009-03-01 21:55:10 +0000 | [diff] [blame] | 152 | example</a> gold does not currently eliminate foo4.</p> |
| 153 | </div> |
| 154 | |
NAKAMURA Takumi | f5af6ad | 2011-04-23 00:30:22 +0000 | [diff] [blame] | 155 | </div> |
| 156 | |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 157 | <!--=========================================================================--> |
NAKAMURA Takumi | 05d0265 | 2011-04-18 23:59:50 +0000 | [diff] [blame] | 158 | <h2> |
| 159 | <a name="lto_autotools"> |
| 160 | Quickstart for using LTO with autotooled projects |
| 161 | </a> |
| 162 | </h2> |
Torok Edwin | 5641f8d | 2009-06-03 15:06:19 +0000 | [diff] [blame] | 163 | <!--=========================================================================--> |
NAKAMURA Takumi | f5af6ad | 2011-04-23 00:30:22 +0000 | [diff] [blame] | 164 | <div> |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 165 | <p>Once your system <tt>ld</tt>, <tt>ar</tt>, and <tt>nm</tt> all support LLVM |
| 166 | bitcode, everything is in place for an easy to use LTO build of autotooled |
| 167 | projects:</p> |
| 168 | |
Torok Edwin | 5641f8d | 2009-06-03 15:06:19 +0000 | [diff] [blame] | 169 | <ul> |
Rafael Espindola | 53843f8 | 2010-08-08 21:14:26 +0000 | [diff] [blame] | 170 | <li>Follow the instructions <a href="#build">on how to build LLVMgold.so</a>.</li> |
Torok Edwin | 5641f8d | 2009-06-03 15:06:19 +0000 | [diff] [blame] | 171 | <li>Install the newly built binutils to <tt>$PREFIX</tt></li> |
Rafael Espindola | 53843f8 | 2010-08-08 21:14:26 +0000 | [diff] [blame] | 172 | <li>Copy <tt>Release/lib/LLVMgold.so</tt> to |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 173 | <tt>$PREFIX/libexec/gcc/x86_64-unknown-linux-gnu/4.2.1/</tt> and |
| 174 | <tt>$PREFIX/lib/bfd-plugins/</tt></li> |
| 175 | <li>Set environment variables (<tt>$PREFIX</tt> is where you installed clang and |
| 176 | binutils): |
| 177 | <pre class="doc_code"> |
| 178 | export CC="$PREFIX/bin/clang -use-gold-plugin" |
| 179 | export CXX="$PREFIX/bin/clang++ -use-gold-plugin" |
Torok Edwin | 347c7bb | 2009-06-04 16:08:10 +0000 | [diff] [blame] | 180 | export AR="$PREFIX/bin/ar" |
| 181 | export NM="$PREFIX/bin/nm" |
Torok Edwin | 5641f8d | 2009-06-03 15:06:19 +0000 | [diff] [blame] | 182 | export RANLIB=/bin/true #ranlib is not needed, and doesn't support .bc files in .a |
| 183 | export CFLAGS="-O4" |
Nick Lewycky | 9d813df | 2009-06-06 18:14:04 +0000 | [diff] [blame] | 184 | </pre> |
Torok Edwin | 5641f8d | 2009-06-03 15:06:19 +0000 | [diff] [blame] | 185 | </li> |
Torok Edwin | 347c7bb | 2009-06-04 16:08:10 +0000 | [diff] [blame] | 186 | <li>Or you can just set your path: |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 187 | <pre class="doc_code"> |
Torok Edwin | 347c7bb | 2009-06-04 16:08:10 +0000 | [diff] [blame] | 188 | export PATH="$PREFIX/bin:$PATH" |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 189 | export CC="clang -use-gold-plugin" |
| 190 | export CXX="clang++ -use-gold-plugin" |
Torok Edwin | 347c7bb | 2009-06-04 16:08:10 +0000 | [diff] [blame] | 191 | export RANLIB=/bin/true |
| 192 | export CFLAGS="-O4" |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 193 | </pre></li> |
| 194 | <li>Configure & build the project as usual: |
| 195 | <pre class="doc_code"> |
| 196 | % ./configure && make && make check |
| 197 | </pre></li> |
Torok Edwin | 5641f8d | 2009-06-03 15:06:19 +0000 | [diff] [blame] | 198 | </ul> |
Bill Wendling | ea55c83 | 2011-09-18 12:37:20 +0000 | [diff] [blame] | 199 | |
| 200 | <p>The environment variable settings may work for non-autotooled projects |
| 201 | too, but you may need to set the <tt>LD</tt> environment variable as |
| 202 | well.</p> |
Torok Edwin | 5641f8d | 2009-06-03 15:06:19 +0000 | [diff] [blame] | 203 | </div> |
| 204 | |
| 205 | <!--=========================================================================--> |
NAKAMURA Takumi | 05d0265 | 2011-04-18 23:59:50 +0000 | [diff] [blame] | 206 | <h2><a name="licensing">Licensing</a></h2> |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 207 | <!--=========================================================================--> |
NAKAMURA Takumi | f5af6ad | 2011-04-23 00:30:22 +0000 | [diff] [blame] | 208 | <div> |
Nick Lewycky | ef5facd | 2009-04-13 02:03:40 +0000 | [diff] [blame] | 209 | <p>Gold is licensed under the GPLv3. LLVMgold uses the interface file |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 210 | <tt>plugin-api.h</tt> from gold which means that the resulting LLVMgold.so |
| 211 | binary is also GPLv3. This can still be used to link non-GPLv3 programs just |
Nick Lewycky | ef5facd | 2009-04-13 02:03:40 +0000 | [diff] [blame] | 212 | as much as gold could without the plugin.</p> |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 213 | </div> |
| 214 | |
| 215 | <!-- *********************************************************************** --> |
| 216 | <hr> |
| 217 | <address> |
| 218 | <a href="http://jigsaw.w3.org/css-validator/check/referer"><img |
| 219 | src="http://jigsaw.w3.org/css-validator/images/vcss-blue" alt="Valid CSS"></a> |
| 220 | <a href="http://validator.w3.org/check/referer"><img |
| 221 | src="http://www.w3.org/Icons/valid-html401-blue" alt="Valid HTML 4.01"></a> |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 222 | <a href="mailto:nicholas@metrix.on.ca">Nick Lewycky</a><br> |
NAKAMURA Takumi | b9a3363 | 2011-04-09 02:13:37 +0000 | [diff] [blame] | 223 | <a href="http://llvm.org/">The LLVM Compiler Infrastructure</a><br> |
Nick Lewycky | 5c21280 | 2010-04-17 07:00:24 +0000 | [diff] [blame] | 224 | Last modified: $Date: 2010-04-16 23:58:21 -0800 (Fri, 16 Apr 2010) $ |
Nick Lewycky | ebc6765 | 2009-03-01 09:38:29 +0000 | [diff] [blame] | 225 | </address> |
| 226 | </body> |
| 227 | </html> |