blob: 2821ce4d214e8237e7a97f5509921b720b1320f0 [file] [log] [blame]
Rui Ueyama2698ab42017-02-24 01:55:50 +00001LLD - The LLVM Linker
Michael J. Spencerd01c8fe2012-04-08 02:06:04 +00002=====================
3
Rui Ueyama2698ab42017-02-24 01:55:50 +00004LLD is a linker from the LLVM project. That is a drop-in replacement
5for system linkers and runs much faster than them. It also provides
6features that are useful for toolchain developers.
Michael J. Spencerd01c8fe2012-04-08 02:06:04 +00007
Sam Cleggc94d3932017-11-17 18:14:09 +00008The linker supports ELF (Unix), PE/COFF (Windows), Mach-O (macOS) and
9WebAssembly in descending order of completeness. Internally, LLD consists of
10several different linkers. The ELF port is the one that will be described in
Hans Wennborgc7792a62018-07-31 12:00:26 +000011this document. The PE/COFF port is complete, including
Sam Cleggc94d3932017-11-17 18:14:09 +000012Windows debug info (PDB) support. The WebAssembly port is still a work in
13progress (See :doc:`WebAssembly`). The Mach-O port is built based on a
14different architecture than the others. For the details about Mach-O, please
15read :doc:`AtomLLD`.
Michael J. Spencerd01c8fe2012-04-08 02:06:04 +000016
Rui Ueyama2698ab42017-02-24 01:55:50 +000017Features
18--------
Simon Atanasyane747a442014-09-08 14:56:20 +000019
Rui Ueyama2698ab42017-02-24 01:55:50 +000020- LLD is a drop-in replacement for the GNU linkers. That accepts the
Rui Ueyamabb361fc2017-02-24 18:54:47 +000021 same command line arguments and linker scripts as GNU.
22
23 We are currently working closely with the FreeBSD project to make
24 LLD default system linker in future versions of the operating
25 system, so we are serious about addressing compatibility issues. As
26 of February 2017, LLD is able to link the entire FreeBSD/amd64 base
27 system including the kernel. With a few work-in-progress patches it
28 can link approximately 95% of the ports collection on AMD64. For the
29 details, see `FreeBSD quarterly status report
Rui Ueyama7c9f00e2017-02-25 03:01:18 +000030 <https://www.freebsd.org/news/status/report-2016-10-2016-12.html#Using-LLVM%27s-LLD-Linker-as-FreeBSD%27s-System-Linker>`_.
Michael J. Spencerd01c8fe2012-04-08 02:06:04 +000031
Rui Ueyama2698ab42017-02-24 01:55:50 +000032- LLD is very fast. When you link a large program on a multicore
33 machine, you can expect that LLD runs more than twice as fast as GNU
34 gold linker. Your milage may vary, though.
Michael J. Spencerd01c8fe2012-04-08 02:06:04 +000035
Rui Ueyama2698ab42017-02-24 01:55:50 +000036- It supports various CPUs/ABIs including x86-64, x86, x32, AArch64,
37 ARM, MIPS 32/64 big/little-endian, PowerPC, PowerPC 64 and AMDGPU.
38 Among these, x86-64 is the most well-supported target and have
39 reached production quality. AArch64 and MIPS seem decent too. x86
40 should be OK but not well tested yet. ARM support is being developed
41 actively.
Michael J. Spencerd01c8fe2012-04-08 02:06:04 +000042
Rui Ueyama2698ab42017-02-24 01:55:50 +000043- It is always a cross-linker, meaning that it always supports all the
44 above targets however it was built. In fact, we don't provide a
45 build-time option to enable/disable each target. This should make it
46 easy to use our linker as part of a cross-compile toolchain.
Michael J. Spencerd01c8fe2012-04-08 02:06:04 +000047
Rui Ueyama2698ab42017-02-24 01:55:50 +000048- You can embed LLD to your program to eliminate dependency to
49 external linkers. All you have to do is to construct object files
50 and command line arguments just like you would do to invoke an
51 external linker and then call the linker's main function,
Rui Ueyama4d5f70d2017-02-26 22:17:46 +000052 ``lld::elf::link``, from your code.
Michael J. Spencerd01c8fe2012-04-08 02:06:04 +000053
Rui Ueyama2698ab42017-02-24 01:55:50 +000054- It is small. We are using LLVM libObject library to read from object
55 files, so it is not completely a fair comparison, but as of February
56 2017, LLD/ELF consists only of 21k lines of C++ code while GNU gold
57 consists of 198k lines of C++ code.
58
59- Link-time optimization (LTO) is supported by default. Essentially,
Rui Ueyama4d5f70d2017-02-26 22:17:46 +000060 all you have to do to do LTO is to pass the ``-flto`` option to clang.
Rui Ueyama2698ab42017-02-24 01:55:50 +000061 Then clang creates object files not in the native object file format
62 but in LLVM bitcode format. LLD reads bitcode object files, compile
63 them using LLVM and emit an output file. Because in this way LLD can
64 see the entire program, it can do the whole program optimization.
65
66- Some very old features for ancient Unix systems (pre-90s or even
67 before that) have been removed. Some default settings have been
68 tuned for the 21st century. For example, the stack is marked as
69 non-executable by default to tighten security.
70
71Performance
72-----------
73
74This is a link time comparison on a 2-socket 20-core 40-thread Xeon
Rui Ueyama74308972017-10-01 03:47:02 +000075E5-2680 2.80 GHz machine with an SSD drive. We ran gold and lld with
76or without multi-threading support. To disable multi-threading, we
Rui Ueyama0b9fbf92017-10-01 03:50:48 +000077added ``-no-threads`` to the command lines.
Rui Ueyama2698ab42017-02-24 01:55:50 +000078
Rui Ueyama74308972017-10-01 03:47:02 +000079============ =========== ============ ==================== ================== =============== =============
80Program Output size GNU ld GNU gold w/o threads GNU gold w/threads lld w/o threads lld w/threads
81ffmpeg dbg 92 MiB 1.72s 1.16s 1.01s 0.60s 0.35s
82mysqld dbg 154 MiB 8.50s 2.96s 2.68s 1.06s 0.68s
83clang dbg 1.67 GiB 104.03s 34.18s 23.49s 14.82s 5.28s
84chromium dbg 1.14 GiB 209.05s [1]_ 64.70s 60.82s 27.60s 16.70s
85============ =========== ============ ==================== ================== =============== =============
Rui Ueyama2698ab42017-02-24 01:55:50 +000086
Rui Ueyama74308972017-10-01 03:47:02 +000087As you can see, lld is significantly faster than GNU linkers.
Rui Ueyama2698ab42017-02-24 01:55:50 +000088Note that this is just a benchmark result of our environment.
89Depending on number of available cores, available amount of memory or
90disk latency/throughput, your results may vary.
91
Rui Ueyama74308972017-10-01 03:47:02 +000092.. [1] Since GNU ld doesn't support the ``-icf=all`` and
93 ``-gdb-index`` options, we removed them from the command line
94 for GNU ld. GNU ld would have been slower than this if it had
95 these options.
Rui Ueyama2698ab42017-02-24 01:55:50 +000096
97Build
98-----
99
100If you have already checked out LLVM using SVN, you can check out LLD
Rui Ueyama4d5f70d2017-02-26 22:17:46 +0000101under ``tools`` directory just like you probably did for clang. For the
Rui Ueyama2698ab42017-02-24 01:55:50 +0000102details, see `Getting Started with the LLVM System
103<http://llvm.org/docs/GettingStarted.html>`_.
104
105If you haven't checkout out LLVM, the easiest way to build LLD is to
106checkout the entire LLVM projects/sub-projects from a git mirror and
107build that tree. You need `cmake` and of course a C++ compiler.
108
109.. code-block:: console
110
Rui Ueyama432342b2017-09-15 21:04:43 +0000111 $ git clone https://github.com/llvm-project/llvm-project-20170507 llvm-project
Rui Ueyama2698ab42017-02-24 01:55:50 +0000112 $ mkdir build
113 $ cd build
114 $ cmake -DCMAKE_BUILD_TYPE=Release -DLLVM_ENABLE_PROJECTS=lld -DCMAKE_INSTALL_PREFIX=/usr/local ../llvm-project/llvm
115 $ make install
116
Rui Ueyama19ce92e2017-02-26 00:20:42 +0000117Using LLD
118---------
119
120LLD is installed as ``ld.lld``. On Unix, linkers are invoked by
121compiler drivers, so you are not expected to use that command
122directly. There are a few ways to tell compiler drivers to use ld.lld
123instead of the default linker.
124
125The easiest way to do that is to overwrite the default linker. After
126installing LLD to somewhere on your disk, you can create a symbolic
Rui Ueyama81762ab2017-02-26 18:32:31 +0000127link by doing ``ln -s /path/to/ld.lld /usr/bin/ld`` so that
Rui Ueyama19ce92e2017-02-26 00:20:42 +0000128``/usr/bin/ld`` is resolved to LLD.
129
130If you don't want to change the system setting, you can use clang's
131``-fuse-ld`` option. In this way, you want to set ``-fuse-ld=lld`` to
132LDFLAGS when building your programs.
133
134LLD leaves its name and version number to a ``.comment`` section in an
135output. If you are in doubt whether you are successfully using LLD or
Rui Ueyama42fca6e2017-04-27 04:50:08 +0000136not, run ``readelf --string-dump .comment <output-file>`` and examine the
Rui Ueyama19ce92e2017-02-26 00:20:42 +0000137output. If the string "Linker: LLD" is included in the output, you are
138using LLD.
139
Rui Ueyama2698ab42017-02-24 01:55:50 +0000140History
141-------
142
143Here is a brief project history of the ELF and COFF ports.
144
145- May 2015: We decided to rewrite the COFF linker and did that.
146 Noticed that the new linker is much faster than the MSVC linker.
147
148- July 2015: The new ELF port was developed based on the COFF linker
149 architecture.
150
151- September 2015: The first patches to support MIPS and AArch64 landed.
152
153- October 2015: Succeeded to self-host the ELF port. We have noticed
154 that the linker was faster than the GNU linkers, but we weren't sure
155 at the time if we would be able to keep the gap as we would add more
156 features to the linker.
157
158- July 2016: Started working on improving the linker script support.
159
160- December 2016: Succeeded to build the entire FreeBSD base system
Rui Ueyamabb361fc2017-02-24 18:54:47 +0000161 including the kernel. We had widen the performance gap against the
162 GNU linkers.
Rui Ueyama2698ab42017-02-24 01:55:50 +0000163
164Internals
165---------
166
Rui Ueyamafca2a112017-02-24 02:07:54 +0000167For the internals of the linker, please read :doc:`NewLLD`. It is a bit
Rui Ueyama2698ab42017-02-24 01:55:50 +0000168outdated but the fundamental concepts remain valid. We'll update the
169document soon.
Rui Ueyama741cc4b2017-02-24 02:46:03 +0000170
171.. toctree::
172 :maxdepth: 1
173
174 NewLLD
175 AtomLLD
Sam Cleggc94d3932017-11-17 18:14:09 +0000176 WebAssembly
Rui Ueyama1582e762017-02-24 04:13:08 +0000177 windows_support
Rui Ueyama8b1c9402017-02-24 04:23:39 +0000178 ReleaseNotes