blob: 4753acdc6d1d4702b709193a84d9b1f96735f6ec [file] [log] [blame]
Sean Eveson661e4fb2017-11-30 12:43:25 +00001==========================================
2The LLVM Target-Independent Code Generator
3==========================================
4
5.. role:: raw-html(raw)
6 :format: html
7
8.. raw:: html
9
10 <style>
11 .unknown { background-color: #C0C0C0; text-align: center; }
12 .unknown:before { content: "?" }
13 .no { background-color: #C11B17 }
14 .no:before { content: "N" }
15 .partial { background-color: #F88017 }
16 .yes { background-color: #0F0; }
17 .yes:before { content: "Y" }
18 .na { background-color: #6666FF; }
19 .na:before { content: "N/A" }
20 </style>
21
22.. contents::
23 :local:
24
25.. warning::
26 This is a work in progress.
27
28Introduction
29============
30
31The LLVM target-independent code generator is a framework that provides a suite
32of reusable components for translating the LLVM internal representation to the
33machine code for a specified target---either in assembly form (suitable for a
34static compiler) or in binary machine code format (usable for a JIT
35compiler). The LLVM target-independent code generator consists of six main
36components:
37
381. `Abstract target description`_ interfaces which capture important properties
39 about various aspects of the machine, independently of how they will be used.
40 These interfaces are defined in ``include/llvm/Target/``.
41
422. Classes used to represent the `code being generated`_ for a target. These
43 classes are intended to be abstract enough to represent the machine code for
44 *any* target machine. These classes are defined in
45 ``include/llvm/CodeGen/``. At this level, concepts like "constant pool
46 entries" and "jump tables" are explicitly exposed.
47
483. Classes and algorithms used to represent code at the object file level, the
49 `MC Layer`_. These classes represent assembly level constructs like labels,
50 sections, and instructions. At this level, concepts like "constant pool
51 entries" and "jump tables" don't exist.
52
534. `Target-independent algorithms`_ used to implement various phases of native
54 code generation (register allocation, scheduling, stack frame representation,
55 etc). This code lives in ``lib/CodeGen/``.
56
575. `Implementations of the abstract target description interfaces`_ for
58 particular targets. These machine descriptions make use of the components
59 provided by LLVM, and can optionally provide custom target-specific passes,
60 to build complete code generators for a specific target. Target descriptions
61 live in ``lib/Target/``.
62
636. The target-independent JIT components. The LLVM JIT is completely target
64 independent (it uses the ``TargetJITInfo`` structure to interface for
65 target-specific issues. The code for the target-independent JIT lives in
66 ``lib/ExecutionEngine/JIT``.
67
68Depending on which part of the code generator you are interested in working on,
69different pieces of this will be useful to you. In any case, you should be
70familiar with the `target description`_ and `machine code representation`_
71classes. If you want to add a backend for a new target, you will need to
72`implement the target description`_ classes for your new target and understand
73the :doc:`LLVM code representation <LangRef>`. If you are interested in
74implementing a new `code generation algorithm`_, it should only depend on the
75target-description and machine code representation classes, ensuring that it is
76portable.
77
78Required components in the code generator
79-----------------------------------------
80
81The two pieces of the LLVM code generator are the high-level interface to the
82code generator and the set of reusable components that can be used to build
83target-specific backends. The two most important interfaces (:raw-html:`<tt>`
84`TargetMachine`_ :raw-html:`</tt>` and :raw-html:`<tt>` `DataLayout`_
85:raw-html:`</tt>`) are the only ones that are required to be defined for a
86backend to fit into the LLVM system, but the others must be defined if the
87reusable code generator components are going to be used.
88
89This design has two important implications. The first is that LLVM can support
90completely non-traditional code generation targets. For example, the C backend
91does not require register allocation, instruction selection, or any of the other
92standard components provided by the system. As such, it only implements these
93two interfaces, and does its own thing. Note that C backend was removed from the
94trunk since LLVM 3.1 release. Another example of a code generator like this is a
95(purely hypothetical) backend that converts LLVM to the GCC RTL form and uses
96GCC to emit machine code for a target.
97
98This design also implies that it is possible to design and implement radically
99different code generators in the LLVM system that do not make use of any of the
100built-in components. Doing so is not recommended at all, but could be required
101for radically different targets that do not fit into the LLVM machine
102description model: FPGAs for example.
103
104.. _high-level design of the code generator:
105
106The high-level design of the code generator
107-------------------------------------------
108
109The LLVM target-independent code generator is designed to support efficient and
110quality code generation for standard register-based microprocessors. Code
111generation in this model is divided into the following stages:
112
1131. `Instruction Selection`_ --- This phase determines an efficient way to
114 express the input LLVM code in the target instruction set. This stage
115 produces the initial code for the program in the target instruction set, then
116 makes use of virtual registers in SSA form and physical registers that
117 represent any required register assignments due to target constraints or
118 calling conventions. This step turns the LLVM code into a DAG of target
119 instructions.
120
1212. `Scheduling and Formation`_ --- This phase takes the DAG of target
122 instructions produced by the instruction selection phase, determines an
123 ordering of the instructions, then emits the instructions as :raw-html:`<tt>`
124 `MachineInstr`_\s :raw-html:`</tt>` with that ordering. Note that we
125 describe this in the `instruction selection section`_ because it operates on
126 a `SelectionDAG`_.
127
1283. `SSA-based Machine Code Optimizations`_ --- This optional stage consists of a
129 series of machine-code optimizations that operate on the SSA-form produced by
130 the instruction selector. Optimizations like modulo-scheduling or peephole
131 optimization work here.
132
1334. `Register Allocation`_ --- The target code is transformed from an infinite
134 virtual register file in SSA form to the concrete register file used by the
135 target. This phase introduces spill code and eliminates all virtual register
136 references from the program.
137
1385. `Prolog/Epilog Code Insertion`_ --- Once the machine code has been generated
139 for the function and the amount of stack space required is known (used for
140 LLVM alloca's and spill slots), the prolog and epilog code for the function
141 can be inserted and "abstract stack location references" can be eliminated.
142 This stage is responsible for implementing optimizations like frame-pointer
143 elimination and stack packing.
144
1456. `Late Machine Code Optimizations`_ --- Optimizations that operate on "final"
146 machine code can go here, such as spill code scheduling and peephole
147 optimizations.
148
1497. `Code Emission`_ --- The final stage actually puts out the code for the
150 current function, either in the target assembler format or in machine
151 code.
152
153The code generator is based on the assumption that the instruction selector will
154use an optimal pattern matching selector to create high-quality sequences of
155native instructions. Alternative code generator designs based on pattern
156expansion and aggressive iterative peephole optimization are much slower. This
157design permits efficient compilation (important for JIT environments) and
158aggressive optimization (used when generating code offline) by allowing
159components of varying levels of sophistication to be used for any step of
160compilation.
161
162In addition to these stages, target implementations can insert arbitrary
163target-specific passes into the flow. For example, the X86 target uses a
164special pass to handle the 80x87 floating point stack architecture. Other
165targets with unusual requirements can be supported with custom passes as needed.
166
167Using TableGen for target description
168-------------------------------------
169
170The target description classes require a detailed description of the target
171architecture. These target descriptions often have a large amount of common
172information (e.g., an ``add`` instruction is almost identical to a ``sub``
173instruction). In order to allow the maximum amount of commonality to be
174factored out, the LLVM code generator uses the
175:doc:`TableGen/index` tool to describe big chunks of the
176target machine, which allows the use of domain-specific and target-specific
177abstractions to reduce the amount of repetition.
178
179As LLVM continues to be developed and refined, we plan to move more and more of
180the target description to the ``.td`` form. Doing so gives us a number of
181advantages. The most important is that it makes it easier to port LLVM because
182it reduces the amount of C++ code that has to be written, and the surface area
183of the code generator that needs to be understood before someone can get
184something working. Second, it makes it easier to change things. In particular,
185if tables and other things are all emitted by ``tblgen``, we only need a change
186in one place (``tblgen``) to update all of the targets to a new interface.
187
188.. _Abstract target description:
189.. _target description:
190
191Target description classes
192==========================
193
194The LLVM target description classes (located in the ``include/llvm/Target``
195directory) provide an abstract description of the target machine independent of
196any particular client. These classes are designed to capture the *abstract*
197properties of the target (such as the instructions and registers it has), and do
198not incorporate any particular pieces of code generation algorithms.
199
200All of the target description classes (except the :raw-html:`<tt>` `DataLayout`_
201:raw-html:`</tt>` class) are designed to be subclassed by the concrete target
202implementation, and have virtual methods implemented. To get to these
203implementations, the :raw-html:`<tt>` `TargetMachine`_ :raw-html:`</tt>` class
204provides accessors that should be implemented by the target.
205
206.. _TargetMachine:
207
208The ``TargetMachine`` class
209---------------------------
210
211The ``TargetMachine`` class provides virtual methods that are used to access the
212target-specific implementations of the various target description classes via
213the ``get*Info`` methods (``getInstrInfo``, ``getRegisterInfo``,
214``getFrameInfo``, etc.). This class is designed to be specialized by a concrete
215target implementation (e.g., ``X86TargetMachine``) which implements the various
216virtual methods. The only required target description class is the
217:raw-html:`<tt>` `DataLayout`_ :raw-html:`</tt>` class, but if the code
218generator components are to be used, the other interfaces should be implemented
219as well.
220
221.. _DataLayout:
222
223The ``DataLayout`` class
224------------------------
225
226The ``DataLayout`` class is the only required target description class, and it
227is the only class that is not extensible (you cannot derive a new class from
228it). ``DataLayout`` specifies information about how the target lays out memory
229for structures, the alignment requirements for various data types, the size of
230pointers in the target, and whether the target is little-endian or
231big-endian.
232
233.. _TargetLowering:
234
235The ``TargetLowering`` class
236----------------------------
237
238The ``TargetLowering`` class is used by SelectionDAG based instruction selectors
239primarily to describe how LLVM code should be lowered to SelectionDAG
240operations. Among other things, this class indicates:
241
242* an initial register class to use for various ``ValueType``\s,
243
244* which operations are natively supported by the target machine,
245
246* the return type of ``setcc`` operations,
247
248* the type to use for shift amounts, and
249
250* various high-level characteristics, like whether it is profitable to turn
251 division by a constant into a multiplication sequence.
252
253.. _TargetRegisterInfo:
254
255The ``TargetRegisterInfo`` class
256--------------------------------
257
258The ``TargetRegisterInfo`` class is used to describe the register file of the
259target and any interactions between the registers.
260
261Registers are represented in the code generator by unsigned integers. Physical
262registers (those that actually exist in the target description) are unique
263small numbers, and virtual registers are generally large. Note that
264register ``#0`` is reserved as a flag value.
265
266Each register in the processor description has an associated
267``TargetRegisterDesc`` entry, which provides a textual name for the register
268(used for assembly output and debugging dumps) and a set of aliases (used to
269indicate whether one register overlaps with another).
270
271In addition to the per-register description, the ``TargetRegisterInfo`` class
272exposes a set of processor specific register classes (instances of the
273``TargetRegisterClass`` class). Each register class contains sets of registers
274that have the same properties (for example, they are all 32-bit integer
275registers). Each SSA virtual register created by the instruction selector has
276an associated register class. When the register allocator runs, it replaces
277virtual registers with a physical register in the set.
278
279The target-specific implementations of these classes is auto-generated from a
280:doc:`TableGen/index` description of the register file.
281
282.. _TargetInstrInfo:
283
284The ``TargetInstrInfo`` class
285-----------------------------
286
287The ``TargetInstrInfo`` class is used to describe the machine instructions
288supported by the target. Descriptions define things like the mnemonic for
289the opcode, the number of operands, the list of implicit register uses and defs,
290whether the instruction has certain target-independent properties (accesses
291memory, is commutable, etc), and holds any target-specific flags.
292
293The ``TargetFrameLowering`` class
294---------------------------------
295
296The ``TargetFrameLowering`` class is used to provide information about the stack
297frame layout of the target. It holds the direction of stack growth, the known
298stack alignment on entry to each function, and the offset to the local area.
299The offset to the local area is the offset from the stack pointer on function
300entry to the first location where function data (local variables, spill
301locations) can be stored.
302
303The ``TargetSubtarget`` class
304-----------------------------
305
306The ``TargetSubtarget`` class is used to provide information about the specific
307chip set being targeted. A sub-target informs code generation of which
308instructions are supported, instruction latencies and instruction execution
309itinerary; i.e., which processing units are used, in what order, and for how
310long.
311
312The ``TargetJITInfo`` class
313---------------------------
314
315The ``TargetJITInfo`` class exposes an abstract interface used by the
316Just-In-Time code generator to perform target-specific activities, such as
317emitting stubs. If a ``TargetMachine`` supports JIT code generation, it should
318provide one of these objects through the ``getJITInfo`` method.
319
320.. _code being generated:
321.. _machine code representation:
322
323Machine code description classes
324================================
325
326At the high-level, LLVM code is translated to a machine specific representation
327formed out of :raw-html:`<tt>` `MachineFunction`_ :raw-html:`</tt>`,
328:raw-html:`<tt>` `MachineBasicBlock`_ :raw-html:`</tt>`, and :raw-html:`<tt>`
329`MachineInstr`_ :raw-html:`</tt>` instances (defined in
330``include/llvm/CodeGen``). This representation is completely target agnostic,
331representing instructions in their most abstract form: an opcode and a series of
332operands. This representation is designed to support both an SSA representation
333for machine code, as well as a register allocated, non-SSA form.
334
335.. _MachineInstr:
336
337The ``MachineInstr`` class
338--------------------------
339
340Target machine instructions are represented as instances of the ``MachineInstr``
341class. This class is an extremely abstract way of representing machine
342instructions. In particular, it only keeps track of an opcode number and a set
343of operands.
344
345The opcode number is a simple unsigned integer that only has meaning to a
346specific backend. All of the instructions for a target should be defined in the
347``*InstrInfo.td`` file for the target. The opcode enum values are auto-generated
348from this description. The ``MachineInstr`` class does not have any information
349about how to interpret the instruction (i.e., what the semantics of the
350instruction are); for that you must refer to the :raw-html:`<tt>`
351`TargetInstrInfo`_ :raw-html:`</tt>` class.
352
353The operands of a machine instruction can be of several different types: a
354register reference, a constant integer, a basic block reference, etc. In
355addition, a machine operand should be marked as a def or a use of the value
356(though only registers are allowed to be defs).
357
358By convention, the LLVM code generator orders instruction operands so that all
359register definitions come before the register uses, even on architectures that
360are normally printed in other orders. For example, the SPARC add instruction:
361"``add %i1, %i2, %i3``" adds the "%i1", and "%i2" registers and stores the
362result into the "%i3" register. In the LLVM code generator, the operands should
363be stored as "``%i3, %i1, %i2``": with the destination first.
364
365Keeping destination (definition) operands at the beginning of the operand list
366has several advantages. In particular, the debugging printer will print the
367instruction like this:
368
369.. code-block:: llvm
370
371 %r3 = add %i1, %i2
372
373Also if the first operand is a def, it is easier to `create instructions`_ whose
374only def is the first operand.
375
376.. _create instructions:
377
378Using the ``MachineInstrBuilder.h`` functions
379^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
380
381Machine instructions are created by using the ``BuildMI`` functions, located in
382the ``include/llvm/CodeGen/MachineInstrBuilder.h`` file. The ``BuildMI``
383functions make it easy to build arbitrary machine instructions. Usage of the
384``BuildMI`` functions look like this:
385
386.. code-block:: c++
387
388 // Create a 'DestReg = mov 42' (rendered in X86 assembly as 'mov DestReg, 42')
389 // instruction and insert it at the end of the given MachineBasicBlock.
390 const TargetInstrInfo &TII = ...
391 MachineBasicBlock &MBB = ...
392 DebugLoc DL;
393 MachineInstr *MI = BuildMI(MBB, DL, TII.get(X86::MOV32ri), DestReg).addImm(42);
394
395 // Create the same instr, but insert it before a specified iterator point.
396 MachineBasicBlock::iterator MBBI = ...
397 BuildMI(MBB, MBBI, DL, TII.get(X86::MOV32ri), DestReg).addImm(42);
398
399 // Create a 'cmp Reg, 0' instruction, no destination reg.
400 MI = BuildMI(MBB, DL, TII.get(X86::CMP32ri8)).addReg(Reg).addImm(42);
401
402 // Create an 'sahf' instruction which takes no operands and stores nothing.
403 MI = BuildMI(MBB, DL, TII.get(X86::SAHF));
404
405 // Create a self looping branch instruction.
406 BuildMI(MBB, DL, TII.get(X86::JNE)).addMBB(&MBB);
407
408If you need to add a definition operand (other than the optional destination
409register), you must explicitly mark it as such:
410
411.. code-block:: c++
412
413 MI.addReg(Reg, RegState::Define);
414
415Fixed (preassigned) registers
416^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
417
418One important issue that the code generator needs to be aware of is the presence
419of fixed registers. In particular, there are often places in the instruction
420stream where the register allocator *must* arrange for a particular value to be
421in a particular register. This can occur due to limitations of the instruction
422set (e.g., the X86 can only do a 32-bit divide with the ``EAX``/``EDX``
423registers), or external factors like calling conventions. In any case, the
424instruction selector should emit code that copies a virtual register into or out
425of a physical register when needed.
426
427For example, consider this simple LLVM example:
428
429.. code-block:: llvm
430
431 define i32 @test(i32 %X, i32 %Y) {
432 %Z = sdiv i32 %X, %Y
433 ret i32 %Z
434 }
435
436The X86 instruction selector might produce this machine code for the ``div`` and
437``ret``:
438
439.. code-block:: text
440
441 ;; Start of div
442 %EAX = mov %reg1024 ;; Copy X (in reg1024) into EAX
443 %reg1027 = sar %reg1024, 31
444 %EDX = mov %reg1027 ;; Sign extend X into EDX
445 idiv %reg1025 ;; Divide by Y (in reg1025)
446 %reg1026 = mov %EAX ;; Read the result (Z) out of EAX
447
448 ;; Start of ret
449 %EAX = mov %reg1026 ;; 32-bit return value goes in EAX
450 ret
451
452By the end of code generation, the register allocator would coalesce the
453registers and delete the resultant identity moves producing the following
454code:
455
456.. code-block:: text
457
458 ;; X is in EAX, Y is in ECX
459 mov %EAX, %EDX
460 sar %EDX, 31
461 idiv %ECX
462 ret
463
464This approach is extremely general (if it can handle the X86 architecture, it
465can handle anything!) and allows all of the target specific knowledge about the
466instruction stream to be isolated in the instruction selector. Note that
467physical registers should have a short lifetime for good code generation, and
468all physical registers are assumed dead on entry to and exit from basic blocks
469(before register allocation). Thus, if you need a value to be live across basic
470block boundaries, it *must* live in a virtual register.
471
472Call-clobbered registers
473^^^^^^^^^^^^^^^^^^^^^^^^
474
475Some machine instructions, like calls, clobber a large number of physical
476registers. Rather than adding ``<def,dead>`` operands for all of them, it is
477possible to use an ``MO_RegisterMask`` operand instead. The register mask
478operand holds a bit mask of preserved registers, and everything else is
479considered to be clobbered by the instruction.
480
481Machine code in SSA form
482^^^^^^^^^^^^^^^^^^^^^^^^
483
484``MachineInstr``'s are initially selected in SSA-form, and are maintained in
485SSA-form until register allocation happens. For the most part, this is
486trivially simple since LLVM is already in SSA form; LLVM PHI nodes become
487machine code PHI nodes, and virtual registers are only allowed to have a single
488definition.
489
490After register allocation, machine code is no longer in SSA-form because there
491are no virtual registers left in the code.
492
493.. _MachineBasicBlock:
494
495The ``MachineBasicBlock`` class
496-------------------------------
497
498The ``MachineBasicBlock`` class contains a list of machine instructions
499(:raw-html:`<tt>` `MachineInstr`_ :raw-html:`</tt>` instances). It roughly
500corresponds to the LLVM code input to the instruction selector, but there can be
501a one-to-many mapping (i.e. one LLVM basic block can map to multiple machine
502basic blocks). The ``MachineBasicBlock`` class has a "``getBasicBlock``" method,
503which returns the LLVM basic block that it comes from.
504
505.. _MachineFunction:
506
507The ``MachineFunction`` class
508-----------------------------
509
510The ``MachineFunction`` class contains a list of machine basic blocks
511(:raw-html:`<tt>` `MachineBasicBlock`_ :raw-html:`</tt>` instances). It
512corresponds one-to-one with the LLVM function input to the instruction selector.
513In addition to a list of basic blocks, the ``MachineFunction`` contains a a
514``MachineConstantPool``, a ``MachineFrameInfo``, a ``MachineFunctionInfo``, and
515a ``MachineRegisterInfo``. See ``include/llvm/CodeGen/MachineFunction.h`` for
516more information.
517
518``MachineInstr Bundles``
519------------------------
520
521LLVM code generator can model sequences of instructions as MachineInstr
522bundles. A MI bundle can model a VLIW group / pack which contains an arbitrary
523number of parallel instructions. It can also be used to model a sequential list
524of instructions (potentially with data dependencies) that cannot be legally
525separated (e.g. ARM Thumb2 IT blocks).
526
527Conceptually a MI bundle is a MI with a number of other MIs nested within:
528
529::
530
531 --------------
532 | Bundle | ---------
533 -------------- \
534 | ----------------
535 | | MI |
536 | ----------------
537 | |
538 | ----------------
539 | | MI |
540 | ----------------
541 | |
542 | ----------------
543 | | MI |
544 | ----------------
545 |
546 --------------
547 | Bundle | --------
548 -------------- \
549 | ----------------
550 | | MI |
551 | ----------------
552 | |
553 | ----------------
554 | | MI |
555 | ----------------
556 | |
557 | ...
558 |
559 --------------
560 | Bundle | --------
561 -------------- \
562 |
563 ...
564
565MI bundle support does not change the physical representations of
566MachineBasicBlock and MachineInstr. All the MIs (including top level and nested
567ones) are stored as sequential list of MIs. The "bundled" MIs are marked with
568the 'InsideBundle' flag. A top level MI with the special BUNDLE opcode is used
Hiroshi Inouec36a1f12018-06-15 05:10:09 +0000569to represent the start of a bundle. It's legal to mix BUNDLE MIs with individual
Sean Eveson661e4fb2017-11-30 12:43:25 +0000570MIs that are not inside bundles nor represent bundles.
571
572MachineInstr passes should operate on a MI bundle as a single unit. Member
573methods have been taught to correctly handle bundles and MIs inside bundles.
574The MachineBasicBlock iterator has been modified to skip over bundled MIs to
575enforce the bundle-as-a-single-unit concept. An alternative iterator
576instr_iterator has been added to MachineBasicBlock to allow passes to iterate
577over all of the MIs in a MachineBasicBlock, including those which are nested
578inside bundles. The top level BUNDLE instruction must have the correct set of
579register MachineOperand's that represent the cumulative inputs and outputs of
580the bundled MIs.
581
582Packing / bundling of MachineInstr's should be done as part of the register
583allocation super-pass. More specifically, the pass which determines what MIs
584should be bundled together must be done after code generator exits SSA form
585(i.e. after two-address pass, PHI elimination, and copy coalescing). Bundles
586should only be finalized (i.e. adding BUNDLE MIs and input and output register
587MachineOperands) after virtual registers have been rewritten into physical
588registers. This requirement eliminates the need to add virtual register operands
589to BUNDLE instructions which would effectively double the virtual register def
590and use lists.
591
592.. _MC Layer:
593
594The "MC" Layer
595==============
596
597The MC Layer is used to represent and process code at the raw machine code
598level, devoid of "high level" information like "constant pools", "jump tables",
599"global variables" or anything like that. At this level, LLVM handles things
600like label names, machine instructions, and sections in the object file. The
601code in this layer is used for a number of important purposes: the tail end of
602the code generator uses it to write a .s or .o file, and it is also used by the
603llvm-mc tool to implement standalone machine code assemblers and disassemblers.
604
605This section describes some of the important classes. There are also a number
606of important subsystems that interact at this layer, they are described later in
607this manual.
608
609.. _MCStreamer:
610
611The ``MCStreamer`` API
612----------------------
613
614MCStreamer is best thought of as an assembler API. It is an abstract API which
615is *implemented* in different ways (e.g. to output a .s file, output an ELF .o
616file, etc) but whose API correspond directly to what you see in a .s file.
617MCStreamer has one method per directive, such as EmitLabel, EmitSymbolAttribute,
618SwitchSection, EmitValue (for .byte, .word), etc, which directly correspond to
619assembly level directives. It also has an EmitInstruction method, which is used
620to output an MCInst to the streamer.
621
622This API is most important for two clients: the llvm-mc stand-alone assembler is
623effectively a parser that parses a line, then invokes a method on MCStreamer. In
624the code generator, the `Code Emission`_ phase of the code generator lowers
625higher level LLVM IR and Machine* constructs down to the MC layer, emitting
626directives through MCStreamer.
627
628On the implementation side of MCStreamer, there are two major implementations:
629one for writing out a .s file (MCAsmStreamer), and one for writing out a .o
630file (MCObjectStreamer). MCAsmStreamer is a straightforward implementation
631that prints out a directive for each method (e.g. ``EmitValue -> .byte``), but
632MCObjectStreamer implements a full assembler.
633
634For target specific directives, the MCStreamer has a MCTargetStreamer instance.
635Each target that needs it defines a class that inherits from it and is a lot
636like MCStreamer itself: It has one method per directive and two classes that
637inherit from it, a target object streamer and a target asm streamer. The target
638asm streamer just prints it (``emitFnStart -> .fnstart``), and the object
639streamer implement the assembler logic for it.
640
641To make llvm use these classes, the target initialization must call
642TargetRegistry::RegisterAsmStreamer and TargetRegistry::RegisterMCObjectStreamer
643passing callbacks that allocate the corresponding target streamer and pass it
644to createAsmStreamer or to the appropriate object streamer constructor.
645
646The ``MCContext`` class
647-----------------------
648
649The MCContext class is the owner of a variety of uniqued data structures at the
650MC layer, including symbols, sections, etc. As such, this is the class that you
651interact with to create symbols and sections. This class can not be subclassed.
652
653The ``MCSymbol`` class
654----------------------
655
656The MCSymbol class represents a symbol (aka label) in the assembly file. There
657are two interesting kinds of symbols: assembler temporary symbols, and normal
658symbols. Assembler temporary symbols are used and processed by the assembler
659but are discarded when the object file is produced. The distinction is usually
660represented by adding a prefix to the label, for example "L" labels are
661assembler temporary labels in MachO.
662
663MCSymbols are created by MCContext and uniqued there. This means that MCSymbols
664can be compared for pointer equivalence to find out if they are the same symbol.
665Note that pointer inequality does not guarantee the labels will end up at
666different addresses though. It's perfectly legal to output something like this
667to the .s file:
668
669::
670
671 foo:
672 bar:
673 .byte 4
674
675In this case, both the foo and bar symbols will have the same address.
676
677The ``MCSection`` class
678-----------------------
679
680The ``MCSection`` class represents an object-file specific section. It is
681subclassed by object file specific implementations (e.g. ``MCSectionMachO``,
682``MCSectionCOFF``, ``MCSectionELF``) and these are created and uniqued by
683MCContext. The MCStreamer has a notion of the current section, which can be
684changed with the SwitchToSection method (which corresponds to a ".section"
685directive in a .s file).
686
687.. _MCInst:
688
689The ``MCInst`` class
690--------------------
691
692The ``MCInst`` class is a target-independent representation of an instruction.
693It is a simple class (much more so than `MachineInstr`_) that holds a
694target-specific opcode and a vector of MCOperands. MCOperand, in turn, is a
695simple discriminated union of three cases: 1) a simple immediate, 2) a target
696register ID, 3) a symbolic expression (e.g. "``Lfoo-Lbar+42``") as an MCExpr.
697
698MCInst is the common currency used to represent machine instructions at the MC
699layer. It is the type used by the instruction encoder, the instruction printer,
700and the type generated by the assembly parser and disassembler.
701
702.. _Target-independent algorithms:
703.. _code generation algorithm:
704
705Target-independent code generation algorithms
706=============================================
707
708This section documents the phases described in the `high-level design of the
709code generator`_. It explains how they work and some of the rationale behind
710their design.
711
712.. _Instruction Selection:
713.. _instruction selection section:
714
715Instruction Selection
716---------------------
717
718Instruction Selection is the process of translating LLVM code presented to the
719code generator into target-specific machine instructions. There are several
720well-known ways to do this in the literature. LLVM uses a SelectionDAG based
721instruction selector.
722
723Portions of the DAG instruction selector are generated from the target
724description (``*.td``) files. Our goal is for the entire instruction selector
725to be generated from these ``.td`` files, though currently there are still
726things that require custom C++ code.
727
728.. _SelectionDAG:
729
730Introduction to SelectionDAGs
731^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
732
733The SelectionDAG provides an abstraction for code representation in a way that
734is amenable to instruction selection using automatic techniques
735(e.g. dynamic-programming based optimal pattern matching selectors). It is also
736well-suited to other phases of code generation; in particular, instruction
737scheduling (SelectionDAG's are very close to scheduling DAGs post-selection).
738Additionally, the SelectionDAG provides a host representation where a large
739variety of very-low-level (but target-independent) `optimizations`_ may be
740performed; ones which require extensive information about the instructions
741efficiently supported by the target.
742
743The SelectionDAG is a Directed-Acyclic-Graph whose nodes are instances of the
744``SDNode`` class. The primary payload of the ``SDNode`` is its operation code
745(Opcode) that indicates what operation the node performs and the operands to the
746operation. The various operation node types are described at the top of the
747``include/llvm/CodeGen/ISDOpcodes.h`` file.
748
749Although most operations define a single value, each node in the graph may
750define multiple values. For example, a combined div/rem operation will define
751both the dividend and the remainder. Many other situations require multiple
752values as well. Each node also has some number of operands, which are edges to
753the node defining the used value. Because nodes may define multiple values,
754edges are represented by instances of the ``SDValue`` class, which is a
755``<SDNode, unsigned>`` pair, indicating the node and result value being used,
756respectively. Each value produced by an ``SDNode`` has an associated ``MVT``
757(Machine Value Type) indicating what the type of the value is.
758
759SelectionDAGs contain two different kinds of values: those that represent data
760flow and those that represent control flow dependencies. Data values are simple
761edges with an integer or floating point value type. Control edges are
762represented as "chain" edges which are of type ``MVT::Other``. These edges
763provide an ordering between nodes that have side effects (such as loads, stores,
764calls, returns, etc). All nodes that have side effects should take a token
765chain as input and produce a new one as output. By convention, token chain
766inputs are always operand #0, and chain results are always the last value
767produced by an operation. However, after instruction selection, the
768machine nodes have their chain after the instruction's operands, and
769may be followed by glue nodes.
770
771A SelectionDAG has designated "Entry" and "Root" nodes. The Entry node is
772always a marker node with an Opcode of ``ISD::EntryToken``. The Root node is
773the final side-effecting node in the token chain. For example, in a single basic
774block function it would be the return node.
775
776One important concept for SelectionDAGs is the notion of a "legal" vs.
777"illegal" DAG. A legal DAG for a target is one that only uses supported
778operations and supported types. On a 32-bit PowerPC, for example, a DAG with a
779value of type i1, i8, i16, or i64 would be illegal, as would a DAG that uses a
780SREM or UREM operation. The `legalize types`_ and `legalize operations`_ phases
781are responsible for turning an illegal DAG into a legal DAG.
782
783.. _SelectionDAG-Process:
784
785SelectionDAG Instruction Selection Process
786^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
787
788SelectionDAG-based instruction selection consists of the following steps:
789
790#. `Build initial DAG`_ --- This stage performs a simple translation from the
791 input LLVM code to an illegal SelectionDAG.
792
793#. `Optimize SelectionDAG`_ --- This stage performs simple optimizations on the
794 SelectionDAG to simplify it, and recognize meta instructions (like rotates
795 and ``div``/``rem`` pairs) for targets that support these meta operations.
796 This makes the resultant code more efficient and the `select instructions
797 from DAG`_ phase (below) simpler.
798
799#. `Legalize SelectionDAG Types`_ --- This stage transforms SelectionDAG nodes
800 to eliminate any types that are unsupported on the target.
801
802#. `Optimize SelectionDAG`_ --- The SelectionDAG optimizer is run to clean up
803 redundancies exposed by type legalization.
804
805#. `Legalize SelectionDAG Ops`_ --- This stage transforms SelectionDAG nodes to
806 eliminate any operations that are unsupported on the target.
807
808#. `Optimize SelectionDAG`_ --- The SelectionDAG optimizer is run to eliminate
809 inefficiencies introduced by operation legalization.
810
811#. `Select instructions from DAG`_ --- Finally, the target instruction selector
812 matches the DAG operations to target instructions. This process translates
813 the target-independent input DAG into another DAG of target instructions.
814
815#. `SelectionDAG Scheduling and Formation`_ --- The last phase assigns a linear
816 order to the instructions in the target-instruction DAG and emits them into
817 the MachineFunction being compiled. This step uses traditional prepass
818 scheduling techniques.
819
820After all of these steps are complete, the SelectionDAG is destroyed and the
821rest of the code generation passes are run.
822
823One great way to visualize what is going on here is to take advantage of a few
824LLC command line options. The following options pop up a window displaying the
825SelectionDAG at specific times (if you only get errors printed to the console
826while using this, you probably `need to configure your
827system <ProgrammersManual.html#viewing-graphs-while-debugging-code>`_ to add support for it).
828
829* ``-view-dag-combine1-dags`` displays the DAG after being built, before the
830 first optimization pass.
831
832* ``-view-legalize-dags`` displays the DAG before Legalization.
833
834* ``-view-dag-combine2-dags`` displays the DAG before the second optimization
835 pass.
836
837* ``-view-isel-dags`` displays the DAG before the Select phase.
838
839* ``-view-sched-dags`` displays the DAG before Scheduling.
840
841The ``-view-sunit-dags`` displays the Scheduler's dependency graph. This graph
842is based on the final SelectionDAG, with nodes that must be scheduled together
843bundled into a single scheduling-unit node, and with immediate operands and
844other nodes that aren't relevant for scheduling omitted.
845
846The option ``-filter-view-dags`` allows to select the name of the basic block
847that you are interested to visualize and filters all the previous
848``view-*-dags`` options.
849
850.. _Build initial DAG:
851
852Initial SelectionDAG Construction
853^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
854
855The initial SelectionDAG is na\ :raw-html:`&iuml;`\ vely peephole expanded from
856the LLVM input by the ``SelectionDAGBuilder`` class. The intent of this pass
857is to expose as much low-level, target-specific details to the SelectionDAG as
858possible. This pass is mostly hard-coded (e.g. an LLVM ``add`` turns into an
859``SDNode add`` while a ``getelementptr`` is expanded into the obvious
860arithmetic). This pass requires target-specific hooks to lower calls, returns,
861varargs, etc. For these features, the :raw-html:`<tt>` `TargetLowering`_
862:raw-html:`</tt>` interface is used.
863
864.. _legalize types:
865.. _Legalize SelectionDAG Types:
866.. _Legalize SelectionDAG Ops:
867
868SelectionDAG LegalizeTypes Phase
869^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
870
871The Legalize phase is in charge of converting a DAG to only use the types that
872are natively supported by the target.
873
874There are two main ways of converting values of unsupported scalar types to
875values of supported types: converting small types to larger types ("promoting"),
876and breaking up large integer types into smaller ones ("expanding"). For
877example, a target might require that all f32 values are promoted to f64 and that
878all i1/i8/i16 values are promoted to i32. The same target might require that
879all i64 values be expanded into pairs of i32 values. These changes can insert
880sign and zero extensions as needed to make sure that the final code has the same
881behavior as the input.
882
883There are two main ways of converting values of unsupported vector types to
884value of supported types: splitting vector types, multiple times if necessary,
885until a legal type is found, and extending vector types by adding elements to
886the end to round them out to legal types ("widening"). If a vector gets split
887all the way down to single-element parts with no supported vector type being
888found, the elements are converted to scalars ("scalarizing").
889
890A target implementation tells the legalizer which types are supported (and which
891register class to use for them) by calling the ``addRegisterClass`` method in
892its ``TargetLowering`` constructor.
893
894.. _legalize operations:
895.. _Legalizer:
896
897SelectionDAG Legalize Phase
898^^^^^^^^^^^^^^^^^^^^^^^^^^^
899
900The Legalize phase is in charge of converting a DAG to only use the operations
901that are natively supported by the target.
902
903Targets often have weird constraints, such as not supporting every operation on
904every supported datatype (e.g. X86 does not support byte conditional moves and
905PowerPC does not support sign-extending loads from a 16-bit memory location).
906Legalize takes care of this by open-coding another sequence of operations to
907emulate the operation ("expansion"), by promoting one type to a larger type that
908supports the operation ("promotion"), or by using a target-specific hook to
909implement the legalization ("custom").
910
911A target implementation tells the legalizer which operations are not supported
912(and which of the above three actions to take) by calling the
913``setOperationAction`` method in its ``TargetLowering`` constructor.
914
Sanjay Patel6a554182019-05-22 00:32:25 +0000915If a target has legal vector types, it is expected to produce efficient machine
916code for common forms of the shufflevector IR instruction using those types.
917This may require custom legalization for SelectionDAG vector operations that
918are created from the shufflevector IR. The shufflevector forms that should be
919handled include:
920
921* Vector select --- Each element of the vector is chosen from either of the
922corresponding elements of the 2 input vectors. This operation may also be
923known as a "blend" or "bitwise select" in target assembly. This type of shuffle
924maps directly to the ``shuffle_vector`` SelectionDAG node.
925
926* Insert subvector --- A vector is placed into a longer vector type starting
927at index 0. This type of shuffle maps directly to the ``insert_subvector``
928SelectionDAG node with the ``index`` operand set to 0.
929
930* Extract subvector --- A vector is pulled from a longer vector type starting
931at index 0. This type of shuffle maps directly to the ``extract_subvector``
932SelectionDAG node with the ``index`` operand set to 0.
933
934* Splat --- All elements of the vector have identical scalar elements. This
935operation may also be known as a "broadcast" or "duplicate" in target assembly.
936The shufflevector IR instruction may change the vector length, so this operation
937may map to multiple SelectionDAG nodes including ``shuffle_vector``,
938``concat_vectors``, ``insert_subvector``, and ``extract_subvector``.
939
Sean Eveson661e4fb2017-11-30 12:43:25 +0000940Prior to the existence of the Legalize passes, we required that every target
941`selector`_ supported and handled every operator and type even if they are not
942natively supported. The introduction of the Legalize phases allows all of the
943canonicalization patterns to be shared across targets, and makes it very easy to
944optimize the canonicalized code because it is still in the form of a DAG.
945
946.. _optimizations:
947.. _Optimize SelectionDAG:
948.. _selector:
949
950SelectionDAG Optimization Phase: the DAG Combiner
951^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
952
953The SelectionDAG optimization phase is run multiple times for code generation,
954immediately after the DAG is built and once after each legalization. The first
955run of the pass allows the initial code to be cleaned up (e.g. performing
956optimizations that depend on knowing that the operators have restricted type
957inputs). Subsequent runs of the pass clean up the messy code generated by the
958Legalize passes, which allows Legalize to be very simple (it can focus on making
959code legal instead of focusing on generating *good* and legal code).
960
961One important class of optimizations performed is optimizing inserted sign and
962zero extension instructions. We currently use ad-hoc techniques, but could move
963to more rigorous techniques in the future. Here are some good papers on the
964subject:
965
966"`Widening integer arithmetic <http://www.eecs.harvard.edu/~nr/pubs/widen-abstract.html>`_" :raw-html:`<br>`
967Kevin Redwine and Norman Ramsey :raw-html:`<br>`
968International Conference on Compiler Construction (CC) 2004
969
970"`Effective sign extension elimination <http://portal.acm.org/citation.cfm?doid=512529.512552>`_" :raw-html:`<br>`
971Motohiro Kawahito, Hideaki Komatsu, and Toshio Nakatani :raw-html:`<br>`
972Proceedings of the ACM SIGPLAN 2002 Conference on Programming Language Design
973and Implementation.
974
975.. _Select instructions from DAG:
976
977SelectionDAG Select Phase
978^^^^^^^^^^^^^^^^^^^^^^^^^
979
980The Select phase is the bulk of the target-specific code for instruction
981selection. This phase takes a legal SelectionDAG as input, pattern matches the
982instructions supported by the target to this DAG, and produces a new DAG of
983target code. For example, consider the following LLVM fragment:
984
985.. code-block:: llvm
986
987 %t1 = fadd float %W, %X
988 %t2 = fmul float %t1, %Y
989 %t3 = fadd float %t2, %Z
990
991This LLVM code corresponds to a SelectionDAG that looks basically like this:
992
993.. code-block:: text
994
995 (fadd:f32 (fmul:f32 (fadd:f32 W, X), Y), Z)
996
997If a target supports floating point multiply-and-add (FMA) operations, one of
998the adds can be merged with the multiply. On the PowerPC, for example, the
999output of the instruction selector might look like this DAG:
1000
1001::
1002
1003 (FMADDS (FADDS W, X), Y, Z)
1004
1005The ``FMADDS`` instruction is a ternary instruction that multiplies its first
1006two operands and adds the third (as single-precision floating-point numbers).
1007The ``FADDS`` instruction is a simple binary single-precision add instruction.
1008To perform this pattern match, the PowerPC backend includes the following
1009instruction definitions:
1010
1011.. code-block:: text
1012 :emphasize-lines: 4-5,9
1013
1014 def FMADDS : AForm_1<59, 29,
1015 (ops F4RC:$FRT, F4RC:$FRA, F4RC:$FRC, F4RC:$FRB),
1016 "fmadds $FRT, $FRA, $FRC, $FRB",
1017 [(set F4RC:$FRT, (fadd (fmul F4RC:$FRA, F4RC:$FRC),
1018 F4RC:$FRB))]>;
1019 def FADDS : AForm_2<59, 21,
1020 (ops F4RC:$FRT, F4RC:$FRA, F4RC:$FRB),
1021 "fadds $FRT, $FRA, $FRB",
1022 [(set F4RC:$FRT, (fadd F4RC:$FRA, F4RC:$FRB))]>;
1023
1024The highlighted portion of the instruction definitions indicates the pattern
1025used to match the instructions. The DAG operators (like ``fmul``/``fadd``)
1026are defined in the ``include/llvm/Target/TargetSelectionDAG.td`` file.
1027"``F4RC``" is the register class of the input and result values.
1028
1029The TableGen DAG instruction selector generator reads the instruction patterns
1030in the ``.td`` file and automatically builds parts of the pattern matching code
1031for your target. It has the following strengths:
1032
1033* At compiler-compile time, it analyzes your instruction patterns and tells you
1034 if your patterns make sense or not.
1035
1036* It can handle arbitrary constraints on operands for the pattern match. In
1037 particular, it is straight-forward to say things like "match any immediate
1038 that is a 13-bit sign-extended value". For examples, see the ``immSExt16``
1039 and related ``tblgen`` classes in the PowerPC backend.
1040
1041* It knows several important identities for the patterns defined. For example,
1042 it knows that addition is commutative, so it allows the ``FMADDS`` pattern
1043 above to match "``(fadd X, (fmul Y, Z))``" as well as "``(fadd (fmul X, Y),
1044 Z)``", without the target author having to specially handle this case.
1045
1046* It has a full-featured type-inferencing system. In particular, you should
1047 rarely have to explicitly tell the system what type parts of your patterns
1048 are. In the ``FMADDS`` case above, we didn't have to tell ``tblgen`` that all
1049 of the nodes in the pattern are of type 'f32'. It was able to infer and
1050 propagate this knowledge from the fact that ``F4RC`` has type 'f32'.
1051
1052* Targets can define their own (and rely on built-in) "pattern fragments".
1053 Pattern fragments are chunks of reusable patterns that get inlined into your
1054 patterns during compiler-compile time. For example, the integer "``(not
1055 x)``" operation is actually defined as a pattern fragment that expands as
1056 "``(xor x, -1)``", since the SelectionDAG does not have a native '``not``'
1057 operation. Targets can define their own short-hand fragments as they see fit.
1058 See the definition of '``not``' and '``ineg``' for examples.
1059
1060* In addition to instructions, targets can specify arbitrary patterns that map
1061 to one or more instructions using the 'Pat' class. For example, the PowerPC
1062 has no way to load an arbitrary integer immediate into a register in one
1063 instruction. To tell tblgen how to do this, it defines:
1064
1065 ::
1066
1067 // Arbitrary immediate support. Implement in terms of LIS/ORI.
1068 def : Pat<(i32 imm:$imm),
1069 (ORI (LIS (HI16 imm:$imm)), (LO16 imm:$imm))>;
1070
1071 If none of the single-instruction patterns for loading an immediate into a
1072 register match, this will be used. This rule says "match an arbitrary i32
1073 immediate, turning it into an ``ORI`` ('or a 16-bit immediate') and an ``LIS``
1074 ('load 16-bit immediate, where the immediate is shifted to the left 16 bits')
1075 instruction". To make this work, the ``LO16``/``HI16`` node transformations
1076 are used to manipulate the input immediate (in this case, take the high or low
1077 16-bits of the immediate).
1078
1079* When using the 'Pat' class to map a pattern to an instruction that has one
1080 or more complex operands (like e.g. `X86 addressing mode`_), the pattern may
1081 either specify the operand as a whole using a ``ComplexPattern``, or else it
1082 may specify the components of the complex operand separately. The latter is
1083 done e.g. for pre-increment instructions by the PowerPC back end:
1084
1085 ::
1086
1087 def STWU : DForm_1<37, (outs ptr_rc:$ea_res), (ins GPRC:$rS, memri:$dst),
1088 "stwu $rS, $dst", LdStStoreUpd, []>,
1089 RegConstraint<"$dst.reg = $ea_res">, NoEncode<"$ea_res">;
1090
1091 def : Pat<(pre_store GPRC:$rS, ptr_rc:$ptrreg, iaddroff:$ptroff),
1092 (STWU GPRC:$rS, iaddroff:$ptroff, ptr_rc:$ptrreg)>;
1093
1094 Here, the pair of ``ptroff`` and ``ptrreg`` operands is matched onto the
1095 complex operand ``dst`` of class ``memri`` in the ``STWU`` instruction.
1096
1097* While the system does automate a lot, it still allows you to write custom C++
1098 code to match special cases if there is something that is hard to
1099 express.
1100
1101While it has many strengths, the system currently has some limitations,
1102primarily because it is a work in progress and is not yet finished:
1103
1104* Overall, there is no way to define or match SelectionDAG nodes that define
1105 multiple values (e.g. ``SMUL_LOHI``, ``LOAD``, ``CALL``, etc). This is the
1106 biggest reason that you currently still *have to* write custom C++ code
1107 for your instruction selector.
1108
1109* There is no great way to support matching complex addressing modes yet. In
1110 the future, we will extend pattern fragments to allow them to define multiple
1111 values (e.g. the four operands of the `X86 addressing mode`_, which are
1112 currently matched with custom C++ code). In addition, we'll extend fragments
1113 so that a fragment can match multiple different patterns.
1114
1115* We don't automatically infer flags like ``isStore``/``isLoad`` yet.
1116
1117* We don't automatically generate the set of supported registers and operations
1118 for the `Legalizer`_ yet.
1119
1120* We don't have a way of tying in custom legalized nodes yet.
1121
1122Despite these limitations, the instruction selector generator is still quite
1123useful for most of the binary and logical operations in typical instruction
1124sets. If you run into any problems or can't figure out how to do something,
1125please let Chris know!
1126
1127.. _Scheduling and Formation:
1128.. _SelectionDAG Scheduling and Formation:
1129
1130SelectionDAG Scheduling and Formation Phase
1131^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1132
1133The scheduling phase takes the DAG of target instructions from the selection
1134phase and assigns an order. The scheduler can pick an order depending on
1135various constraints of the machines (i.e. order for minimal register pressure or
1136try to cover instruction latencies). Once an order is established, the DAG is
1137converted to a list of :raw-html:`<tt>` `MachineInstr`_\s :raw-html:`</tt>` and
1138the SelectionDAG is destroyed.
1139
1140Note that this phase is logically separate from the instruction selection phase,
1141but is tied to it closely in the code because it operates on SelectionDAGs.
1142
1143Future directions for the SelectionDAG
1144^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1145
1146#. Optional function-at-a-time selection.
1147
1148#. Auto-generate entire selector from ``.td`` file.
1149
1150.. _SSA-based Machine Code Optimizations:
1151
1152SSA-based Machine Code Optimizations
1153------------------------------------
1154
1155To Be Written
1156
1157Live Intervals
1158--------------
1159
1160Live Intervals are the ranges (intervals) where a variable is *live*. They are
1161used by some `register allocator`_ passes to determine if two or more virtual
1162registers which require the same physical register are live at the same point in
1163the program (i.e., they conflict). When this situation occurs, one virtual
1164register must be *spilled*.
1165
1166Live Variable Analysis
1167^^^^^^^^^^^^^^^^^^^^^^
1168
1169The first step in determining the live intervals of variables is to calculate
1170the set of registers that are immediately dead after the instruction (i.e., the
1171instruction calculates the value, but it is never used) and the set of registers
1172that are used by the instruction, but are never used after the instruction
1173(i.e., they are killed). Live variable information is computed for
1174each *virtual* register and *register allocatable* physical register
1175in the function. This is done in a very efficient manner because it uses SSA to
1176sparsely compute lifetime information for virtual registers (which are in SSA
1177form) and only has to track physical registers within a block. Before register
1178allocation, LLVM can assume that physical registers are only live within a
1179single basic block. This allows it to do a single, local analysis to resolve
1180physical register lifetimes within each basic block. If a physical register is
1181not register allocatable (e.g., a stack pointer or condition codes), it is not
1182tracked.
1183
1184Physical registers may be live in to or out of a function. Live in values are
1185typically arguments in registers. Live out values are typically return values in
1186registers. Live in values are marked as such, and are given a dummy "defining"
1187instruction during live intervals analysis. If the last basic block of a
1188function is a ``return``, then it's marked as using all live out values in the
1189function.
1190
1191``PHI`` nodes need to be handled specially, because the calculation of the live
1192variable information from a depth first traversal of the CFG of the function
1193won't guarantee that a virtual register used by the ``PHI`` node is defined
1194before it's used. When a ``PHI`` node is encountered, only the definition is
1195handled, because the uses will be handled in other basic blocks.
1196
1197For each ``PHI`` node of the current basic block, we simulate an assignment at
1198the end of the current basic block and traverse the successor basic blocks. If a
1199successor basic block has a ``PHI`` node and one of the ``PHI`` node's operands
1200is coming from the current basic block, then the variable is marked as *alive*
1201within the current basic block and all of its predecessor basic blocks, until
1202the basic block with the defining instruction is encountered.
1203
1204Live Intervals Analysis
1205^^^^^^^^^^^^^^^^^^^^^^^
1206
1207We now have the information available to perform the live intervals analysis and
1208build the live intervals themselves. We start off by numbering the basic blocks
1209and machine instructions. We then handle the "live-in" values. These are in
1210physical registers, so the physical register is assumed to be killed by the end
1211of the basic block. Live intervals for virtual registers are computed for some
1212ordering of the machine instructions ``[1, N]``. A live interval is an interval
1213``[i, j)``, where ``1 >= i >= j > N``, for which a variable is live.
1214
1215.. note::
1216 More to come...
1217
1218.. _Register Allocation:
1219.. _register allocator:
1220
1221Register Allocation
1222-------------------
1223
1224The *Register Allocation problem* consists in mapping a program
1225:raw-html:`<b><tt>` P\ :sub:`v`\ :raw-html:`</tt></b>`, that can use an unbounded
1226number of virtual registers, to a program :raw-html:`<b><tt>` P\ :sub:`p`\
1227:raw-html:`</tt></b>` that contains a finite (possibly small) number of physical
1228registers. Each target architecture has a different number of physical
1229registers. If the number of physical registers is not enough to accommodate all
1230the virtual registers, some of them will have to be mapped into memory. These
1231virtuals are called *spilled virtuals*.
1232
1233How registers are represented in LLVM
1234^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1235
1236In LLVM, physical registers are denoted by integer numbers that normally range
1237from 1 to 1023. To see how this numbering is defined for a particular
1238architecture, you can read the ``GenRegisterNames.inc`` file for that
1239architecture. For instance, by inspecting
1240``lib/Target/X86/X86GenRegisterInfo.inc`` we see that the 32-bit register
1241``EAX`` is denoted by 43, and the MMX register ``MM0`` is mapped to 65.
1242
1243Some architectures contain registers that share the same physical location. A
1244notable example is the X86 platform. For instance, in the X86 architecture, the
1245registers ``EAX``, ``AX`` and ``AL`` share the first eight bits. These physical
1246registers are marked as *aliased* in LLVM. Given a particular architecture, you
1247can check which registers are aliased by inspecting its ``RegisterInfo.td``
1248file. Moreover, the class ``MCRegAliasIterator`` enumerates all the physical
1249registers aliased to a register.
1250
1251Physical registers, in LLVM, are grouped in *Register Classes*. Elements in the
1252same register class are functionally equivalent, and can be interchangeably
1253used. Each virtual register can only be mapped to physical registers of a
1254particular class. For instance, in the X86 architecture, some virtuals can only
1255be allocated to 8 bit registers. A register class is described by
1256``TargetRegisterClass`` objects. To discover if a virtual register is
1257compatible with a given physical, this code can be used:
1258
1259.. code-block:: c++
1260
1261 bool RegMapping_Fer::compatible_class(MachineFunction &mf,
1262 unsigned v_reg,
1263 unsigned p_reg) {
1264 assert(TargetRegisterInfo::isPhysicalRegister(p_reg) &&
1265 "Target register must be physical");
1266 const TargetRegisterClass *trc = mf.getRegInfo().getRegClass(v_reg);
1267 return trc->contains(p_reg);
1268 }
1269
1270Sometimes, mostly for debugging purposes, it is useful to change the number of
1271physical registers available in the target architecture. This must be done
1272statically, inside the ``TargetRegsterInfo.td`` file. Just ``grep`` for
1273``RegisterClass``, the last parameter of which is a list of registers. Just
1274commenting some out is one simple way to avoid them being used. A more polite
1275way is to explicitly exclude some registers from the *allocation order*. See the
1276definition of the ``GR8`` register class in
1277``lib/Target/X86/X86RegisterInfo.td`` for an example of this.
1278
1279Virtual registers are also denoted by integer numbers. Contrary to physical
1280registers, different virtual registers never share the same number. Whereas
1281physical registers are statically defined in a ``TargetRegisterInfo.td`` file
1282and cannot be created by the application developer, that is not the case with
1283virtual registers. In order to create new virtual registers, use the method
1284``MachineRegisterInfo::createVirtualRegister()``. This method will return a new
1285virtual register. Use an ``IndexedMap<Foo, VirtReg2IndexFunctor>`` to hold
1286information per virtual register. If you need to enumerate all virtual
1287registers, use the function ``TargetRegisterInfo::index2VirtReg()`` to find the
1288virtual register numbers:
1289
1290.. code-block:: c++
1291
1292 for (unsigned i = 0, e = MRI->getNumVirtRegs(); i != e; ++i) {
1293 unsigned VirtReg = TargetRegisterInfo::index2VirtReg(i);
1294 stuff(VirtReg);
1295 }
1296
1297Before register allocation, the operands of an instruction are mostly virtual
1298registers, although physical registers may also be used. In order to check if a
1299given machine operand is a register, use the boolean function
1300``MachineOperand::isRegister()``. To obtain the integer code of a register, use
1301``MachineOperand::getReg()``. An instruction may define or use a register. For
1302instance, ``ADD reg:1026 := reg:1025 reg:1024`` defines the registers 1024, and
1303uses registers 1025 and 1026. Given a register operand, the method
1304``MachineOperand::isUse()`` informs if that register is being used by the
1305instruction. The method ``MachineOperand::isDef()`` informs if that registers is
1306being defined.
1307
1308We will call physical registers present in the LLVM bitcode before register
1309allocation *pre-colored registers*. Pre-colored registers are used in many
1310different situations, for instance, to pass parameters of functions calls, and
1311to store results of particular instructions. There are two types of pre-colored
1312registers: the ones *implicitly* defined, and those *explicitly*
1313defined. Explicitly defined registers are normal operands, and can be accessed
1314with ``MachineInstr::getOperand(int)::getReg()``. In order to check which
1315registers are implicitly defined by an instruction, use the
1316``TargetInstrInfo::get(opcode)::ImplicitDefs``, where ``opcode`` is the opcode
1317of the target instruction. One important difference between explicit and
1318implicit physical registers is that the latter are defined statically for each
1319instruction, whereas the former may vary depending on the program being
1320compiled. For example, an instruction that represents a function call will
1321always implicitly define or use the same set of physical registers. To read the
1322registers implicitly used by an instruction, use
1323``TargetInstrInfo::get(opcode)::ImplicitUses``. Pre-colored registers impose
1324constraints on any register allocation algorithm. The register allocator must
1325make sure that none of them are overwritten by the values of virtual registers
1326while still alive.
1327
1328Mapping virtual registers to physical registers
1329^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1330
1331There are two ways to map virtual registers to physical registers (or to memory
1332slots). The first way, that we will call *direct mapping*, is based on the use
1333of methods of the classes ``TargetRegisterInfo``, and ``MachineOperand``. The
1334second way, that we will call *indirect mapping*, relies on the ``VirtRegMap``
1335class in order to insert loads and stores sending and getting values to and from
1336memory.
1337
1338The direct mapping provides more flexibility to the developer of the register
1339allocator; however, it is more error prone, and demands more implementation
1340work. Basically, the programmer will have to specify where load and store
1341instructions should be inserted in the target function being compiled in order
1342to get and store values in memory. To assign a physical register to a virtual
1343register present in a given operand, use ``MachineOperand::setReg(p_reg)``. To
1344insert a store instruction, use ``TargetInstrInfo::storeRegToStackSlot(...)``,
1345and to insert a load instruction, use ``TargetInstrInfo::loadRegFromStackSlot``.
1346
1347The indirect mapping shields the application developer from the complexities of
1348inserting load and store instructions. In order to map a virtual register to a
1349physical one, use ``VirtRegMap::assignVirt2Phys(vreg, preg)``. In order to map
1350a certain virtual register to memory, use
1351``VirtRegMap::assignVirt2StackSlot(vreg)``. This method will return the stack
1352slot where ``vreg``'s value will be located. If it is necessary to map another
1353virtual register to the same stack slot, use
1354``VirtRegMap::assignVirt2StackSlot(vreg, stack_location)``. One important point
1355to consider when using the indirect mapping, is that even if a virtual register
1356is mapped to memory, it still needs to be mapped to a physical register. This
1357physical register is the location where the virtual register is supposed to be
1358found before being stored or after being reloaded.
1359
1360If the indirect strategy is used, after all the virtual registers have been
1361mapped to physical registers or stack slots, it is necessary to use a spiller
1362object to place load and store instructions in the code. Every virtual that has
1363been mapped to a stack slot will be stored to memory after being defined and will
1364be loaded before being used. The implementation of the spiller tries to recycle
1365load/store instructions, avoiding unnecessary instructions. For an example of
1366how to invoke the spiller, see ``RegAllocLinearScan::runOnMachineFunction`` in
1367``lib/CodeGen/RegAllocLinearScan.cpp``.
1368
1369Handling two address instructions
1370^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1371
1372With very rare exceptions (e.g., function calls), the LLVM machine code
1373instructions are three address instructions. That is, each instruction is
1374expected to define at most one register, and to use at most two registers.
1375However, some architectures use two address instructions. In this case, the
1376defined register is also one of the used registers. For instance, an instruction
1377such as ``ADD %EAX, %EBX``, in X86 is actually equivalent to ``%EAX = %EAX +
1378%EBX``.
1379
1380In order to produce correct code, LLVM must convert three address instructions
1381that represent two address instructions into true two address instructions. LLVM
1382provides the pass ``TwoAddressInstructionPass`` for this specific purpose. It
1383must be run before register allocation takes place. After its execution, the
1384resulting code may no longer be in SSA form. This happens, for instance, in
1385situations where an instruction such as ``%a = ADD %b %c`` is converted to two
1386instructions such as:
1387
1388::
1389
1390 %a = MOVE %b
1391 %a = ADD %a %c
1392
1393Notice that, internally, the second instruction is represented as ``ADD
1394%a[def/use] %c``. I.e., the register operand ``%a`` is both used and defined by
1395the instruction.
1396
1397The SSA deconstruction phase
1398^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1399
1400An important transformation that happens during register allocation is called
1401the *SSA Deconstruction Phase*. The SSA form simplifies many analyses that are
1402performed on the control flow graph of programs. However, traditional
1403instruction sets do not implement PHI instructions. Thus, in order to generate
1404executable code, compilers must replace PHI instructions with other instructions
1405that preserve their semantics.
1406
1407There are many ways in which PHI instructions can safely be removed from the
1408target code. The most traditional PHI deconstruction algorithm replaces PHI
1409instructions with copy instructions. That is the strategy adopted by LLVM. The
1410SSA deconstruction algorithm is implemented in
1411``lib/CodeGen/PHIElimination.cpp``. In order to invoke this pass, the identifier
1412``PHIEliminationID`` must be marked as required in the code of the register
1413allocator.
1414
1415Instruction folding
1416^^^^^^^^^^^^^^^^^^^
1417
1418*Instruction folding* is an optimization performed during register allocation
1419that removes unnecessary copy instructions. For instance, a sequence of
1420instructions such as:
1421
1422::
1423
1424 %EBX = LOAD %mem_address
1425 %EAX = COPY %EBX
1426
1427can be safely substituted by the single instruction:
1428
1429::
1430
1431 %EAX = LOAD %mem_address
1432
1433Instructions can be folded with the
1434``TargetRegisterInfo::foldMemoryOperand(...)`` method. Care must be taken when
1435folding instructions; a folded instruction can be quite different from the
1436original instruction. See ``LiveIntervals::addIntervalsForSpills`` in
1437``lib/CodeGen/LiveIntervalAnalysis.cpp`` for an example of its use.
1438
1439Built in register allocators
1440^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1441
1442The LLVM infrastructure provides the application developer with three different
1443register allocators:
1444
1445* *Fast* --- This register allocator is the default for debug builds. It
1446 allocates registers on a basic block level, attempting to keep values in
1447 registers and reusing registers as appropriate.
1448
1449* *Basic* --- This is an incremental approach to register allocation. Live
1450 ranges are assigned to registers one at a time in an order that is driven by
1451 heuristics. Since code can be rewritten on-the-fly during allocation, this
1452 framework allows interesting allocators to be developed as extensions. It is
1453 not itself a production register allocator but is a potentially useful
1454 stand-alone mode for triaging bugs and as a performance baseline.
1455
1456* *Greedy* --- *The default allocator*. This is a highly tuned implementation of
1457 the *Basic* allocator that incorporates global live range splitting. This
1458 allocator works hard to minimize the cost of spill code.
1459
1460* *PBQP* --- A Partitioned Boolean Quadratic Programming (PBQP) based register
1461 allocator. This allocator works by constructing a PBQP problem representing
1462 the register allocation problem under consideration, solving this using a PBQP
1463 solver, and mapping the solution back to a register assignment.
1464
1465The type of register allocator used in ``llc`` can be chosen with the command
1466line option ``-regalloc=...``:
1467
1468.. code-block:: bash
1469
1470 $ llc -regalloc=linearscan file.bc -o ln.s
1471 $ llc -regalloc=fast file.bc -o fa.s
1472 $ llc -regalloc=pbqp file.bc -o pbqp.s
1473
1474.. _Prolog/Epilog Code Insertion:
1475
1476Prolog/Epilog Code Insertion
1477----------------------------
1478
1479Compact Unwind
1480
1481Throwing an exception requires *unwinding* out of a function. The information on
1482how to unwind a given function is traditionally expressed in DWARF unwind
1483(a.k.a. frame) info. But that format was originally developed for debuggers to
1484backtrace, and each Frame Description Entry (FDE) requires ~20-30 bytes per
1485function. There is also the cost of mapping from an address in a function to the
1486corresponding FDE at runtime. An alternative unwind encoding is called *compact
1487unwind* and requires just 4-bytes per function.
1488
1489The compact unwind encoding is a 32-bit value, which is encoded in an
1490architecture-specific way. It specifies which registers to restore and from
1491where, and how to unwind out of the function. When the linker creates a final
1492linked image, it will create a ``__TEXT,__unwind_info`` section. This section is
1493a small and fast way for the runtime to access unwind info for any given
1494function. If we emit compact unwind info for the function, that compact unwind
1495info will be encoded in the ``__TEXT,__unwind_info`` section. If we emit DWARF
1496unwind info, the ``__TEXT,__unwind_info`` section will contain the offset of the
1497FDE in the ``__TEXT,__eh_frame`` section in the final linked image.
1498
1499For X86, there are three modes for the compact unwind encoding:
1500
1501*Function with a Frame Pointer (``EBP`` or ``RBP``)*
1502 ``EBP/RBP``-based frame, where ``EBP/RBP`` is pushed onto the stack
1503 immediately after the return address, then ``ESP/RSP`` is moved to
1504 ``EBP/RBP``. Thus to unwind, ``ESP/RSP`` is restored with the current
1505 ``EBP/RBP`` value, then ``EBP/RBP`` is restored by popping the stack, and the
1506 return is done by popping the stack once more into the PC. All non-volatile
1507 registers that need to be restored must have been saved in a small range on
1508 the stack that starts ``EBP-4`` to ``EBP-1020`` (``RBP-8`` to
1509 ``RBP-1020``). The offset (divided by 4 in 32-bit mode and 8 in 64-bit mode)
1510 is encoded in bits 16-23 (mask: ``0x00FF0000``). The registers saved are
1511 encoded in bits 0-14 (mask: ``0x00007FFF``) as five 3-bit entries from the
1512 following table:
1513
1514 ============== ============= ===============
1515 Compact Number i386 Register x86-64 Register
1516 ============== ============= ===============
1517 1 ``EBX`` ``RBX``
1518 2 ``ECX`` ``R12``
1519 3 ``EDX`` ``R13``
1520 4 ``EDI`` ``R14``
1521 5 ``ESI`` ``R15``
1522 6 ``EBP`` ``RBP``
1523 ============== ============= ===============
1524
1525*Frameless with a Small Constant Stack Size (``EBP`` or ``RBP`` is not used as a frame pointer)*
1526 To return, a constant (encoded in the compact unwind encoding) is added to the
1527 ``ESP/RSP``. Then the return is done by popping the stack into the PC. All
1528 non-volatile registers that need to be restored must have been saved on the
1529 stack immediately after the return address. The stack size (divided by 4 in
1530 32-bit mode and 8 in 64-bit mode) is encoded in bits 16-23 (mask:
1531 ``0x00FF0000``). There is a maximum stack size of 1024 bytes in 32-bit mode
1532 and 2048 in 64-bit mode. The number of registers saved is encoded in bits 9-12
1533 (mask: ``0x00001C00``). Bits 0-9 (mask: ``0x000003FF``) contain which
1534 registers were saved and their order. (See the
1535 ``encodeCompactUnwindRegistersWithoutFrame()`` function in
1536 ``lib/Target/X86FrameLowering.cpp`` for the encoding algorithm.)
1537
1538*Frameless with a Large Constant Stack Size (``EBP`` or ``RBP`` is not used as a frame pointer)*
1539 This case is like the "Frameless with a Small Constant Stack Size" case, but
1540 the stack size is too large to encode in the compact unwind encoding. Instead
1541 it requires that the function contains "``subl $nnnnnn, %esp``" in its
1542 prolog. The compact encoding contains the offset to the ``$nnnnnn`` value in
1543 the function in bits 9-12 (mask: ``0x00001C00``).
1544
1545.. _Late Machine Code Optimizations:
1546
1547Late Machine Code Optimizations
1548-------------------------------
1549
1550.. note::
1551
1552 To Be Written
1553
1554.. _Code Emission:
1555
1556Code Emission
1557-------------
1558
1559The code emission step of code generation is responsible for lowering from the
1560code generator abstractions (like `MachineFunction`_, `MachineInstr`_, etc) down
1561to the abstractions used by the MC layer (`MCInst`_, `MCStreamer`_, etc). This
1562is done with a combination of several different classes: the (misnamed)
1563target-independent AsmPrinter class, target-specific subclasses of AsmPrinter
1564(such as SparcAsmPrinter), and the TargetLoweringObjectFile class.
1565
1566Since the MC layer works at the level of abstraction of object files, it doesn't
1567have a notion of functions, global variables etc. Instead, it thinks about
1568labels, directives, and instructions. A key class used at this time is the
1569MCStreamer class. This is an abstract API that is implemented in different ways
1570(e.g. to output a .s file, output an ELF .o file, etc) that is effectively an
1571"assembler API". MCStreamer has one method per directive, such as EmitLabel,
1572EmitSymbolAttribute, SwitchSection, etc, which directly correspond to assembly
1573level directives.
1574
1575If you are interested in implementing a code generator for a target, there are
1576three important things that you have to implement for your target:
1577
1578#. First, you need a subclass of AsmPrinter for your target. This class
1579 implements the general lowering process converting MachineFunction's into MC
1580 label constructs. The AsmPrinter base class provides a number of useful
1581 methods and routines, and also allows you to override the lowering process in
1582 some important ways. You should get much of the lowering for free if you are
1583 implementing an ELF, COFF, or MachO target, because the
1584 TargetLoweringObjectFile class implements much of the common logic.
1585
1586#. Second, you need to implement an instruction printer for your target. The
1587 instruction printer takes an `MCInst`_ and renders it to a raw_ostream as
1588 text. Most of this is automatically generated from the .td file (when you
1589 specify something like "``add $dst, $src1, $src2``" in the instructions), but
1590 you need to implement routines to print operands.
1591
1592#. Third, you need to implement code that lowers a `MachineInstr`_ to an MCInst,
1593 usually implemented in "<target>MCInstLower.cpp". This lowering process is
1594 often target specific, and is responsible for turning jump table entries,
1595 constant pool indices, global variable addresses, etc into MCLabels as
1596 appropriate. This translation layer is also responsible for expanding pseudo
1597 ops used by the code generator into the actual machine instructions they
1598 correspond to. The MCInsts that are generated by this are fed into the
1599 instruction printer or the encoder.
1600
1601Finally, at your choosing, you can also implement a subclass of MCCodeEmitter
1602which lowers MCInst's into machine code bytes and relocations. This is
1603important if you want to support direct .o file emission, or would like to
1604implement an assembler for your target.
1605
Sean Evesona6bcd532017-11-30 13:05:14 +00001606Emitting function stack size information
1607^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1608
1609A section containing metadata on function stack sizes will be emitted when
1610``TargetLoweringObjectFile::StackSizesSection`` is not null, and
1611``TargetOptions::EmitStackSizeSection`` is set (-stack-size-section). The
Sean Eveson2ae60372018-01-17 09:01:29 +00001612section will contain an array of pairs of function symbol values (pointer size)
Sean Evesona6bcd532017-11-30 13:05:14 +00001613and stack sizes (unsigned LEB128). The stack size values only include the space
1614allocated in the function prologue. Functions with dynamic stack allocations are
1615not included.
1616
Francis Visoiu Mistrihee1a6e72019-03-27 01:13:59 +00001617Emitting remark diagnostics in the object file
1618^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1619
1620A section containing metadata on remark diagnostics will be emitted when
1621-remarks-section is passed. The section contains:
1622
Francis Visoiu Mistrih465415f2019-04-24 00:27:59 +00001623* a magic number: "REMARKS\\0"
Francis Visoiu Mistrihee1a6e72019-03-27 01:13:59 +00001624* the version number: a little-endian uint64_t
Francis Visoiu Mistrih465415f2019-04-24 00:27:59 +00001625* the total size of the string table (the size itself excluded):
1626 little-endian uint64_t
1627* a list of null-terminated strings
Francis Visoiu Mistrihee1a6e72019-03-27 01:13:59 +00001628* the absolute file path to the serialized remark diagnostics: a
1629 null-terminated string.
1630
Sean Eveson661e4fb2017-11-30 12:43:25 +00001631VLIW Packetizer
1632---------------
1633
1634In a Very Long Instruction Word (VLIW) architecture, the compiler is responsible
1635for mapping instructions to functional-units available on the architecture. To
1636that end, the compiler creates groups of instructions called *packets* or
1637*bundles*. The VLIW packetizer in LLVM is a target-independent mechanism to
1638enable the packetization of machine instructions.
1639
1640Mapping from instructions to functional units
1641^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1642
1643Instructions in a VLIW target can typically be mapped to multiple functional
1644units. During the process of packetizing, the compiler must be able to reason
1645about whether an instruction can be added to a packet. This decision can be
1646complex since the compiler has to examine all possible mappings of instructions
1647to functional units. Therefore to alleviate compilation-time complexity, the
1648VLIW packetizer parses the instruction classes of a target and generates tables
1649at compiler build time. These tables can then be queried by the provided
1650machine-independent API to determine if an instruction can be accommodated in a
1651packet.
1652
1653How the packetization tables are generated and used
1654^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1655
1656The packetizer reads instruction classes from a target's itineraries and creates
1657a deterministic finite automaton (DFA) to represent the state of a packet. A DFA
1658consists of three major elements: inputs, states, and transitions. The set of
1659inputs for the generated DFA represents the instruction being added to a
1660packet. The states represent the possible consumption of functional units by
1661instructions in a packet. In the DFA, transitions from one state to another
1662occur on the addition of an instruction to an existing packet. If there is a
1663legal mapping of functional units to instructions, then the DFA contains a
1664corresponding transition. The absence of a transition indicates that a legal
1665mapping does not exist and that the instruction cannot be added to the packet.
1666
1667To generate tables for a VLIW target, add *Target*\ GenDFAPacketizer.inc as a
1668target to the Makefile in the target directory. The exported API provides three
1669functions: ``DFAPacketizer::clearResources()``,
1670``DFAPacketizer::reserveResources(MachineInstr *MI)``, and
1671``DFAPacketizer::canReserveResources(MachineInstr *MI)``. These functions allow
1672a target packetizer to add an instruction to an existing packet and to check
1673whether an instruction can be added to a packet. See
1674``llvm/CodeGen/DFAPacketizer.h`` for more information.
1675
1676Implementing a Native Assembler
1677===============================
1678
1679Though you're probably reading this because you want to write or maintain a
1680compiler backend, LLVM also fully supports building a native assembler.
1681We've tried hard to automate the generation of the assembler from the .td files
1682(in particular the instruction syntax and encodings), which means that a large
1683part of the manual and repetitive data entry can be factored and shared with the
1684compiler.
1685
1686Instruction Parsing
1687-------------------
1688
1689.. note::
1690
1691 To Be Written
1692
1693
1694Instruction Alias Processing
1695----------------------------
1696
1697Once the instruction is parsed, it enters the MatchInstructionImpl function.
1698The MatchInstructionImpl function performs alias processing and then does actual
1699matching.
1700
1701Alias processing is the phase that canonicalizes different lexical forms of the
1702same instructions down to one representation. There are several different kinds
1703of alias that are possible to implement and they are listed below in the order
1704that they are processed (which is in order from simplest/weakest to most
1705complex/powerful). Generally you want to use the first alias mechanism that
1706meets the needs of your instruction, because it will allow a more concise
1707description.
1708
1709Mnemonic Aliases
1710^^^^^^^^^^^^^^^^
1711
1712The first phase of alias processing is simple instruction mnemonic remapping for
1713classes of instructions which are allowed with two different mnemonics. This
1714phase is a simple and unconditionally remapping from one input mnemonic to one
1715output mnemonic. It isn't possible for this form of alias to look at the
1716operands at all, so the remapping must apply for all forms of a given mnemonic.
1717Mnemonic aliases are defined simply, for example X86 has:
1718
1719::
1720
1721 def : MnemonicAlias<"cbw", "cbtw">;
1722 def : MnemonicAlias<"smovq", "movsq">;
1723 def : MnemonicAlias<"fldcww", "fldcw">;
1724 def : MnemonicAlias<"fucompi", "fucomip">;
1725 def : MnemonicAlias<"ud2a", "ud2">;
1726
1727... and many others. With a MnemonicAlias definition, the mnemonic is remapped
1728simply and directly. Though MnemonicAlias's can't look at any aspect of the
1729instruction (such as the operands) they can depend on global modes (the same
1730ones supported by the matcher), through a Requires clause:
1731
1732::
1733
1734 def : MnemonicAlias<"pushf", "pushfq">, Requires<[In64BitMode]>;
1735 def : MnemonicAlias<"pushf", "pushfl">, Requires<[In32BitMode]>;
1736
1737In this example, the mnemonic gets mapped into a different one depending on
1738the current instruction set.
1739
1740Instruction Aliases
1741^^^^^^^^^^^^^^^^^^^
1742
1743The most general phase of alias processing occurs while matching is happening:
1744it provides new forms for the matcher to match along with a specific instruction
1745to generate. An instruction alias has two parts: the string to match and the
1746instruction to generate. For example:
1747
1748::
1749
1750 def : InstAlias<"movsx $src, $dst", (MOVSX16rr8W GR16:$dst, GR8 :$src)>;
1751 def : InstAlias<"movsx $src, $dst", (MOVSX16rm8W GR16:$dst, i8mem:$src)>;
1752 def : InstAlias<"movsx $src, $dst", (MOVSX32rr8 GR32:$dst, GR8 :$src)>;
1753 def : InstAlias<"movsx $src, $dst", (MOVSX32rr16 GR32:$dst, GR16 :$src)>;
1754 def : InstAlias<"movsx $src, $dst", (MOVSX64rr8 GR64:$dst, GR8 :$src)>;
1755 def : InstAlias<"movsx $src, $dst", (MOVSX64rr16 GR64:$dst, GR16 :$src)>;
1756 def : InstAlias<"movsx $src, $dst", (MOVSX64rr32 GR64:$dst, GR32 :$src)>;
1757
1758This shows a powerful example of the instruction aliases, matching the same
1759mnemonic in multiple different ways depending on what operands are present in
1760the assembly. The result of instruction aliases can include operands in a
1761different order than the destination instruction, and can use an input multiple
1762times, for example:
1763
1764::
1765
1766 def : InstAlias<"clrb $reg", (XOR8rr GR8 :$reg, GR8 :$reg)>;
1767 def : InstAlias<"clrw $reg", (XOR16rr GR16:$reg, GR16:$reg)>;
1768 def : InstAlias<"clrl $reg", (XOR32rr GR32:$reg, GR32:$reg)>;
1769 def : InstAlias<"clrq $reg", (XOR64rr GR64:$reg, GR64:$reg)>;
1770
1771This example also shows that tied operands are only listed once. In the X86
1772backend, XOR8rr has two input GR8's and one output GR8 (where an input is tied
1773to the output). InstAliases take a flattened operand list without duplicates
1774for tied operands. The result of an instruction alias can also use immediates
1775and fixed physical registers which are added as simple immediate operands in the
1776result, for example:
1777
1778::
1779
1780 // Fixed Immediate operand.
1781 def : InstAlias<"aad", (AAD8i8 10)>;
1782
1783 // Fixed register operand.
1784 def : InstAlias<"fcomi", (COM_FIr ST1)>;
1785
1786 // Simple alias.
1787 def : InstAlias<"fcomi $reg", (COM_FIr RST:$reg)>;
1788
1789Instruction aliases can also have a Requires clause to make them subtarget
1790specific.
1791
1792If the back-end supports it, the instruction printer can automatically emit the
1793alias rather than what's being aliased. It typically leads to better, more
1794readable code. If it's better to print out what's being aliased, then pass a '0'
1795as the third parameter to the InstAlias definition.
1796
1797Instruction Matching
1798--------------------
1799
1800.. note::
1801
1802 To Be Written
1803
1804.. _Implementations of the abstract target description interfaces:
1805.. _implement the target description:
1806
1807Target-specific Implementation Notes
1808====================================
1809
1810This section of the document explains features or design decisions that are
1811specific to the code generator for a particular target. First we start with a
1812table that summarizes what features are supported by each target.
1813
1814.. _target-feature-matrix:
1815
1816Target Feature Matrix
1817---------------------
1818
1819Note that this table does not list features that are not supported fully by any
1820target yet. It considers a feature to be supported if at least one subtarget
1821supports it. A feature being supported means that it is useful and works for
1822most cases, it does not indicate that there are zero known bugs in the
1823implementation. Here is the key:
1824
1825:raw-html:`<table border="1" cellspacing="0">`
1826:raw-html:`<tr>`
1827:raw-html:`<th>Unknown</th>`
1828:raw-html:`<th>Not Applicable</th>`
1829:raw-html:`<th>No support</th>`
1830:raw-html:`<th>Partial Support</th>`
1831:raw-html:`<th>Complete Support</th>`
1832:raw-html:`</tr>`
1833:raw-html:`<tr>`
1834:raw-html:`<td class="unknown"></td>`
1835:raw-html:`<td class="na"></td>`
1836:raw-html:`<td class="no"></td>`
1837:raw-html:`<td class="partial"></td>`
1838:raw-html:`<td class="yes"></td>`
1839:raw-html:`</tr>`
1840:raw-html:`</table>`
1841
1842Here is the table:
1843
1844:raw-html:`<table width="689" border="1" cellspacing="0">`
1845:raw-html:`<tr><td></td>`
1846:raw-html:`<td colspan="13" align="center" style="background-color:#ffc">Target</td>`
1847:raw-html:`</tr>`
1848:raw-html:`<tr>`
1849:raw-html:`<th>Feature</th>`
1850:raw-html:`<th>ARM</th>`
1851:raw-html:`<th>Hexagon</th>`
1852:raw-html:`<th>MSP430</th>`
1853:raw-html:`<th>Mips</th>`
1854:raw-html:`<th>NVPTX</th>`
1855:raw-html:`<th>PowerPC</th>`
1856:raw-html:`<th>Sparc</th>`
1857:raw-html:`<th>SystemZ</th>`
1858:raw-html:`<th>X86</th>`
1859:raw-html:`<th>XCore</th>`
1860:raw-html:`<th>eBPF</th>`
1861:raw-html:`</tr>`
1862
1863:raw-html:`<tr>`
1864:raw-html:`<td><a href="#feat_reliable">is generally reliable</a></td>`
1865:raw-html:`<td class="yes"></td> <!-- ARM -->`
1866:raw-html:`<td class="yes"></td> <!-- Hexagon -->`
1867:raw-html:`<td class="unknown"></td> <!-- MSP430 -->`
1868:raw-html:`<td class="yes"></td> <!-- Mips -->`
1869:raw-html:`<td class="yes"></td> <!-- NVPTX -->`
1870:raw-html:`<td class="yes"></td> <!-- PowerPC -->`
1871:raw-html:`<td class="yes"></td> <!-- Sparc -->`
1872:raw-html:`<td class="yes"></td> <!-- SystemZ -->`
1873:raw-html:`<td class="yes"></td> <!-- X86 -->`
1874:raw-html:`<td class="yes"></td> <!-- XCore -->`
1875:raw-html:`<td class="yes"></td> <!-- eBPF -->`
1876:raw-html:`</tr>`
1877
1878:raw-html:`<tr>`
1879:raw-html:`<td><a href="#feat_asmparser">assembly parser</a></td>`
1880:raw-html:`<td class="no"></td> <!-- ARM -->`
1881:raw-html:`<td class="no"></td> <!-- Hexagon -->`
1882:raw-html:`<td class="no"></td> <!-- MSP430 -->`
1883:raw-html:`<td class="no"></td> <!-- Mips -->`
1884:raw-html:`<td class="no"></td> <!-- NVPTX -->`
1885:raw-html:`<td class="no"></td> <!-- PowerPC -->`
1886:raw-html:`<td class="no"></td> <!-- Sparc -->`
1887:raw-html:`<td class="yes"></td> <!-- SystemZ -->`
1888:raw-html:`<td class="yes"></td> <!-- X86 -->`
1889:raw-html:`<td class="no"></td> <!-- XCore -->`
1890:raw-html:`<td class="no"></td> <!-- eBPF -->`
1891:raw-html:`</tr>`
1892
1893:raw-html:`<tr>`
1894:raw-html:`<td><a href="#feat_disassembler">disassembler</a></td>`
1895:raw-html:`<td class="yes"></td> <!-- ARM -->`
1896:raw-html:`<td class="no"></td> <!-- Hexagon -->`
1897:raw-html:`<td class="no"></td> <!-- MSP430 -->`
1898:raw-html:`<td class="no"></td> <!-- Mips -->`
1899:raw-html:`<td class="na"></td> <!-- NVPTX -->`
1900:raw-html:`<td class="no"></td> <!-- PowerPC -->`
1901:raw-html:`<td class="yes"></td> <!-- SystemZ -->`
1902:raw-html:`<td class="no"></td> <!-- Sparc -->`
1903:raw-html:`<td class="yes"></td> <!-- X86 -->`
1904:raw-html:`<td class="yes"></td> <!-- XCore -->`
1905:raw-html:`<td class="yes"></td> <!-- eBPF -->`
1906:raw-html:`</tr>`
1907
1908:raw-html:`<tr>`
1909:raw-html:`<td><a href="#feat_inlineasm">inline asm</a></td>`
1910:raw-html:`<td class="yes"></td> <!-- ARM -->`
1911:raw-html:`<td class="yes"></td> <!-- Hexagon -->`
1912:raw-html:`<td class="unknown"></td> <!-- MSP430 -->`
1913:raw-html:`<td class="no"></td> <!-- Mips -->`
1914:raw-html:`<td class="yes"></td> <!-- NVPTX -->`
1915:raw-html:`<td class="yes"></td> <!-- PowerPC -->`
1916:raw-html:`<td class="unknown"></td> <!-- Sparc -->`
1917:raw-html:`<td class="yes"></td> <!-- SystemZ -->`
1918:raw-html:`<td class="yes"></td> <!-- X86 -->`
1919:raw-html:`<td class="yes"></td> <!-- XCore -->`
1920:raw-html:`<td class="no"></td> <!-- eBPF -->`
1921:raw-html:`</tr>`
1922
1923:raw-html:`<tr>`
1924:raw-html:`<td><a href="#feat_jit">jit</a></td>`
1925:raw-html:`<td class="partial"><a href="#feat_jit_arm">*</a></td> <!-- ARM -->`
1926:raw-html:`<td class="no"></td> <!-- Hexagon -->`
1927:raw-html:`<td class="unknown"></td> <!-- MSP430 -->`
1928:raw-html:`<td class="yes"></td> <!-- Mips -->`
1929:raw-html:`<td class="na"></td> <!-- NVPTX -->`
1930:raw-html:`<td class="yes"></td> <!-- PowerPC -->`
1931:raw-html:`<td class="unknown"></td> <!-- Sparc -->`
1932:raw-html:`<td class="yes"></td> <!-- SystemZ -->`
1933:raw-html:`<td class="yes"></td> <!-- X86 -->`
1934:raw-html:`<td class="no"></td> <!-- XCore -->`
1935:raw-html:`<td class="yes"></td> <!-- eBPF -->`
1936:raw-html:`</tr>`
1937
1938:raw-html:`<tr>`
1939:raw-html:`<td><a href="#feat_objectwrite">.o&nbsp;file writing</a></td>`
1940:raw-html:`<td class="no"></td> <!-- ARM -->`
1941:raw-html:`<td class="no"></td> <!-- Hexagon -->`
1942:raw-html:`<td class="no"></td> <!-- MSP430 -->`
1943:raw-html:`<td class="no"></td> <!-- Mips -->`
1944:raw-html:`<td class="na"></td> <!-- NVPTX -->`
1945:raw-html:`<td class="no"></td> <!-- PowerPC -->`
1946:raw-html:`<td class="no"></td> <!-- Sparc -->`
1947:raw-html:`<td class="yes"></td> <!-- SystemZ -->`
1948:raw-html:`<td class="yes"></td> <!-- X86 -->`
1949:raw-html:`<td class="no"></td> <!-- XCore -->`
1950:raw-html:`<td class="yes"></td> <!-- eBPF -->`
1951:raw-html:`</tr>`
1952
1953:raw-html:`<tr>`
1954:raw-html:`<td><a hr:raw-html:`ef="#feat_tailcall">tail calls</a></td>`
1955:raw-html:`<td class="yes"></td> <!-- ARM -->`
1956:raw-html:`<td class="yes"></td> <!-- Hexagon -->`
1957:raw-html:`<td class="unknown"></td> <!-- MSP430 -->`
1958:raw-html:`<td class="no"></td> <!-- Mips -->`
1959:raw-html:`<td class="no"></td> <!-- NVPTX -->`
1960:raw-html:`<td class="yes"></td> <!-- PowerPC -->`
1961:raw-html:`<td class="unknown"></td> <!-- Sparc -->`
1962:raw-html:`<td class="no"></td> <!-- SystemZ -->`
1963:raw-html:`<td class="yes"></td> <!-- X86 -->`
1964:raw-html:`<td class="no"></td> <!-- XCore -->`
1965:raw-html:`<td class="no"></td> <!-- eBPF -->`
1966:raw-html:`</tr>`
1967
1968:raw-html:`<tr>`
1969:raw-html:`<td><a href="#feat_segstacks">segmented stacks</a></td>`
1970:raw-html:`<td class="no"></td> <!-- ARM -->`
1971:raw-html:`<td class="no"></td> <!-- Hexagon -->`
1972:raw-html:`<td class="no"></td> <!-- MSP430 -->`
1973:raw-html:`<td class="no"></td> <!-- Mips -->`
1974:raw-html:`<td class="no"></td> <!-- NVPTX -->`
1975:raw-html:`<td class="no"></td> <!-- PowerPC -->`
1976:raw-html:`<td class="no"></td> <!-- Sparc -->`
1977:raw-html:`<td class="no"></td> <!-- SystemZ -->`
1978:raw-html:`<td class="partial"><a href="#feat_segstacks_x86">*</a></td> <!-- X86 -->`
1979:raw-html:`<td class="no"></td> <!-- XCore -->`
1980:raw-html:`<td class="no"></td> <!-- eBPF -->`
1981:raw-html:`</tr>`
1982
1983:raw-html:`</table>`
1984
1985.. _feat_reliable:
1986
1987Is Generally Reliable
1988^^^^^^^^^^^^^^^^^^^^^
1989
1990This box indicates whether the target is considered to be production quality.
1991This indicates that the target has been used as a static compiler to compile
1992large amounts of code by a variety of different people and is in continuous use.
1993
1994.. _feat_asmparser:
1995
1996Assembly Parser
1997^^^^^^^^^^^^^^^
1998
1999This box indicates whether the target supports parsing target specific .s files
2000by implementing the MCAsmParser interface. This is required for llvm-mc to be
2001able to act as a native assembler and is required for inline assembly support in
2002the native .o file writer.
2003
2004.. _feat_disassembler:
2005
2006Disassembler
2007^^^^^^^^^^^^
2008
2009This box indicates whether the target supports the MCDisassembler API for
2010disassembling machine opcode bytes into MCInst's.
2011
2012.. _feat_inlineasm:
2013
2014Inline Asm
2015^^^^^^^^^^
2016
2017This box indicates whether the target supports most popular inline assembly
2018constraints and modifiers.
2019
2020.. _feat_jit:
2021
2022JIT Support
2023^^^^^^^^^^^
2024
2025This box indicates whether the target supports the JIT compiler through the
2026ExecutionEngine interface.
2027
2028.. _feat_jit_arm:
2029
2030The ARM backend has basic support for integer code in ARM codegen mode, but
2031lacks NEON and full Thumb support.
2032
2033.. _feat_objectwrite:
2034
2035.o File Writing
2036^^^^^^^^^^^^^^^
2037
2038This box indicates whether the target supports writing .o files (e.g. MachO,
2039ELF, and/or COFF) files directly from the target. Note that the target also
2040must include an assembly parser and general inline assembly support for full
2041inline assembly support in the .o writer.
2042
2043Targets that don't support this feature can obviously still write out .o files,
2044they just rely on having an external assembler to translate from a .s file to a
2045.o file (as is the case for many C compilers).
2046
2047.. _feat_tailcall:
2048
2049Tail Calls
2050^^^^^^^^^^
2051
2052This box indicates whether the target supports guaranteed tail calls. These are
2053calls marked "`tail <LangRef.html#i_call>`_" and use the fastcc calling
2054convention. Please see the `tail call section`_ for more details.
2055
2056.. _feat_segstacks:
2057
2058Segmented Stacks
2059^^^^^^^^^^^^^^^^
2060
2061This box indicates whether the target supports segmented stacks. This replaces
2062the traditional large C stack with many linked segments. It is compatible with
2063the `gcc implementation <http://gcc.gnu.org/wiki/SplitStacks>`_ used by the Go
2064front end.
2065
2066.. _feat_segstacks_x86:
2067
2068Basic support exists on the X86 backend. Currently vararg doesn't work and the
2069object files are not marked the way the gold linker expects, but simple Go
2070programs can be built by dragonegg.
2071
2072.. _tail call section:
2073
2074Tail call optimization
2075----------------------
2076
2077Tail call optimization, callee reusing the stack of the caller, is currently
2078supported on x86/x86-64 and PowerPC. It is performed if:
2079
2080* Caller and callee have the calling convention ``fastcc``, ``cc 10`` (GHC
2081 calling convention) or ``cc 11`` (HiPE calling convention).
2082
2083* The call is a tail call - in tail position (ret immediately follows call and
2084 ret uses value of call or is void).
2085
2086* Option ``-tailcallopt`` is enabled.
2087
2088* Platform-specific constraints are met.
2089
2090x86/x86-64 constraints:
2091
2092* No variable argument lists are used.
2093
2094* On x86-64 when generating GOT/PIC code only module-local calls (visibility =
2095 hidden or protected) are supported.
2096
2097PowerPC constraints:
2098
2099* No variable argument lists are used.
2100
2101* No byval parameters are used.
2102
2103* On ppc32/64 GOT/PIC only module-local calls (visibility = hidden or protected)
2104 are supported.
2105
2106Example:
2107
2108Call as ``llc -tailcallopt test.ll``.
2109
2110.. code-block:: llvm
2111
2112 declare fastcc i32 @tailcallee(i32 inreg %a1, i32 inreg %a2, i32 %a3, i32 %a4)
2113
2114 define fastcc i32 @tailcaller(i32 %in1, i32 %in2) {
2115 %l1 = add i32 %in1, %in2
2116 %tmp = tail call fastcc i32 @tailcallee(i32 %in1 inreg, i32 %in2 inreg, i32 %in1, i32 %l1)
2117 ret i32 %tmp
2118 }
2119
2120Implications of ``-tailcallopt``:
2121
2122To support tail call optimization in situations where the callee has more
2123arguments than the caller a 'callee pops arguments' convention is used. This
2124currently causes each ``fastcc`` call that is not tail call optimized (because
2125one or more of above constraints are not met) to be followed by a readjustment
2126of the stack. So performance might be worse in such cases.
2127
2128Sibling call optimization
2129-------------------------
2130
2131Sibling call optimization is a restricted form of tail call optimization.
2132Unlike tail call optimization described in the previous section, it can be
2133performed automatically on any tail calls when ``-tailcallopt`` option is not
2134specified.
2135
2136Sibling call optimization is currently performed on x86/x86-64 when the
2137following constraints are met:
2138
2139* Caller and callee have the same calling convention. It can be either ``c`` or
2140 ``fastcc``.
2141
2142* The call is a tail call - in tail position (ret immediately follows call and
2143 ret uses value of call or is void).
2144
2145* Caller and callee have matching return type or the callee result is not used.
2146
2147* If any of the callee arguments are being passed in stack, they must be
2148 available in caller's own incoming argument stack and the frame offsets must
2149 be the same.
2150
2151Example:
2152
2153.. code-block:: llvm
2154
2155 declare i32 @bar(i32, i32)
2156
2157 define i32 @foo(i32 %a, i32 %b, i32 %c) {
2158 entry:
2159 %0 = tail call i32 @bar(i32 %a, i32 %b)
2160 ret i32 %0
2161 }
2162
2163The X86 backend
2164---------------
2165
2166The X86 code generator lives in the ``lib/Target/X86`` directory. This code
2167generator is capable of targeting a variety of x86-32 and x86-64 processors, and
2168includes support for ISA extensions such as MMX and SSE.
2169
2170X86 Target Triples supported
2171^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2172
2173The following are the known target triples that are supported by the X86
2174backend. This is not an exhaustive list, and it would be useful to add those
2175that people test.
2176
2177* **i686-pc-linux-gnu** --- Linux
2178
2179* **i386-unknown-freebsd5.3** --- FreeBSD 5.3
2180
2181* **i686-pc-cygwin** --- Cygwin on Win32
2182
2183* **i686-pc-mingw32** --- MingW on Win32
2184
2185* **i386-pc-mingw32msvc** --- MingW crosscompiler on Linux
2186
2187* **i686-apple-darwin*** --- Apple Darwin on X86
2188
2189* **x86_64-unknown-linux-gnu** --- Linux
2190
2191X86 Calling Conventions supported
2192^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2193
2194The following target-specific calling conventions are known to backend:
2195
2196* **x86_StdCall** --- stdcall calling convention seen on Microsoft Windows
2197 platform (CC ID = 64).
2198
2199* **x86_FastCall** --- fastcall calling convention seen on Microsoft Windows
2200 platform (CC ID = 65).
2201
2202* **x86_ThisCall** --- Similar to X86_StdCall. Passes first argument in ECX,
2203 others via stack. Callee is responsible for stack cleaning. This convention is
2204 used by MSVC by default for methods in its ABI (CC ID = 70).
2205
2206.. _X86 addressing mode:
2207
2208Representing X86 addressing modes in MachineInstrs
2209^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2210
2211The x86 has a very flexible way of accessing memory. It is capable of forming
2212memory addresses of the following expression directly in integer instructions
2213(which use ModR/M addressing):
2214
2215::
2216
2217 SegmentReg: Base + [1,2,4,8] * IndexReg + Disp32
2218
2219In order to represent this, LLVM tracks no less than 5 operands for each memory
2220operand of this form. This means that the "load" form of '``mov``' has the
2221following ``MachineOperand``\s in this order:
2222
2223::
2224
2225 Index: 0 | 1 2 3 4 5
2226 Meaning: DestReg, | BaseReg, Scale, IndexReg, Displacement Segment
2227 OperandTy: VirtReg, | VirtReg, UnsImm, VirtReg, SignExtImm PhysReg
2228
2229Stores, and all other instructions, treat the four memory operands in the same
2230way and in the same order. If the segment register is unspecified (regno = 0),
2231then no segment override is generated. "Lea" operations do not have a segment
2232register specified, so they only have 4 operands for their memory reference.
2233
2234X86 address spaces supported
2235^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2236
2237x86 has a feature which provides the ability to perform loads and stores to
2238different address spaces via the x86 segment registers. A segment override
2239prefix byte on an instruction causes the instruction's memory access to go to
2240the specified segment. LLVM address space 0 is the default address space, which
2241includes the stack, and any unqualified memory accesses in a program. Address
2242spaces 1-255 are currently reserved for user-defined code. The GS-segment is
2243represented by address space 256, the FS-segment is represented by address space
2244257, and the SS-segment is represented by address space 258. Other x86 segments
2245have yet to be allocated address space numbers.
2246
2247While these address spaces may seem similar to TLS via the ``thread_local``
2248keyword, and often use the same underlying hardware, there are some fundamental
2249differences.
2250
2251The ``thread_local`` keyword applies to global variables and specifies that they
2252are to be allocated in thread-local memory. There are no type qualifiers
2253involved, and these variables can be pointed to with normal pointers and
2254accessed with normal loads and stores. The ``thread_local`` keyword is
2255target-independent at the LLVM IR level (though LLVM doesn't yet have
2256implementations of it for some configurations)
2257
2258Special address spaces, in contrast, apply to static types. Every load and store
2259has a particular address space in its address operand type, and this is what
2260determines which address space is accessed. LLVM ignores these special address
2261space qualifiers on global variables, and does not provide a way to directly
2262allocate storage in them. At the LLVM IR level, the behavior of these special
2263address spaces depends in part on the underlying OS or runtime environment, and
2264they are specific to x86 (and LLVM doesn't yet handle them correctly in some
2265cases).
2266
2267Some operating systems and runtime environments use (or may in the future use)
2268the FS/GS-segment registers for various low-level purposes, so care should be
2269taken when considering them.
2270
2271Instruction naming
2272^^^^^^^^^^^^^^^^^^
2273
2274An instruction name consists of the base name, a default operand size, and a a
2275character per operand with an optional special size. For example:
2276
2277::
2278
2279 ADD8rr -> add, 8-bit register, 8-bit register
2280 IMUL16rmi -> imul, 16-bit register, 16-bit memory, 16-bit immediate
2281 IMUL16rmi8 -> imul, 16-bit register, 16-bit memory, 8-bit immediate
2282 MOVSX32rm16 -> movsx, 32-bit register, 16-bit memory
2283
2284The PowerPC backend
2285-------------------
2286
2287The PowerPC code generator lives in the lib/Target/PowerPC directory. The code
2288generation is retargetable to several variations or *subtargets* of the PowerPC
2289ISA; including ppc32, ppc64 and altivec.
2290
2291LLVM PowerPC ABI
2292^^^^^^^^^^^^^^^^
2293
2294LLVM follows the AIX PowerPC ABI, with two deviations. LLVM uses a PC relative
2295(PIC) or static addressing for accessing global values, so no TOC (r2) is
2296used. Second, r31 is used as a frame pointer to allow dynamic growth of a stack
2297frame. LLVM takes advantage of having no TOC to provide space to save the frame
2298pointer in the PowerPC linkage area of the caller frame. Other details of
2299PowerPC ABI can be found at `PowerPC ABI
2300<http://developer.apple.com/documentation/DeveloperTools/Conceptual/LowLevelABI/Articles/32bitPowerPC.html>`_\
2301. Note: This link describes the 32 bit ABI. The 64 bit ABI is similar except
2302space for GPRs are 8 bytes wide (not 4) and r13 is reserved for system use.
2303
2304Frame Layout
2305^^^^^^^^^^^^
2306
2307The size of a PowerPC frame is usually fixed for the duration of a function's
2308invocation. Since the frame is fixed size, all references into the frame can be
2309accessed via fixed offsets from the stack pointer. The exception to this is
2310when dynamic alloca or variable sized arrays are present, then a base pointer
2311(r31) is used as a proxy for the stack pointer and stack pointer is free to grow
2312or shrink. A base pointer is also used if llvm-gcc is not passed the
2313-fomit-frame-pointer flag. The stack pointer is always aligned to 16 bytes, so
2314that space allocated for altivec vectors will be properly aligned.
2315
2316An invocation frame is laid out as follows (low memory at top):
2317
2318:raw-html:`<table border="1" cellspacing="0">`
2319:raw-html:`<tr>`
2320:raw-html:`<td>Linkage<br><br></td>`
2321:raw-html:`</tr>`
2322:raw-html:`<tr>`
2323:raw-html:`<td>Parameter area<br><br></td>`
2324:raw-html:`</tr>`
2325:raw-html:`<tr>`
2326:raw-html:`<td>Dynamic area<br><br></td>`
2327:raw-html:`</tr>`
2328:raw-html:`<tr>`
2329:raw-html:`<td>Locals area<br><br></td>`
2330:raw-html:`</tr>`
2331:raw-html:`<tr>`
2332:raw-html:`<td>Saved registers area<br><br></td>`
2333:raw-html:`</tr>`
2334:raw-html:`<tr style="border-style: none hidden none hidden;">`
2335:raw-html:`<td><br></td>`
2336:raw-html:`</tr>`
2337:raw-html:`<tr>`
2338:raw-html:`<td>Previous Frame<br><br></td>`
2339:raw-html:`</tr>`
2340:raw-html:`</table>`
2341
2342The *linkage* area is used by a callee to save special registers prior to
2343allocating its own frame. Only three entries are relevant to LLVM. The first
2344entry is the previous stack pointer (sp), aka link. This allows probing tools
2345like gdb or exception handlers to quickly scan the frames in the stack. A
2346function epilog can also use the link to pop the frame from the stack. The
2347third entry in the linkage area is used to save the return address from the lr
2348register. Finally, as mentioned above, the last entry is used to save the
2349previous frame pointer (r31.) The entries in the linkage area are the size of a
2350GPR, thus the linkage area is 24 bytes long in 32 bit mode and 48 bytes in 64
2351bit mode.
2352
235332 bit linkage area:
2354
2355:raw-html:`<table border="1" cellspacing="0">`
2356:raw-html:`<tr>`
2357:raw-html:`<td>0</td>`
2358:raw-html:`<td>Saved SP (r1)</td>`
2359:raw-html:`</tr>`
2360:raw-html:`<tr>`
2361:raw-html:`<td>4</td>`
2362:raw-html:`<td>Saved CR</td>`
2363:raw-html:`</tr>`
2364:raw-html:`<tr>`
2365:raw-html:`<td>8</td>`
2366:raw-html:`<td>Saved LR</td>`
2367:raw-html:`</tr>`
2368:raw-html:`<tr>`
2369:raw-html:`<td>12</td>`
2370:raw-html:`<td>Reserved</td>`
2371:raw-html:`</tr>`
2372:raw-html:`<tr>`
2373:raw-html:`<td>16</td>`
2374:raw-html:`<td>Reserved</td>`
2375:raw-html:`</tr>`
2376:raw-html:`<tr>`
2377:raw-html:`<td>20</td>`
2378:raw-html:`<td>Saved FP (r31)</td>`
2379:raw-html:`</tr>`
2380:raw-html:`</table>`
2381
238264 bit linkage area:
2383
2384:raw-html:`<table border="1" cellspacing="0">`
2385:raw-html:`<tr>`
2386:raw-html:`<td>0</td>`
2387:raw-html:`<td>Saved SP (r1)</td>`
2388:raw-html:`</tr>`
2389:raw-html:`<tr>`
2390:raw-html:`<td>8</td>`
2391:raw-html:`<td>Saved CR</td>`
2392:raw-html:`</tr>`
2393:raw-html:`<tr>`
2394:raw-html:`<td>16</td>`
2395:raw-html:`<td>Saved LR</td>`
2396:raw-html:`</tr>`
2397:raw-html:`<tr>`
2398:raw-html:`<td>24</td>`
2399:raw-html:`<td>Reserved</td>`
2400:raw-html:`</tr>`
2401:raw-html:`<tr>`
2402:raw-html:`<td>32</td>`
2403:raw-html:`<td>Reserved</td>`
2404:raw-html:`</tr>`
2405:raw-html:`<tr>`
2406:raw-html:`<td>40</td>`
2407:raw-html:`<td>Saved FP (r31)</td>`
2408:raw-html:`</tr>`
2409:raw-html:`</table>`
2410
2411The *parameter area* is used to store arguments being passed to a callee
2412function. Following the PowerPC ABI, the first few arguments are actually
2413passed in registers, with the space in the parameter area unused. However, if
2414there are not enough registers or the callee is a thunk or vararg function,
2415these register arguments can be spilled into the parameter area. Thus, the
2416parameter area must be large enough to store all the parameters for the largest
2417call sequence made by the caller. The size must also be minimally large enough
2418to spill registers r3-r10. This allows callees blind to the call signature,
2419such as thunks and vararg functions, enough space to cache the argument
2420registers. Therefore, the parameter area is minimally 32 bytes (64 bytes in 64
2421bit mode.) Also note that since the parameter area is a fixed offset from the
2422top of the frame, that a callee can access its spilt arguments using fixed
2423offsets from the stack pointer (or base pointer.)
2424
2425Combining the information about the linkage, parameter areas and alignment. A
2426stack frame is minimally 64 bytes in 32 bit mode and 128 bytes in 64 bit mode.
2427
2428The *dynamic area* starts out as size zero. If a function uses dynamic alloca
2429then space is added to the stack, the linkage and parameter areas are shifted to
2430top of stack, and the new space is available immediately below the linkage and
2431parameter areas. The cost of shifting the linkage and parameter areas is minor
2432since only the link value needs to be copied. The link value can be easily
2433fetched by adding the original frame size to the base pointer. Note that
2434allocations in the dynamic space need to observe 16 byte alignment.
2435
2436The *locals area* is where the llvm compiler reserves space for local variables.
2437
2438The *saved registers area* is where the llvm compiler spills callee saved
2439registers on entry to the callee.
2440
2441Prolog/Epilog
2442^^^^^^^^^^^^^
2443
2444The llvm prolog and epilog are the same as described in the PowerPC ABI, with
2445the following exceptions. Callee saved registers are spilled after the frame is
2446created. This allows the llvm epilog/prolog support to be common with other
2447targets. The base pointer callee saved register r31 is saved in the TOC slot of
2448linkage area. This simplifies allocation of space for the base pointer and
2449makes it convenient to locate programmatically and during debugging.
2450
2451Dynamic Allocation
2452^^^^^^^^^^^^^^^^^^
2453
2454.. note::
2455
2456 TODO - More to come.
2457
2458The NVPTX backend
2459-----------------
2460
2461The NVPTX code generator under lib/Target/NVPTX is an open-source version of
2462the NVIDIA NVPTX code generator for LLVM. It is contributed by NVIDIA and is
2463a port of the code generator used in the CUDA compiler (nvcc). It targets the
2464PTX 3.0/3.1 ISA and can target any compute capability greater than or equal to
24652.0 (Fermi).
2466
2467This target is of production quality and should be completely compatible with
2468the official NVIDIA toolchain.
2469
2470Code Generator Options:
2471
2472:raw-html:`<table border="1" cellspacing="0">`
2473:raw-html:`<tr>`
2474:raw-html:`<th>Option</th>`
2475:raw-html:`<th>Description</th>`
2476:raw-html:`</tr>`
2477:raw-html:`<tr>`
2478:raw-html:`<td>sm_20</td>`
2479:raw-html:`<td align="left">Set shader model/compute capability to 2.0</td>`
2480:raw-html:`</tr>`
2481:raw-html:`<tr>`
2482:raw-html:`<td>sm_21</td>`
2483:raw-html:`<td align="left">Set shader model/compute capability to 2.1</td>`
2484:raw-html:`</tr>`
2485:raw-html:`<tr>`
2486:raw-html:`<td>sm_30</td>`
2487:raw-html:`<td align="left">Set shader model/compute capability to 3.0</td>`
2488:raw-html:`</tr>`
2489:raw-html:`<tr>`
2490:raw-html:`<td>sm_35</td>`
2491:raw-html:`<td align="left">Set shader model/compute capability to 3.5</td>`
2492:raw-html:`</tr>`
2493:raw-html:`<tr>`
2494:raw-html:`<td>ptx30</td>`
2495:raw-html:`<td align="left">Target PTX 3.0</td>`
2496:raw-html:`</tr>`
2497:raw-html:`<tr>`
2498:raw-html:`<td>ptx31</td>`
2499:raw-html:`<td align="left">Target PTX 3.1</td>`
2500:raw-html:`</tr>`
2501:raw-html:`</table>`
2502
2503The extended Berkeley Packet Filter (eBPF) backend
2504--------------------------------------------------
2505
2506Extended BPF (or eBPF) is similar to the original ("classic") BPF (cBPF) used
2507to filter network packets. The
2508`bpf() system call <http://man7.org/linux/man-pages/man2/bpf.2.html>`_
2509performs a range of operations related to eBPF. For both cBPF and eBPF
2510programs, the Linux kernel statically analyzes the programs before loading
2511them, in order to ensure that they cannot harm the running system. eBPF is
2512a 64-bit RISC instruction set designed for one to one mapping to 64-bit CPUs.
2513Opcodes are 8-bit encoded, and 87 instructions are defined. There are 10
2514registers, grouped by function as outlined below.
2515
2516::
2517
2518 R0 return value from in-kernel functions; exit value for eBPF program
2519 R1 - R5 function call arguments to in-kernel functions
2520 R6 - R9 callee-saved registers preserved by in-kernel functions
2521 R10 stack frame pointer (read only)
2522
2523Instruction encoding (arithmetic and jump)
2524^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2525eBPF is reusing most of the opcode encoding from classic to simplify conversion
2526of classic BPF to eBPF. For arithmetic and jump instructions the 8-bit 'code'
2527field is divided into three parts:
2528
2529::
2530
2531 +----------------+--------+--------------------+
2532 | 4 bits | 1 bit | 3 bits |
2533 | operation code | source | instruction class |
2534 +----------------+--------+--------------------+
2535 (MSB) (LSB)
2536
2537Three LSB bits store instruction class which is one of:
2538
2539::
2540
2541 BPF_LD 0x0
2542 BPF_LDX 0x1
2543 BPF_ST 0x2
2544 BPF_STX 0x3
2545 BPF_ALU 0x4
2546 BPF_JMP 0x5
2547 (unused) 0x6
2548 BPF_ALU64 0x7
2549
2550When BPF_CLASS(code) == BPF_ALU or BPF_ALU64 or BPF_JMP,
25514th bit encodes source operand
2552
2553::
2554
Yonghong Song33434d52019-05-03 16:40:16 +00002555 BPF_X 0x1 use src_reg register as source operand
2556 BPF_K 0x0 use 32 bit immediate as source operand
Sean Eveson661e4fb2017-11-30 12:43:25 +00002557
2558and four MSB bits store operation code
2559
2560::
2561
2562 BPF_ADD 0x0 add
2563 BPF_SUB 0x1 subtract
2564 BPF_MUL 0x2 multiply
2565 BPF_DIV 0x3 divide
2566 BPF_OR 0x4 bitwise logical OR
2567 BPF_AND 0x5 bitwise logical AND
2568 BPF_LSH 0x6 left shift
2569 BPF_RSH 0x7 right shift (zero extended)
2570 BPF_NEG 0x8 arithmetic negation
2571 BPF_MOD 0x9 modulo
2572 BPF_XOR 0xa bitwise logical XOR
2573 BPF_MOV 0xb move register to register
2574 BPF_ARSH 0xc right shift (sign extended)
2575 BPF_END 0xd endianness conversion
2576
2577If BPF_CLASS(code) == BPF_JMP, BPF_OP(code) is one of
2578
2579::
2580
2581 BPF_JA 0x0 unconditional jump
2582 BPF_JEQ 0x1 jump ==
2583 BPF_JGT 0x2 jump >
2584 BPF_JGE 0x3 jump >=
2585 BPF_JSET 0x4 jump if (DST & SRC)
2586 BPF_JNE 0x5 jump !=
2587 BPF_JSGT 0x6 jump signed >
2588 BPF_JSGE 0x7 jump signed >=
2589 BPF_CALL 0x8 function call
2590 BPF_EXIT 0x9 function return
2591
2592Instruction encoding (load, store)
2593^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2594For load and store instructions the 8-bit 'code' field is divided as:
2595
2596::
2597
2598 +--------+--------+-------------------+
2599 | 3 bits | 2 bits | 3 bits |
2600 | mode | size | instruction class |
2601 +--------+--------+-------------------+
2602 (MSB) (LSB)
2603
2604Size modifier is one of
2605
2606::
2607
2608 BPF_W 0x0 word
2609 BPF_H 0x1 half word
2610 BPF_B 0x2 byte
2611 BPF_DW 0x3 double word
2612
2613Mode modifier is one of
2614
2615::
2616
2617 BPF_IMM 0x0 immediate
2618 BPF_ABS 0x1 used to access packet data
2619 BPF_IND 0x2 used to access packet data
2620 BPF_MEM 0x3 memory
2621 (reserved) 0x4
2622 (reserved) 0x5
2623 BPF_XADD 0x6 exclusive add
2624
2625
2626Packet data access (BPF_ABS, BPF_IND)
2627^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2628
2629Two non-generic instructions: (BPF_ABS | <size> | BPF_LD) and
2630(BPF_IND | <size> | BPF_LD) which are used to access packet data.
2631Register R6 is an implicit input that must contain pointer to sk_buff.
2632Register R0 is an implicit output which contains the data fetched
2633from the packet. Registers R1-R5 are scratch registers and must not
2634be used to store the data across BPF_ABS | BPF_LD or BPF_IND | BPF_LD
2635instructions. These instructions have implicit program exit condition
2636as well. When eBPF program is trying to access the data beyond
2637the packet boundary, the interpreter will abort the execution of the program.
2638
2639BPF_IND | BPF_W | BPF_LD is equivalent to:
2640 R0 = ntohl(\*(u32 \*) (((struct sk_buff \*) R6)->data + src_reg + imm32))
2641
2642eBPF maps
2643^^^^^^^^^
2644
2645eBPF maps are provided for sharing data between kernel and user-space.
2646Currently implemented types are hash and array, with potential extension to
2647support bloom filters, radix trees, etc. A map is defined by its type,
2648maximum number of elements, key size and value size in bytes. eBPF syscall
2649supports create, update, find and delete functions on maps.
2650
2651Function calls
2652^^^^^^^^^^^^^^
2653
2654Function call arguments are passed using up to five registers (R1 - R5).
2655The return value is passed in a dedicated register (R0). Four additional
2656registers (R6 - R9) are callee-saved, and the values in these registers
2657are preserved within kernel functions. R0 - R5 are scratch registers within
2658kernel functions, and eBPF programs must therefor store/restore values in
2659these registers if needed across function calls. The stack can be accessed
2660using the read-only frame pointer R10. eBPF registers map 1:1 to hardware
2661registers on x86_64 and other 64-bit architectures. For example, x86_64
2662in-kernel JIT maps them as
2663
2664::
2665
2666 R0 - rax
2667 R1 - rdi
2668 R2 - rsi
2669 R3 - rdx
2670 R4 - rcx
2671 R5 - r8
2672 R6 - rbx
2673 R7 - r13
2674 R8 - r14
2675 R9 - r15
2676 R10 - rbp
2677
2678since x86_64 ABI mandates rdi, rsi, rdx, rcx, r8, r9 for argument passing
2679and rbx, r12 - r15 are callee saved.
2680
2681Program start
2682^^^^^^^^^^^^^
2683
2684An eBPF program receives a single argument and contains
2685a single eBPF main routine; the program does not contain eBPF functions.
2686Function calls are limited to a predefined set of kernel functions. The size
2687of a program is limited to 4K instructions: this ensures fast termination and
2688a limited number of kernel function calls. Prior to running an eBPF program,
2689a verifier performs static analysis to prevent loops in the code and
2690to ensure valid register usage and operand types.
2691
2692The AMDGPU backend
2693------------------
2694
2695The AMDGPU code generator lives in the ``lib/Target/AMDGPU``
2696directory. This code generator is capable of targeting a variety of
2697AMD GPU processors. Refer to :doc:`AMDGPUUsage` for more information.