Gitiles
Code Review Sign In
gerrit-public.fairphone.software / fp2-dev / platform / external / llvm / 8ffc66dac44a2615d46c7eb188957b74d0afd41b / . / utils / NightlyTestTemplate.html
blob: 83db6bbbaa6244dec031e3b0a2872d505cf01d27 [file] [log] [blame]
Chris Lattner2f8cb572003-01-20 18:05:27 +0000[diff] [blame]1
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]2<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
3<html><head><title>LLVM Test Results for $DateString</title></head>
4
5<body bgcolor=white>
6<center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center>
7<hr height=1>
8
9<table width=100%>
10<tr><td valign=top align=center>
11
12<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
13<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77">
14<font size=+1><b>Sections:</b></font><br>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]15</td></tr><tr><td bgcolor="#FFCC99" align=center>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]16<a href="#Overview">Overview</a><br>
17<a href="#Changes">Changes</a><br>
18<a href="#Trends">Trends</a><br>
19<a href="#Programs">Programs</a><br>
20<a href="#Regression">Regression</a><br>
21</td></tr></table></td></tr></table>
22
23<p>
24<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
25<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"
26<font size=+1><b>Previous:</b></font><br>
27</td></tr><tr><td bgcolor="#FFCC99">
28 $PrevDaysList
29</td></tr></table></td></tr></table>
30<p>
31
32<font size=+1><b>Back to:</b></font><br>
33<a href="..">Test&nbsp;Results</a><br>
34<a href="../..">LLVM&nbsp;Page</a><p>
35
36</td><td valign=top>
37
38<center>
39<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
40<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
41<font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
42</td></tr></table></td></tr></table></center><p>
43
Chris Lattner24eefd32003-08-18 19:59:28 +0000[diff] [blame]44<!-- Running LOC graph -->
45<table align=right>
46<tr><td>
47<a href="running_loc_large.png"
Chris Lattner8ab0a012003-08-19 14:27:44 +0000[diff] [blame]48 ><img border=0 width=480 height=360 src="running_loc.png"></a>
Chris Lattner24eefd32003-08-18 19:59:28 +0000[diff] [blame]49</td></tr>
50<tr><td align=center>Lines Of Code over Time<br>
51<font size=-1><a href="running_loc_large.png">Click for larger view</a></font>
52</td></tr>
53</table>
54
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]55<h2>CVS Tree Overview:</h2>
56<ul>
57<li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
58<ul>
Brian Gaeke1bb9a482003-10-06 15:30:00 +0000[diff] [blame]59 <b>$NumDirsInCVS</b> dirs, <b>$NumFilesInCVS</b> files, <b>$LOC</b>
60 lines of code, checked out in <b>$CVSCheckoutTime</b> seconds<br></ul>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]61<li><a href="$DATE-Build-Log.txt">Compilation Log</a>
62<ul>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]63 $BuildError
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000[diff] [blame]64 Time to configure CVS tree: <b>$ConfigTime</b> seconds
65 (<b>$ConfigWallTime</b> seconds wall time)<br>
Chris Lattnerd9bdbaa2003-01-22 20:35:59 +0000[diff] [blame]66 Time to build CVS tree: <b>$BuildTime</b> seconds
67 (<b>$BuildWallTime</b> seconds wall time)<br>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]68 Number of object files compiled: <b>$NumObjects</b><br>
69 Number of libraries linked: <b>$NumLibraries</b><br>
70 Number of executables linked:<b> $NumExecutables</b><br>
71</ul>
72</ul>
73
74<h2>Warnings during the build:</h2>
Chris Lattner09bfdf52003-02-02 17:02:20 +0000[diff] [blame]75<ul>$WarningsList
76</ul><p>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]77
78<br><br><center>
79<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
80<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
81<font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b>
82</td></tr></table></td></tr></table></center><p>
83
84<h2>Changes to CVS:</h2>
85<ul>
86<li>Users who committed to CVS: <b>$UserCommitList</b>
87<li>Users who updated from CVS: <b>$UserUpdateList</b>
88<li>Added Files: $AddedFilesList
89<li>Modified Files: $ModifiedFilesList
90<li>Removed Files: $RemovedFilesList
91</ul><p>
92
Chris Lattner2f8cb572003-01-20 18:05:27 +0000[diff] [blame]93<h2>Changes to Warnings:</h2>
94<ul>
95<li>Warnings Added: $WarningsAdded
96<li>Warnings Removed: $WarningsRemoved
97</ul><p>
98
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]99<h2>Changes in the test suite:</h2>
100<ul>
Chris Lattnerd9bdbaa2003-01-22 20:35:59 +0000[diff] [blame]101<li>New Tests: $TestsAdded
102<li>Removed Tests: $TestsRemoved
103<li>Newly passing tests: $TestsFixed
104<li>Newly failing tests: $TestsBroken
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]105</ul>
106
107<br><br><center>
108<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
109<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
110<font size=+2 face=Verdana><b><a name="Trends">Changes over Time</font></b>
111</td></tr></table></td></tr></table></center><p>
112
Chris Lattnera3ed7d32003-11-08 20:48:39 +0000[diff] [blame]113
114Here are some charts showing how the LLVM optimizer and code generators are
115changing over time. For now we use the Olden benchmark suite to measure this,
116but eventually we will switch to using SPEC CPU2000. All programs are run with
117"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger
118version.<p>
119
120<h2>Compilation Measurements:</h2>
121
122<table border="0" align=center>
123<tr>
124<td width=50% align=center>
125<a href="running_Olden_bytecode_large.png"><img width=480 height=360 border=0 src="running_Olden_bytecode.png"></a><br>
126Size of LLVM bytecode files
127</td>
128<td width=50% align=center>
129<a href="running_Olden_machcode_large.png"><img width=480 height=360 border=0 src="running_Olden_machcode.png"></a><br>
130Size of native machine code for each program (generated by the JIT)
131</td></tr>
132<tr>
133<td align=center>
134<a href="running_Olden_opt_time_large.png"><img width=480 height=360 border=0 src="running_Olden_opt_time.png"></a><br>
135Time to run the LLVM optimizer on each program
136</td>
137<td></td></tr>
138</table>
139
140<h2>Program Execution Measurements:</h2>
141
142<table border="0" align=center>
143<tr>
144<td width=50% align=center>
145<a href="running_Olden_cbe_time_large.png"><img width=480 height=360 border=0 src="running_Olden_cbe_time.png"></a><br>
146Execution time for CBE generated executable
147</td>
148<td width=50% align=center>
149<a href="running_Olden_llc_time_large.png"><img width=480 height=360 border=0 src="running_Olden_llc_time.png"></a><br>
150Execution time for the LLC generated executable
151</td></tr>
152
153<tr>
154<td align=center>
155<a href="running_Olden_jit_time_large.png"><img width=480 height=360 border=0 src="running_Olden_jit_time.png"></a><br>
156Execution time for program in the JIT
157</td>
158<td></td></tr>
159</table>
160
161
162
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]163
164<br><br><center>
165<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
166<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
167<font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b>
168</td></tr></table></td></tr></table></center><p>
169
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]170This section tests LLVM on a variety of programs in the test suite. This
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]171includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as
172well as a few random programs with test inputs. This section is meant to track
173how stable LLVM is as a whole. A failure in the execution of any test is marked
174with an asterisk: `*'. The columns of the tables are:<p>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]175
176<ol>
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]177<li><a name="Program">Program</a> - The name of the program for that row.</li>
178<li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li>
179<li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the
180 program</li>
181<li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the
182 compiled bytecode</li>
183<li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with
184 LLC (the static backend)</li>
185<li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the
186 JIT itself, instead of executing the program.</li>
187<li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine
188 code generated by the JIT.</li>
189<li><a name="GCC">GCC</a> - The time taken to execute the program when compiled
Chris Lattnerb1adab72003-08-18 04:32:34 +0000[diff] [blame]190 with GCC -O2.</li>
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]191<li><a name="CBE">CBE</a> - The time taken to execute the program after
Chris Lattnere928d7d2003-08-18 04:39:41 +0000[diff] [blame]192 compilation through the C backend, compiled with -O2.</li>
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]193<li><a name="LLC">LLC</a> - How long does the program generated by the static
194 backend LLC take to execute </li>
195<li><a name="JIT">JIT</a> - The amount of time spent running the
196 program with the JIT; this includes the code generation phase (listed above)
197 and actually running the program.</li>
Alkis Evlogimenos6b8b2252003-10-08 05:09:52 +0000[diff] [blame]198<li><a name="GCC/LLC">GCC/LLC</a> - The speed-up of the LLC output vs the native
199 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
200<li><a name="GCC/CBE">GCC/CBE</a> - The speed-up of the CBE output vs the native
201 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
Chris Lattner8ffc66d2003-12-19 03:34:46 +0000[diff] [blame^]202<li><a name="LLC-LS">LLC-LS</a> - How long does the program generated by the static
203 backend LLC take to execute the program, when compiled with the linear scan
204 register allocator. This is temporary, for tuning.</li>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]205</ol><p>
206
Misha Brukmanefe84742003-08-19 15:54:16 +0000[diff] [blame]207A complete log of testing
Chris Lattnereac3cdc2003-08-21 15:55:26 +0000[diff] [blame]208<a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>,
209<a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and
210<a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are
Misha Brukmanefe84742003-08-19 15:54:16 +0000[diff] [blame]211available</a> for further analysis.
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]212
Chris Lattnereac3cdc2003-08-21 15:55:26 +0000[diff] [blame]213<h2>Programs/External</h2>
214
215<center>
216<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
217$ExternalProgramsTable
218</td></tr></table></center>
219
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]220<h2>Programs/MultiSource</h2>
221
222<center>
223<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000[diff] [blame]224$MultiSourceProgramsTable
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]225</td></tr></table></center>
226
227<h2>Programs/SingleSource</h2>
228
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000[diff] [blame]229<center>
230<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
231$SingleSourceProgramsTable
232</td></tr></table></center>
233
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]234
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]235
236<br><br><center>
237<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
238<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
239<font size=+2 face=Verdana><b><a name="Regression">Regression Tests</font></b>
240</td></tr></table></td></tr></table></center><p>
241
242Not yet implemented<p>
243
244</td></tr>
245
246</html>