Gitiles
Code Review Sign In
gerrit-public.fairphone.software / toolchain / llvm-project / 090516fe932ad4ed14b72ea27017aeb4a15cb15c / . / llvm / utils / NightlyTestTemplate.html
blob: 83db6bbbaa6244dec031e3b0a2872d505cf01d27 [file] [log] [blame]
Chris Lattner3dc06172003-01-20 18:05:27 +0000[diff] [blame]1
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]2<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
3<html><head><title>LLVM Test Results for $DateString</title></head>
4
5<body bgcolor=white>
6<center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center>
7<hr height=1>
8
9<table width=100%>
10<tr><td valign=top align=center>
11
12<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
13<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77">
14<font size=+1><b>Sections:</b></font><br>
Chris Lattner42215202003-01-22 16:13:10 +0000[diff] [blame]15</td></tr><tr><td bgcolor="#FFCC99" align=center>
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]16<a href="#Overview">Overview</a><br>
17<a href="#Changes">Changes</a><br>
18<a href="#Trends">Trends</a><br>
19<a href="#Programs">Programs</a><br>
20<a href="#Regression">Regression</a><br>
21</td></tr></table></td></tr></table>
22
23<p>
24<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
25<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"
26<font size=+1><b>Previous:</b></font><br>
27</td></tr><tr><td bgcolor="#FFCC99">
28 $PrevDaysList
29</td></tr></table></td></tr></table>
30<p>
31
32<font size=+1><b>Back to:</b></font><br>
33<a href="..">Test&nbsp;Results</a><br>
34<a href="../..">LLVM&nbsp;Page</a><p>
35
36</td><td valign=top>
37
38<center>
39<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
40<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
41<font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
42</td></tr></table></td></tr></table></center><p>
43
Chris Lattnerb3b70f92003-08-18 19:59:28 +0000[diff] [blame]44<!-- Running LOC graph -->
45<table align=right>
46<tr><td>
47<a href="running_loc_large.png"
Chris Lattnerd729a472003-08-19 14:27:44 +0000[diff] [blame]48 ><img border=0 width=480 height=360 src="running_loc.png"></a>
Chris Lattnerb3b70f92003-08-18 19:59:28 +0000[diff] [blame]49</td></tr>
50<tr><td align=center>Lines Of Code over Time<br>
51<font size=-1><a href="running_loc_large.png">Click for larger view</a></font>
52</td></tr>
53</table>
54
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]55<h2>CVS Tree Overview:</h2>
56<ul>
57<li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
58<ul>
Brian Gaeke0c803032003-10-06 15:30:00 +0000[diff] [blame]59 <b>$NumDirsInCVS</b> dirs, <b>$NumFilesInCVS</b> files, <b>$LOC</b>
60 lines of code, checked out in <b>$CVSCheckoutTime</b> seconds<br></ul>
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]61<li><a href="$DATE-Build-Log.txt">Compilation Log</a>
62<ul>
Chris Lattner42215202003-01-22 16:13:10 +0000[diff] [blame]63 $BuildError
Chris Lattnerf5ba14b2003-08-18 06:05:21 +0000[diff] [blame]64 Time to configure CVS tree: <b>$ConfigTime</b> seconds
65 (<b>$ConfigWallTime</b> seconds wall time)<br>
Chris Lattner34debbf2003-01-22 20:35:59 +0000[diff] [blame]66 Time to build CVS tree: <b>$BuildTime</b> seconds
67 (<b>$BuildWallTime</b> seconds wall time)<br>
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]68 Number of object files compiled: <b>$NumObjects</b><br>
69 Number of libraries linked: <b>$NumLibraries</b><br>
70 Number of executables linked:<b> $NumExecutables</b><br>
71</ul>
72</ul>
73
74<h2>Warnings during the build:</h2>
Chris Lattner0881aeb2003-02-02 17:02:20 +0000[diff] [blame]75<ul>$WarningsList
76</ul><p>
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]77
78<br><br><center>
79<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
80<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
81<font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b>
82</td></tr></table></td></tr></table></center><p>
83
84<h2>Changes to CVS:</h2>
85<ul>
86<li>Users who committed to CVS: <b>$UserCommitList</b>
87<li>Users who updated from CVS: <b>$UserUpdateList</b>
88<li>Added Files: $AddedFilesList
89<li>Modified Files: $ModifiedFilesList
90<li>Removed Files: $RemovedFilesList
91</ul><p>
92
Chris Lattner3dc06172003-01-20 18:05:27 +0000[diff] [blame]93<h2>Changes to Warnings:</h2>
94<ul>
95<li>Warnings Added: $WarningsAdded
96<li>Warnings Removed: $WarningsRemoved
97</ul><p>
98
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]99<h2>Changes in the test suite:</h2>
100<ul>
Chris Lattner34debbf2003-01-22 20:35:59 +0000[diff] [blame]101<li>New Tests: $TestsAdded
102<li>Removed Tests: $TestsRemoved
103<li>Newly passing tests: $TestsFixed
104<li>Newly failing tests: $TestsBroken
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]105</ul>
106
107<br><br><center>
108<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
109<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
110<font size=+2 face=Verdana><b><a name="Trends">Changes over Time</font></b>
111</td></tr></table></td></tr></table></center><p>
112
Chris Lattner5c944912003-11-08 20:48:39 +0000[diff] [blame]113
114Here are some charts showing how the LLVM optimizer and code generators are
115changing over time. For now we use the Olden benchmark suite to measure this,
116but eventually we will switch to using SPEC CPU2000. All programs are run with
117"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger
118version.<p>
119
120<h2>Compilation Measurements:</h2>
121
122<table border="0" align=center>
123<tr>
124<td width=50% align=center>
125<a href="running_Olden_bytecode_large.png"><img width=480 height=360 border=0 src="running_Olden_bytecode.png"></a><br>
126Size of LLVM bytecode files
127</td>
128<td width=50% align=center>
129<a href="running_Olden_machcode_large.png"><img width=480 height=360 border=0 src="running_Olden_machcode.png"></a><br>
130Size of native machine code for each program (generated by the JIT)
131</td></tr>
132<tr>
133<td align=center>
134<a href="running_Olden_opt_time_large.png"><img width=480 height=360 border=0 src="running_Olden_opt_time.png"></a><br>
135Time to run the LLVM optimizer on each program
136</td>
137<td></td></tr>
138</table>
139
140<h2>Program Execution Measurements:</h2>
141
142<table border="0" align=center>
143<tr>
144<td width=50% align=center>
145<a href="running_Olden_cbe_time_large.png"><img width=480 height=360 border=0 src="running_Olden_cbe_time.png"></a><br>
146Execution time for CBE generated executable
147</td>
148<td width=50% align=center>
149<a href="running_Olden_llc_time_large.png"><img width=480 height=360 border=0 src="running_Olden_llc_time.png"></a><br>
150Execution time for the LLC generated executable
151</td></tr>
152
153<tr>
154<td align=center>
155<a href="running_Olden_jit_time_large.png"><img width=480 height=360 border=0 src="running_Olden_jit_time.png"></a><br>
156Execution time for program in the JIT
157</td>
158<td></td></tr>
159</table>
160
161
162
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]163
164<br><br><center>
165<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
166<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
167<font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b>
168</td></tr></table></td></tr></table></center><p>
169
Chris Lattner42215202003-01-22 16:13:10 +0000[diff] [blame]170This section tests LLVM on a variety of programs in the test suite. This
Misha Brukman2ba18cb2003-08-15 19:31:04 +0000[diff] [blame]171includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as
172well as a few random programs with test inputs. This section is meant to track
173how stable LLVM is as a whole. A failure in the execution of any test is marked
174with an asterisk: `*'. The columns of the tables are:<p>
Chris Lattner42215202003-01-22 16:13:10 +0000[diff] [blame]175
176<ol>
Misha Brukman2ba18cb2003-08-15 19:31:04 +0000[diff] [blame]177<li><a name="Program">Program</a> - The name of the program for that row.</li>
178<li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li>
179<li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the
180 program</li>
181<li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the
182 compiled bytecode</li>
183<li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with
184 LLC (the static backend)</li>
185<li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the
186 JIT itself, instead of executing the program.</li>
187<li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine
188 code generated by the JIT.</li>
189<li><a name="GCC">GCC</a> - The time taken to execute the program when compiled
Chris Lattnerfe2b22f2003-08-18 04:32:34 +0000[diff] [blame]190 with GCC -O2.</li>
Misha Brukman2ba18cb2003-08-15 19:31:04 +0000[diff] [blame]191<li><a name="CBE">CBE</a> - The time taken to execute the program after
Chris Lattner978b8482003-08-18 04:39:41 +0000[diff] [blame]192 compilation through the C backend, compiled with -O2.</li>
Misha Brukman2ba18cb2003-08-15 19:31:04 +0000[diff] [blame]193<li><a name="LLC">LLC</a> - How long does the program generated by the static
194 backend LLC take to execute </li>
195<li><a name="JIT">JIT</a> - The amount of time spent running the
196 program with the JIT; this includes the code generation phase (listed above)
197 and actually running the program.</li>
Alkis Evlogimenos74f2f892003-10-08 05:09:52 +0000[diff] [blame]198<li><a name="GCC/LLC">GCC/LLC</a> - The speed-up of the LLC output vs the native
199 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
200<li><a name="GCC/CBE">GCC/CBE</a> - The speed-up of the CBE output vs the native
201 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
Chris Lattner4953be92003-12-19 03:34:46 +0000[diff] [blame]202<li><a name="LLC-LS">LLC-LS</a> - How long does the program generated by the static
203 backend LLC take to execute the program, when compiled with the linear scan
204 register allocator. This is temporary, for tuning.</li>
Chris Lattner42215202003-01-22 16:13:10 +0000[diff] [blame]205</ol><p>
206
Misha Brukmandbfec2c2003-08-19 15:54:16 +0000[diff] [blame]207A complete log of testing
Chris Lattnered51e682003-08-21 15:55:26 +0000[diff] [blame]208<a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>,
209<a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and
210<a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are
Misha Brukmandbfec2c2003-08-19 15:54:16 +0000[diff] [blame]211available</a> for further analysis.
Chris Lattner42215202003-01-22 16:13:10 +0000[diff] [blame]212
Chris Lattnered51e682003-08-21 15:55:26 +0000[diff] [blame]213<h2>Programs/External</h2>
214
215<center>
216<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
217$ExternalProgramsTable
218</td></tr></table></center>
219
Chris Lattner42215202003-01-22 16:13:10 +0000[diff] [blame]220<h2>Programs/MultiSource</h2>
221
222<center>
223<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
Chris Lattnerf5ba14b2003-08-18 06:05:21 +0000[diff] [blame]224$MultiSourceProgramsTable
Chris Lattner42215202003-01-22 16:13:10 +0000[diff] [blame]225</td></tr></table></center>
226
227<h2>Programs/SingleSource</h2>
228
Chris Lattnerf5ba14b2003-08-18 06:05:21 +0000[diff] [blame]229<center>
230<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
231$SingleSourceProgramsTable
232</td></tr></table></center>
233
Chris Lattner42215202003-01-22 16:13:10 +0000[diff] [blame]234
Chris Lattner6a36dc62003-01-20 06:11:03 +0000[diff] [blame]235
236<br><br><center>
237<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
238<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
239<font size=+2 face=Verdana><b><a name="Regression">Regression Tests</font></b>
240</td></tr></table></td></tr></table></center><p>
241
242Not yet implemented<p>
243
244</td></tr>
245
246</html>