Gitiles
Code Review Sign In
gerrit-public.fairphone.software / fp2-dev / platform / external / llvm / 24738a72b47832d17df0c9513fa2f03416dc614a / . / utils / NightlyTestTemplate.html
blob: 7ee4ce0ddb39d2c9190b93df5f9e53323e3b23ca [file] [log] [blame]
Chris Lattner2f8cb572003-01-20 18:05:27 +0000[diff] [blame]1
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]2<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
3<html><head><title>LLVM Test Results for $DateString</title></head>
4
5<body bgcolor=white>
6<center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center>
7<hr height=1>
8
9<table width=100%>
10<tr><td valign=top align=center>
11
12<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
13<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77">
14<font size=+1><b>Sections:</b></font><br>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]15</td></tr><tr><td bgcolor="#FFCC99" align=center>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]16<a href="#Overview">Overview</a><br>
17<a href="#Changes">Changes</a><br>
18<a href="#Trends">Trends</a><br>
19<a href="#Programs">Programs</a><br>
Chris Lattner4d00fde2004-05-28 20:30:23 +0000[diff] [blame]20<a href="#Feature">Feature</a><br>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]21<a href="#Regression">Regression</a><br>
22</td></tr></table></td></tr></table>
23
24<p>
25<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
26<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"
27<font size=+1><b>Previous:</b></font><br>
28</td></tr><tr><td bgcolor="#FFCC99">
29 $PrevDaysList
30</td></tr></table></td></tr></table>
31<p>
32
33<font size=+1><b>Back to:</b></font><br>
34<a href="..">Test&nbsp;Results</a><br>
35<a href="../..">LLVM&nbsp;Page</a><p>
36
37</td><td valign=top>
38
39<center>
40<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
41<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
42<font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
43</td></tr></table></td></tr></table></center><p>
44
Chris Lattner24eefd32003-08-18 19:59:28 +0000[diff] [blame]45<!-- Running LOC graph -->
46<table align=right>
47<tr><td>
48<a href="running_loc_large.png"
Chris Lattner8ab0a012003-08-19 14:27:44 +0000[diff] [blame]49 ><img border=0 width=480 height=360 src="running_loc.png"></a>
Chris Lattner24eefd32003-08-18 19:59:28 +0000[diff] [blame]50</td></tr>
51<tr><td align=center>Lines Of Code over Time<br>
52<font size=-1><a href="running_loc_large.png">Click for larger view</a></font>
53</td></tr>
54</table>
55
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]56<h2>CVS Tree Overview:</h2>
57<ul>
58<li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
59<ul>
Brian Gaeke1bb9a482003-10-06 15:30:00 +0000[diff] [blame]60 <b>$NumDirsInCVS</b> dirs, <b>$NumFilesInCVS</b> files, <b>$LOC</b>
61 lines of code, checked out in <b>$CVSCheckoutTime</b> seconds<br></ul>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]62<li><a href="$DATE-Build-Log.txt">Compilation Log</a>
63<ul>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]64 $BuildError
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000[diff] [blame]65 Time to configure CVS tree: <b>$ConfigTime</b> seconds
66 (<b>$ConfigWallTime</b> seconds wall time)<br>
Chris Lattnerd9bdbaa2003-01-22 20:35:59 +0000[diff] [blame]67 Time to build CVS tree: <b>$BuildTime</b> seconds
68 (<b>$BuildWallTime</b> seconds wall time)<br>
Chris Lattner4d00fde2004-05-28 20:30:23 +0000[diff] [blame]69 Time to run feature tests: <b>$FeatureTime</b> seconds
70 (<b>$FeatureWallTime</b> seconds wall time)<br>
71 Time to run regression tests: <b>$RegressionTime</b> seconds
72 (<b>$RegressionWallTime</b> seconds wall time)<br>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]73 Number of object files compiled: <b>$NumObjects</b><br>
74 Number of libraries linked: <b>$NumLibraries</b><br>
75 Number of executables linked:<b> $NumExecutables</b><br>
76</ul>
77</ul>
78
79<h2>Warnings during the build:</h2>
Chris Lattner09bfdf52003-02-02 17:02:20 +0000[diff] [blame]80<ul>$WarningsList
81</ul><p>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]82
83<br><br><center>
84<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
85<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
86<font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b>
87</td></tr></table></td></tr></table></center><p>
88
89<h2>Changes to CVS:</h2>
90<ul>
91<li>Users who committed to CVS: <b>$UserCommitList</b>
92<li>Users who updated from CVS: <b>$UserUpdateList</b>
93<li>Added Files: $AddedFilesList
94<li>Modified Files: $ModifiedFilesList
95<li>Removed Files: $RemovedFilesList
96</ul><p>
97
Chris Lattner2f8cb572003-01-20 18:05:27 +0000[diff] [blame]98<h2>Changes to Warnings:</h2>
99<ul>
100<li>Warnings Added: $WarningsAdded
101<li>Warnings Removed: $WarningsRemoved
102</ul><p>
103
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]104<h2>Changes in the test suite:</h2>
105<ul>
Chris Lattnerd9bdbaa2003-01-22 20:35:59 +0000[diff] [blame]106<li>New Tests: $TestsAdded
107<li>Removed Tests: $TestsRemoved
108<li>Newly passing tests: $TestsFixed
109<li>Newly failing tests: $TestsBroken
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]110</ul>
Reid Spencerf2523712004-05-31 21:38:56 +0000[diff] [blame]111</td></tr></tbody></table>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]112<br><br><center>
113<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
114<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
Reid Spencerf2523712004-05-31 21:38:56 +0000[diff] [blame]115<font size=+2 face=Verdana><b><a name="Trends">Changes Over Time</font></b>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]116</td></tr></table></td></tr></table></center><p>
117
Chris Lattnera3ed7d32003-11-08 20:48:39 +0000[diff] [blame]118
119Here are some charts showing how the LLVM optimizer and code generators are
120changing over time. For now we use the Olden benchmark suite to measure this,
121but eventually we will switch to using SPEC CPU2000. All programs are run with
122"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger
123version.<p>
124
125<h2>Compilation Measurements:</h2>
126
127<table border="0" align=center>
128<tr>
129<td width=50% align=center>
130<a href="running_Olden_bytecode_large.png"><img width=480 height=360 border=0 src="running_Olden_bytecode.png"></a><br>
131Size of LLVM bytecode files
132</td>
133<td width=50% align=center>
134<a href="running_Olden_machcode_large.png"><img width=480 height=360 border=0 src="running_Olden_machcode.png"></a><br>
135Size of native machine code for each program (generated by the JIT)
136</td></tr>
137<tr>
138<td align=center>
139<a href="running_Olden_opt_time_large.png"><img width=480 height=360 border=0 src="running_Olden_opt_time.png"></a><br>
140Time to run the LLVM optimizer on each program
141</td>
142<td></td></tr>
143</table>
144
145<h2>Program Execution Measurements:</h2>
146
147<table border="0" align=center>
148<tr>
149<td width=50% align=center>
150<a href="running_Olden_cbe_time_large.png"><img width=480 height=360 border=0 src="running_Olden_cbe_time.png"></a><br>
151Execution time for CBE generated executable
152</td>
153<td width=50% align=center>
154<a href="running_Olden_llc_time_large.png"><img width=480 height=360 border=0 src="running_Olden_llc_time.png"></a><br>
155Execution time for the LLC generated executable
156</td></tr>
157
158<tr>
159<td align=center>
160<a href="running_Olden_jit_time_large.png"><img width=480 height=360 border=0 src="running_Olden_jit_time.png"></a><br>
161Execution time for program in the JIT
162</td>
163<td></td></tr>
164</table>
165
166
167
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]168
169<br><br><center>
170<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
171<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
172<font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b>
173</td></tr></table></td></tr></table></center><p>
174
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]175This section tests LLVM on a variety of programs in the test suite. This
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]176includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as
177well as a few random programs with test inputs. This section is meant to track
178how stable LLVM is as a whole. A failure in the execution of any test is marked
179with an asterisk: `*'. The columns of the tables are:<p>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]180
181<ol>
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]182<li><a name="Program">Program</a> - The name of the program for that row.</li>
183<li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li>
184<li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the
185 program</li>
186<li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the
187 compiled bytecode</li>
188<li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with
189 LLC (the static backend)</li>
190<li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the
191 JIT itself, instead of executing the program.</li>
192<li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine
193 code generated by the JIT.</li>
194<li><a name="GCC">GCC</a> - The time taken to execute the program when compiled
Chris Lattnerb1adab72003-08-18 04:32:34 +0000[diff] [blame]195 with GCC -O2.</li>
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]196<li><a name="CBE">CBE</a> - The time taken to execute the program after
Chris Lattnere928d7d2003-08-18 04:39:41 +0000[diff] [blame]197 compilation through the C backend, compiled with -O2.</li>
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]198<li><a name="LLC">LLC</a> - How long does the program generated by the static
199 backend LLC take to execute </li>
200<li><a name="JIT">JIT</a> - The amount of time spent running the
201 program with the JIT; this includes the code generation phase (listed above)
202 and actually running the program.</li>
Alkis Evlogimenos6b8b2252003-10-08 05:09:52 +0000[diff] [blame]203<li><a name="GCC/LLC">GCC/LLC</a> - The speed-up of the LLC output vs the native
204 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
205<li><a name="GCC/CBE">GCC/CBE</a> - The speed-up of the CBE output vs the native
206 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
Chris Lattner8ffc66d2003-12-19 03:34:46 +0000[diff] [blame]207<li><a name="LLC-LS">LLC-LS</a> - How long does the program generated by the static
208 backend LLC take to execute the program, when compiled with the linear scan
209 register allocator. This is temporary, for tuning.</li>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]210</ol><p>
211
Misha Brukmanefe84742003-08-19 15:54:16 +0000[diff] [blame]212A complete log of testing
Chris Lattnereac3cdc2003-08-21 15:55:26 +0000[diff] [blame]213<a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>,
214<a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and
215<a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are
Misha Brukmanefe84742003-08-19 15:54:16 +0000[diff] [blame]216available</a> for further analysis.
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]217
Chris Lattnereac3cdc2003-08-21 15:55:26 +0000[diff] [blame]218<h2>Programs/External</h2>
219
220<center>
221<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
222$ExternalProgramsTable
223</td></tr></table></center>
224
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]225<h2>Programs/MultiSource</h2>
226
227<center>
228<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000[diff] [blame]229$MultiSourceProgramsTable
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]230</td></tr></table></center>
231
232<h2>Programs/SingleSource</h2>
233
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000[diff] [blame]234<center>
235<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
236$SingleSourceProgramsTable
237</td></tr></table></center>
238
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]239
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]240
Chris Lattner4d00fde2004-05-28 20:30:23 +0000[diff] [blame]241<br/><br/><center>
242<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
243<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
244<font size=+2 face=Verdana><b><a name="Feature">Feature Test Results</font></b>
245</td></tr></table></td></tr></table></center>
246<br/>
247$FeatureTestResults
248
249<br/><br/><center>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]250<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
251<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
252<font size=+2 face=Verdana><b><a name="Regression">Regression Tests</font></b>
Chris Lattner4d00fde2004-05-28 20:30:23 +0000[diff] [blame]253</td></tr></table></td></tr></table></center>
254<br/>
255$RegressionTestResults
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]256
257</td></tr>
258
259</html>