Gitiles
Code Review Sign In
gerrit-public.fairphone.software / fp2-dev / platform / external / llvm / f12a90098aec2f8e496ab67ccbe119e19fbe40c3 / . / utils / NightlyTestTemplate.html
blob: c38bb2e776bbe4e7aadfa462cd8d06863c319c0b [file] [log] [blame]
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]1<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
2<html><head><title>LLVM Test Results for $DateString</title></head>
3
4<body bgcolor=white>
5<center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center>
6<hr height=1>
7
8<table width=100%>
9<tr><td valign=top align=center>
10
11<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
12<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77">
13<font size=+1><b>Sections:</b></font><br>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]14</td></tr><tr><td bgcolor="#FFCC99" align=center>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]15<a href="#Overview">Overview</a><br>
16<a href="#Changes">Changes</a><br>
Chris Lattneredcc6b12004-12-04 20:18:21 +0000[diff] [blame]17<a href="#Dejagnu">Dejagnu Tests</a><br>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]18<a href="#Trends">Trends</a><br>
19<a href="#Programs">Programs</a><br>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]20</td></tr></table></td></tr></table>
21
22<p>
23<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
24<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"
25<font size=+1><b>Previous:</b></font><br>
26</td></tr><tr><td bgcolor="#FFCC99">
27 $PrevDaysList
28</td></tr></table></td></tr></table>
29<p>
30
31<font size=+1><b>Back to:</b></font><br>
Reid Spencer9dce2b32006-03-14 05:54:52 +0000[diff] [blame]32<a href="http://llvm.org/testresults/">Test&nbsp;Results</a><br>
33<a href="http://llvm.org/">LLVM&nbsp;Page</a><p>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]34
35</td><td valign=top>
36
37<center>
38<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
39<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
40<font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
41</td></tr></table></td></tr></table></center><p>
42
Chris Lattner24eefd32003-08-18 19:59:28 +0000[diff] [blame]43<!-- Running LOC graph -->
44<table align=right>
45<tr><td>
46<a href="running_loc_large.png"
Chris Lattner8ab0a012003-08-19 14:27:44 +0000[diff] [blame]47 ><img border=0 width=480 height=360 src="running_loc.png"></a>
Chris Lattner24eefd32003-08-18 19:59:28 +0000[diff] [blame]48</td></tr>
49<tr><td align=center>Lines Of Code over Time<br>
50<font size=-1><a href="running_loc_large.png">Click for larger view</a></font>
51</td></tr>
52</table>
53
Reid Spencer900576f2004-06-22 15:32:02 +0000[diff] [blame]54<h2>Nightly Test Overview:</h2>
55<ul>
Chris Lattner004e19e2005-02-13 16:08:30 +0000[diff] [blame]56 <li>Start: <b>$TestStartTime</b></li>
57 <li>Finish: <b>$TestFinishTime</b></li>
Reid Spencer900576f2004-06-22 15:32:02 +0000[diff] [blame]58 <li>Platform: <b>$TestPlatform</b></li>
59</ul>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]60<h2>CVS Tree Overview:</h2>
61<ul>
62<li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
63<ul>
Brian Gaeke1bb9a482003-10-06 15:30:00 +0000[diff] [blame]64 <b>$NumDirsInCVS</b> dirs, <b>$NumFilesInCVS</b> files, <b>$LOC</b>
65 lines of code, checked out in <b>$CVSCheckoutTime</b> seconds<br></ul>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]66<li><a href="$DATE-Build-Log.txt">Compilation Log</a>
Reid Spencer389174b2004-06-09 18:29:15 +0000[diff] [blame]67<table>
68<tr><td><b>Item</b></td><td><b>CPU Time</b></td><td><b>Wall Clock</b></td></tr>
69<tr><td>Configure CVS Tree</td><td>$ConfigTime</td><td>$ConfigWallTime</td></tr>
70<tr><td>Build CVS Tree</td><td>$BuildTime</td><td>$BuildWallTime</td></tr>
Tanya Lattner5debe8c2004-11-21 00:02:40 +0000[diff] [blame]71<tr><td>Run Dejagnu Tests</td><td>$DejagnuTime</td><td>$DejagnuWallTime</td></tr>
Reid Spencer389174b2004-06-09 18:29:15 +0000[diff] [blame]72</table></li>
73<li>Number of object files compiled: <b>$NumObjects</b></li>
74<li>Number of libraries linked: <b>$NumLibraries</b></li>
75<li>Number of executables linked:<b> $NumExecutables</b></li>
Misha Brukman9a612752005-01-12 03:31:38 +0000[diff] [blame]76<li>Build Status: $BuildStatus</li>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]77</ul>
78
79<h2>Warnings during the build:</h2>
Reid Spencer7d6a5152006-03-21 01:21:39 +0000[diff] [blame]80$WarningsList
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]81
82<br><br><center>
83<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
84<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
85<font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b>
86</td></tr></table></td></tr></table></center><p>
87
88<h2>Changes to CVS:</h2>
89<ul>
90<li>Users who committed to CVS: <b>$UserCommitList</b>
91<li>Users who updated from CVS: <b>$UserUpdateList</b>
92<li>Added Files: $AddedFilesList
93<li>Modified Files: $ModifiedFilesList
94<li>Removed Files: $RemovedFilesList
95</ul><p>
96
Chris Lattner2f8cb572003-01-20 18:05:27 +0000[diff] [blame]97<h2>Changes to Warnings:</h2>
Reid Spencer7d6a5152006-03-21 01:21:39 +0000[diff] [blame]98<p>Warnings Added:</p>
99$WarningsAdded
100<p>Warnings Removed:</p>
101$WarningsRemoved
Chris Lattner2f8cb572003-01-20 18:05:27 +0000[diff] [blame]102
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]103<h2>Changes in the test suite:</h2>
104<ul>
Chris Lattnerd9bdbaa2003-01-22 20:35:59 +0000[diff] [blame]105<li>New Tests: $TestsAdded
106<li>Removed Tests: $TestsRemoved
107<li>Newly passing tests: $TestsFixed
108<li>Newly failing tests: $TestsBroken
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]109</ul>
Reid Spencerf2523712004-05-31 21:38:56 +0000[diff] [blame]110</td></tr></tbody></table>
Chris Lattneredcc6b12004-12-04 20:18:21 +0000[diff] [blame]111
112
113<br/><br/><center>
114<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
115<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
116<font size=+2 face=Verdana><b><a name="Dejagnu">Dejagnu Test Results</font></b>
117</td></tr></table></td></tr></table></center>
118<br/>
119$DejagnuTestResults
120<p>A complete log of testing <a href="$DATE-Dejagnu-testrun.log">Feature and Regression</a> is available for further analysis.</p>
121
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]122<br><br><center>
123<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
124<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
Reid Spencerf2523712004-05-31 21:38:56 +0000[diff] [blame]125<font size=+2 face=Verdana><b><a name="Trends">Changes Over Time</font></b>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]126</td></tr></table></td></tr></table></center><p>
127
Chris Lattnera3ed7d32003-11-08 20:48:39 +0000[diff] [blame]128
129Here are some charts showing how the LLVM optimizer and code generators are
130changing over time. For now we use the Olden benchmark suite to measure this,
131but eventually we will switch to using SPEC CPU2000. All programs are run with
132"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger
133version.<p>
134
135<h2>Compilation Measurements:</h2>
136
137<table border="0" align=center>
138<tr>
139<td width=50% align=center>
140<a href="running_Olden_bytecode_large.png"><img width=480 height=360 border=0 src="running_Olden_bytecode.png"></a><br>
141Size of LLVM bytecode files
142</td>
143<td width=50% align=center>
Chris Lattnera3ed7d32003-11-08 20:48:39 +0000[diff] [blame]144<a href="running_Olden_opt_time_large.png"><img width=480 height=360 border=0 src="running_Olden_opt_time.png"></a><br>
145Time to run the LLVM optimizer on each program
Chris Lattnere50caac2005-10-28 16:35:18 +0000[diff] [blame]146</td></tr>
Chris Lattnera3ed7d32003-11-08 20:48:39 +0000[diff] [blame]147</table>
148
149<h2>Program Execution Measurements:</h2>
150
151<table border="0" align=center>
152<tr>
153<td width=50% align=center>
154<a href="running_Olden_cbe_time_large.png"><img width=480 height=360 border=0 src="running_Olden_cbe_time.png"></a><br>
155Execution time for CBE generated executable
156</td>
157<td width=50% align=center>
158<a href="running_Olden_llc_time_large.png"><img width=480 height=360 border=0 src="running_Olden_llc_time.png"></a><br>
159Execution time for the LLC generated executable
160</td></tr>
161
162<tr>
163<td align=center>
164<a href="running_Olden_jit_time_large.png"><img width=480 height=360 border=0 src="running_Olden_jit_time.png"></a><br>
165Execution time for program in the JIT
166</td>
167<td></td></tr>
168</table>
169
170
171
Chris Lattner4c7e3032003-01-20 06:11:03 +0000[diff] [blame]172
173<br><br><center>
174<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
175<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
176<font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b>
177</td></tr></table></td></tr></table></center><p>
178
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]179This section tests LLVM on a variety of programs in the test suite. This
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]180includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as
181well as a few random programs with test inputs. This section is meant to track
182how stable LLVM is as a whole. A failure in the execution of any test is marked
183with an asterisk: `*'. The columns of the tables are:<p>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]184
185<ol>
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]186<li><a name="Program">Program</a> - The name of the program for that row.</li>
187<li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li>
188<li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the
189 program</li>
190<li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the
191 compiled bytecode</li>
192<li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with
193 LLC (the static backend)</li>
194<li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the
195 JIT itself, instead of executing the program.</li>
196<li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine
197 code generated by the JIT.</li>
198<li><a name="GCC">GCC</a> - The time taken to execute the program when compiled
Chris Lattnerb1adab72003-08-18 04:32:34 +0000[diff] [blame]199 with GCC -O2.</li>
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]200<li><a name="CBE">CBE</a> - The time taken to execute the program after
Chris Lattnere928d7d2003-08-18 04:39:41 +0000[diff] [blame]201 compilation through the C backend, compiled with -O2.</li>
Misha Brukman0137afa2003-08-15 19:31:04 +0000[diff] [blame]202<li><a name="LLC">LLC</a> - How long does the program generated by the static
203 backend LLC take to execute </li>
204<li><a name="JIT">JIT</a> - The amount of time spent running the
205 program with the JIT; this includes the code generation phase (listed above)
206 and actually running the program.</li>
Alkis Evlogimenos6b8b2252003-10-08 05:09:52 +0000[diff] [blame]207<li><a name="GCC/LLC">GCC/LLC</a> - The speed-up of the LLC output vs the native
208 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
209<li><a name="GCC/CBE">GCC/CBE</a> - The speed-up of the CBE output vs the native
210 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.</li>
Reid Spencer51e615f2004-12-06 20:14:45 +0000[diff] [blame]211<li><a name="LLC-BETA">LLC-BETA</a> - How long does the program generated by the static
212 backend LLC take to execute the program, when compiled with new experimental
213 features. This is temporary, for tuning.</li>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]214</ol><p>
215
Misha Brukmanefe84742003-08-19 15:54:16 +0000[diff] [blame]216A complete log of testing
Chris Lattnereac3cdc2003-08-21 15:55:26 +0000[diff] [blame]217<a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>,
218<a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and
219<a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are
Tanya Lattner60f5cf42004-06-22 05:44:31 +0000[diff] [blame]220available for further analysis.
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]221
Chris Lattnereac3cdc2003-08-21 15:55:26 +0000[diff] [blame]222<h2>Programs/External</h2>
223
224<center>
225<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
226$ExternalProgramsTable
227</td></tr></table></center>
228
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]229<h2>Programs/MultiSource</h2>
230
231<center>
232<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000[diff] [blame]233$MultiSourceProgramsTable
Chris Lattner8a4baf42003-01-22 16:13:10 +0000[diff] [blame]234</td></tr></table></center>
235
236<h2>Programs/SingleSource</h2>
237
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000[diff] [blame]238<center>
239<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
240$SingleSourceProgramsTable
241</td></tr></table></center>
242
Reid Spencer1a8c9172004-06-09 02:07:25 +0000[diff] [blame]243</td></tr></html>
Tanya Lattner5debe8c2004-11-21 00:02:40 +0000[diff] [blame]244