blob: 3fceb623f488c617156a8d9826b0e0f6ebe2c323 [file] [log] [blame]
Chris Lattner2f8cb572003-01-20 18:05:27 +00001
Chris Lattner4c7e3032003-01-20 06:11:03 +00002<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
3<html><head><title>LLVM Test Results for $DateString</title></head>
4
5<body bgcolor=white>
6<center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center>
7<hr height=1>
8
9<table width=100%>
10<tr><td valign=top align=center>
11
12<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
13<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77">
14<font size=+1><b>Sections:</b></font><br>
Chris Lattner8a4baf42003-01-22 16:13:10 +000015</td></tr><tr><td bgcolor="#FFCC99" align=center>
Chris Lattner4c7e3032003-01-20 06:11:03 +000016<a href="#Overview">Overview</a><br>
17<a href="#Changes">Changes</a><br>
18<a href="#Trends">Trends</a><br>
19<a href="#Programs">Programs</a><br>
20<a href="#Regression">Regression</a><br>
21</td></tr></table></td></tr></table>
22
23<p>
24<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
25<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"
26<font size=+1><b>Previous:</b></font><br>
27</td></tr><tr><td bgcolor="#FFCC99">
28 $PrevDaysList
29</td></tr></table></td></tr></table>
30<p>
31
32<font size=+1><b>Back to:</b></font><br>
33<a href="..">Test&nbsp;Results</a><br>
34<a href="../..">LLVM&nbsp;Page</a><p>
35
36</td><td valign=top>
37
38<center>
39<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
40<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
41<font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
42</td></tr></table></td></tr></table></center><p>
43
Chris Lattner24eefd32003-08-18 19:59:28 +000044<!-- Running LOC graph -->
45<table align=right>
46<tr><td>
47<a href="running_loc_large.png"
Chris Lattner8ab0a012003-08-19 14:27:44 +000048 ><img border=0 width=480 height=360 src="running_loc.png"></a>
Chris Lattner24eefd32003-08-18 19:59:28 +000049</td></tr>
50<tr><td align=center>Lines Of Code over Time<br>
51<font size=-1><a href="running_loc_large.png">Click for larger view</a></font>
52</td></tr>
53</table>
54
Chris Lattner4c7e3032003-01-20 06:11:03 +000055<h2>CVS Tree Overview:</h2>
56<ul>
57<li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
58<ul>
59 Time to check out CVS tree: <b>$CVSCheckoutTime</b> seconds<br>
60 Number of directories in CVS: <b>$NumDirsInCVS</b><br>
61 Number of files in CVS: <b>$NumFilesInCVS</b><br>
62 Number of lines of code: <b>$LOC</b></ul>
63<li><a href="$DATE-Build-Log.txt">Compilation Log</a>
64<ul>
Chris Lattner8a4baf42003-01-22 16:13:10 +000065 $BuildError
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +000066 Time to configure CVS tree: <b>$ConfigTime</b> seconds
67 (<b>$ConfigWallTime</b> seconds wall time)<br>
Chris Lattnerd9bdbaa2003-01-22 20:35:59 +000068 Time to build CVS tree: <b>$BuildTime</b> seconds
69 (<b>$BuildWallTime</b> seconds wall time)<br>
Chris Lattner4c7e3032003-01-20 06:11:03 +000070 Number of object files compiled: <b>$NumObjects</b><br>
71 Number of libraries linked: <b>$NumLibraries</b><br>
72 Number of executables linked:<b> $NumExecutables</b><br>
73</ul>
74</ul>
75
76<h2>Warnings during the build:</h2>
Chris Lattner09bfdf52003-02-02 17:02:20 +000077<ul>$WarningsList
78</ul><p>
Chris Lattner4c7e3032003-01-20 06:11:03 +000079
80<br><br><center>
81<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
82<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
83<font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b>
84</td></tr></table></td></tr></table></center><p>
85
86<h2>Changes to CVS:</h2>
87<ul>
88<li>Users who committed to CVS: <b>$UserCommitList</b>
89<li>Users who updated from CVS: <b>$UserUpdateList</b>
90<li>Added Files: $AddedFilesList
91<li>Modified Files: $ModifiedFilesList
92<li>Removed Files: $RemovedFilesList
93</ul><p>
94
Chris Lattner2f8cb572003-01-20 18:05:27 +000095<h2>Changes to Warnings:</h2>
96<ul>
97<li>Warnings Added: $WarningsAdded
98<li>Warnings Removed: $WarningsRemoved
99</ul><p>
100
Chris Lattner4c7e3032003-01-20 06:11:03 +0000101<h2>Changes in the test suite:</h2>
102<ul>
Chris Lattnerd9bdbaa2003-01-22 20:35:59 +0000103<li>New Tests: $TestsAdded
104<li>Removed Tests: $TestsRemoved
105<li>Newly passing tests: $TestsFixed
106<li>Newly failing tests: $TestsBroken
Chris Lattner4c7e3032003-01-20 06:11:03 +0000107</ul>
108
109<br><br><center>
110<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
111<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
112<font size=+2 face=Verdana><b><a name="Trends">Changes over Time</font></b>
113</td></tr></table></td></tr></table></center><p>
114
115GNUplot <b>charts</b> showing a couple of things:
116<ol>
Chris Lattner4c7e3032003-01-20 06:11:03 +0000117<li>Compile Time
118<li>Testing Time
119<li>Time to run some programs, say all of Olden
120<li>Time to compile something, say Olden.
121<li>Size of bytecode files for Olden
122</ol>
123
124<br><br><center>
125<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
126<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
127<font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b>
128</td></tr></table></td></tr></table></center><p>
129
Chris Lattner8a4baf42003-01-22 16:13:10 +0000130This section tests LLVM on a variety of programs in the test suite. This
Misha Brukman0137afa2003-08-15 19:31:04 +0000131includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as
132well as a few random programs with test inputs. This section is meant to track
133how stable LLVM is as a whole. A failure in the execution of any test is marked
134with an asterisk: `*'. The columns of the tables are:<p>
Chris Lattner8a4baf42003-01-22 16:13:10 +0000135
136<ol>
Misha Brukman0137afa2003-08-15 19:31:04 +0000137<li><a name="Program">Program</a> - The name of the program for that row.</li>
138<li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li>
139<li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the
140 program</li>
141<li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the
142 compiled bytecode</li>
143<li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with
144 LLC (the static backend)</li>
145<li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the
146 JIT itself, instead of executing the program.</li>
147<li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine
148 code generated by the JIT.</li>
149<li><a name="GCC">GCC</a> - The time taken to execute the program when compiled
Chris Lattnerb1adab72003-08-18 04:32:34 +0000150 with GCC -O2.</li>
Misha Brukman0137afa2003-08-15 19:31:04 +0000151<li><a name="CBE">CBE</a> - The time taken to execute the program after
Chris Lattnere928d7d2003-08-18 04:39:41 +0000152 compilation through the C backend, compiled with -O2.</li>
Misha Brukman0137afa2003-08-15 19:31:04 +0000153<li><a name="LLC">LLC</a> - How long does the program generated by the static
154 backend LLC take to execute </li>
155<li><a name="JIT">JIT</a> - The amount of time spent running the
156 program with the JIT; this includes the code generation phase (listed above)
157 and actually running the program.</li>
Chris Lattnerb1adab72003-08-18 04:32:34 +0000158<li><a name="GCC/LLC">GCC/LLC - The speed-up of the LLC output vs the native
159 GCC output: greater than 1 is a speedup, less than 1 is a slowdown.
Chris Lattner8a4baf42003-01-22 16:13:10 +0000160</ol><p>
161
Misha Brukmanefe84742003-08-19 15:54:16 +0000162A complete log of testing
Chris Lattnereac3cdc2003-08-21 15:55:26 +0000163<a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>,
164<a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and
165<a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are
Misha Brukmanefe84742003-08-19 15:54:16 +0000166available</a> for further analysis.
Chris Lattner8a4baf42003-01-22 16:13:10 +0000167
Chris Lattnereac3cdc2003-08-21 15:55:26 +0000168<h2>Programs/External</h2>
169
170<center>
171<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
172$ExternalProgramsTable
173</td></tr></table></center>
174
Chris Lattner8a4baf42003-01-22 16:13:10 +0000175<h2>Programs/MultiSource</h2>
176
177<center>
178<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000179$MultiSourceProgramsTable
Chris Lattner8a4baf42003-01-22 16:13:10 +0000180</td></tr></table></center>
181
182<h2>Programs/SingleSource</h2>
183
Chris Lattnerbf6a4dc2003-08-18 06:05:21 +0000184<center>
185<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
186$SingleSourceProgramsTable
187</td></tr></table></center>
188
Chris Lattner8a4baf42003-01-22 16:13:10 +0000189
Chris Lattner4c7e3032003-01-20 06:11:03 +0000190
191<br><br><center>
192<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000">
193<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
194<font size=+2 face=Verdana><b><a name="Regression">Regression Tests</font></b>
195</td></tr></table></td></tr></table></center><p>
196
197Not yet implemented<p>
198
199</td></tr>
200
201</html>