Chris Lattner | 2f8cb57 | 2003-01-20 18:05:27 +0000 | [diff] [blame] | 1 | |
Chris Lattner | 4c7e303 | 2003-01-20 06:11:03 +0000 | [diff] [blame] | 2 | <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"> |
| 3 | <html><head><title>LLVM Test Results for $DateString</title></head> |
| 4 | |
| 5 | <body bgcolor=white> |
| 6 | <center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center> |
| 7 | <hr height=1> |
| 8 | |
| 9 | <table width=100%> |
| 10 | <tr><td valign=top align=center> |
| 11 | |
| 12 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
| 13 | <table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"> |
| 14 | <font size=+1><b>Sections:</b></font><br> |
Chris Lattner | 8a4baf4 | 2003-01-22 16:13:10 +0000 | [diff] [blame] | 15 | </td></tr><tr><td bgcolor="#FFCC99" align=center> |
Chris Lattner | 4c7e303 | 2003-01-20 06:11:03 +0000 | [diff] [blame] | 16 | <a href="#Overview">Overview</a><br> |
| 17 | <a href="#Changes">Changes</a><br> |
| 18 | <a href="#Trends">Trends</a><br> |
| 19 | <a href="#Programs">Programs</a><br> |
| 20 | <a href="#Regression">Regression</a><br> |
| 21 | </td></tr></table></td></tr></table> |
| 22 | |
| 23 | <p> |
| 24 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
| 25 | <table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77" |
| 26 | <font size=+1><b>Previous:</b></font><br> |
| 27 | </td></tr><tr><td bgcolor="#FFCC99"> |
| 28 | $PrevDaysList |
| 29 | </td></tr></table></td></tr></table> |
| 30 | <p> |
| 31 | |
| 32 | <font size=+1><b>Back to:</b></font><br> |
| 33 | <a href="..">Test Results</a><br> |
| 34 | <a href="../..">LLVM Page</a><p> |
| 35 | |
| 36 | </td><td valign=top> |
| 37 | |
| 38 | <center> |
| 39 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
| 40 | <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" |
| 41 | <font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b> |
| 42 | </td></tr></table></td></tr></table></center><p> |
| 43 | |
Chris Lattner | 24eefd3 | 2003-08-18 19:59:28 +0000 | [diff] [blame] | 44 | <!-- Running LOC graph --> |
| 45 | <table align=right> |
| 46 | <tr><td> |
| 47 | <a href="running_loc_large.png" |
Chris Lattner | 8ab0a01 | 2003-08-19 14:27:44 +0000 | [diff] [blame] | 48 | ><img border=0 width=480 height=360 src="running_loc.png"></a> |
Chris Lattner | 24eefd3 | 2003-08-18 19:59:28 +0000 | [diff] [blame] | 49 | </td></tr> |
| 50 | <tr><td align=center>Lines Of Code over Time<br> |
| 51 | <font size=-1><a href="running_loc_large.png">Click for larger view</a></font> |
| 52 | </td></tr> |
| 53 | </table> |
| 54 | |
Chris Lattner | 4c7e303 | 2003-01-20 06:11:03 +0000 | [diff] [blame] | 55 | <h2>CVS Tree Overview:</h2> |
| 56 | <ul> |
| 57 | <li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a> |
| 58 | <ul> |
| 59 | Time to check out CVS tree: <b>$CVSCheckoutTime</b> seconds<br> |
| 60 | Number of directories in CVS: <b>$NumDirsInCVS</b><br> |
| 61 | Number of files in CVS: <b>$NumFilesInCVS</b><br> |
| 62 | Number of lines of code: <b>$LOC</b></ul> |
| 63 | <li><a href="$DATE-Build-Log.txt">Compilation Log</a> |
| 64 | <ul> |
Chris Lattner | 8a4baf4 | 2003-01-22 16:13:10 +0000 | [diff] [blame] | 65 | $BuildError |
Chris Lattner | bf6a4dc | 2003-08-18 06:05:21 +0000 | [diff] [blame] | 66 | Time to configure CVS tree: <b>$ConfigTime</b> seconds |
| 67 | (<b>$ConfigWallTime</b> seconds wall time)<br> |
Chris Lattner | d9bdbaa | 2003-01-22 20:35:59 +0000 | [diff] [blame] | 68 | Time to build CVS tree: <b>$BuildTime</b> seconds |
| 69 | (<b>$BuildWallTime</b> seconds wall time)<br> |
Chris Lattner | 4c7e303 | 2003-01-20 06:11:03 +0000 | [diff] [blame] | 70 | Number of object files compiled: <b>$NumObjects</b><br> |
| 71 | Number of libraries linked: <b>$NumLibraries</b><br> |
| 72 | Number of executables linked:<b> $NumExecutables</b><br> |
| 73 | </ul> |
| 74 | </ul> |
| 75 | |
| 76 | <h2>Warnings during the build:</h2> |
Chris Lattner | 09bfdf5 | 2003-02-02 17:02:20 +0000 | [diff] [blame] | 77 | <ul>$WarningsList |
| 78 | </ul><p> |
Chris Lattner | 4c7e303 | 2003-01-20 06:11:03 +0000 | [diff] [blame] | 79 | |
| 80 | <br><br><center> |
| 81 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
| 82 | <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" |
| 83 | <font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b> |
| 84 | </td></tr></table></td></tr></table></center><p> |
| 85 | |
| 86 | <h2>Changes to CVS:</h2> |
| 87 | <ul> |
| 88 | <li>Users who committed to CVS: <b>$UserCommitList</b> |
| 89 | <li>Users who updated from CVS: <b>$UserUpdateList</b> |
| 90 | <li>Added Files: $AddedFilesList |
| 91 | <li>Modified Files: $ModifiedFilesList |
| 92 | <li>Removed Files: $RemovedFilesList |
| 93 | </ul><p> |
| 94 | |
Chris Lattner | 2f8cb57 | 2003-01-20 18:05:27 +0000 | [diff] [blame] | 95 | <h2>Changes to Warnings:</h2> |
| 96 | <ul> |
| 97 | <li>Warnings Added: $WarningsAdded |
| 98 | <li>Warnings Removed: $WarningsRemoved |
| 99 | </ul><p> |
| 100 | |
Chris Lattner | 4c7e303 | 2003-01-20 06:11:03 +0000 | [diff] [blame] | 101 | <h2>Changes in the test suite:</h2> |
| 102 | <ul> |
Chris Lattner | d9bdbaa | 2003-01-22 20:35:59 +0000 | [diff] [blame] | 103 | <li>New Tests: $TestsAdded |
| 104 | <li>Removed Tests: $TestsRemoved |
| 105 | <li>Newly passing tests: $TestsFixed |
| 106 | <li>Newly failing tests: $TestsBroken |
Chris Lattner | 4c7e303 | 2003-01-20 06:11:03 +0000 | [diff] [blame] | 107 | </ul> |
| 108 | |
| 109 | <br><br><center> |
| 110 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
| 111 | <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" |
| 112 | <font size=+2 face=Verdana><b><a name="Trends">Changes over Time</font></b> |
| 113 | </td></tr></table></td></tr></table></center><p> |
| 114 | |
| 115 | GNUplot <b>charts</b> showing a couple of things: |
| 116 | <ol> |
Chris Lattner | 4c7e303 | 2003-01-20 06:11:03 +0000 | [diff] [blame] | 117 | <li>Compile Time |
| 118 | <li>Testing Time |
| 119 | <li>Time to run some programs, say all of Olden |
| 120 | <li>Time to compile something, say Olden. |
| 121 | <li>Size of bytecode files for Olden |
| 122 | </ol> |
| 123 | |
| 124 | <br><br><center> |
| 125 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
| 126 | <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" |
| 127 | <font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b> |
| 128 | </td></tr></table></td></tr></table></center><p> |
| 129 | |
Chris Lattner | 8a4baf4 | 2003-01-22 16:13:10 +0000 | [diff] [blame] | 130 | This section tests LLVM on a variety of programs in the test suite. This |
Misha Brukman | 0137afa | 2003-08-15 19:31:04 +0000 | [diff] [blame] | 131 | includes benchmark suites like the Olden, McCat, Ptrdist, and SPEC benchmarks as |
| 132 | well as a few random programs with test inputs. This section is meant to track |
| 133 | how stable LLVM is as a whole. A failure in the execution of any test is marked |
| 134 | with an asterisk: `*'. The columns of the tables are:<p> |
Chris Lattner | 8a4baf4 | 2003-01-22 16:13:10 +0000 | [diff] [blame] | 135 | |
| 136 | <ol> |
Misha Brukman | 0137afa | 2003-08-15 19:31:04 +0000 | [diff] [blame] | 137 | <li><a name="Program">Program</a> - The name of the program for that row.</li> |
| 138 | <li><a name="GCCAS">GCCAS</a> - Time to run LLVM optimizers on the program.</li> |
| 139 | <li><a name="Bytecode">Bytecode</a> - The size of the bytecode for the |
| 140 | program</li> |
| 141 | <li><a name="Instrs">Instrs</a> - The number of LLVM instructions in the |
| 142 | compiled bytecode</li> |
| 143 | <li><a name="LLC<br>compile">LLC compile</a> - The time taken compile with |
| 144 | LLC (the static backend)</li> |
| 145 | <li><a name="JIT<br>codegen">JIT codegen</a> - The amount of time spent in the |
| 146 | JIT itself, instead of executing the program.</li> |
| 147 | <li><a name="Machine<br>code">Machine code</a> - The number of bytes of machine |
| 148 | code generated by the JIT.</li> |
| 149 | <li><a name="GCC">GCC</a> - The time taken to execute the program when compiled |
Chris Lattner | b1adab7 | 2003-08-18 04:32:34 +0000 | [diff] [blame] | 150 | with GCC -O2.</li> |
Misha Brukman | 0137afa | 2003-08-15 19:31:04 +0000 | [diff] [blame] | 151 | <li><a name="CBE">CBE</a> - The time taken to execute the program after |
Chris Lattner | e928d7d | 2003-08-18 04:39:41 +0000 | [diff] [blame] | 152 | compilation through the C backend, compiled with -O2.</li> |
Misha Brukman | 0137afa | 2003-08-15 19:31:04 +0000 | [diff] [blame] | 153 | <li><a name="LLC">LLC</a> - How long does the program generated by the static |
| 154 | backend LLC take to execute </li> |
| 155 | <li><a name="JIT">JIT</a> - The amount of time spent running the |
| 156 | program with the JIT; this includes the code generation phase (listed above) |
| 157 | and actually running the program.</li> |
Chris Lattner | b1adab7 | 2003-08-18 04:32:34 +0000 | [diff] [blame] | 158 | <li><a name="GCC/LLC">GCC/LLC - The speed-up of the LLC output vs the native |
| 159 | GCC output: greater than 1 is a speedup, less than 1 is a slowdown. |
Chris Lattner | 7b44755 | 2003-09-17 22:02:49 +0000 | [diff] [blame] | 160 | <li><a name="GCC/CBE">GCC/CBE - The speed-up of the CBE output vs the native |
| 161 | GCC output: greater than 1 is a speedup, less than 1 is a slowdown. |
Chris Lattner | 8a4baf4 | 2003-01-22 16:13:10 +0000 | [diff] [blame] | 162 | </ol><p> |
| 163 | |
Misha Brukman | efe8474 | 2003-08-19 15:54:16 +0000 | [diff] [blame] | 164 | A complete log of testing |
Chris Lattner | eac3cdc | 2003-08-21 15:55:26 +0000 | [diff] [blame] | 165 | <a href="$DATE-SingleSource-ProgramTest.txt.gz">SingleSource</a>, |
| 166 | <a href="$DATE-MultiSource-ProgramTest.txt.gz">MultiSource</a>, and |
| 167 | <a href="$DATE-External-ProgramTest.txt.gz">External</a> programs are |
Misha Brukman | efe8474 | 2003-08-19 15:54:16 +0000 | [diff] [blame] | 168 | available</a> for further analysis. |
Chris Lattner | 8a4baf4 | 2003-01-22 16:13:10 +0000 | [diff] [blame] | 169 | |
Chris Lattner | eac3cdc | 2003-08-21 15:55:26 +0000 | [diff] [blame] | 170 | <h2>Programs/External</h2> |
| 171 | |
| 172 | <center> |
| 173 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
| 174 | $ExternalProgramsTable |
| 175 | </td></tr></table></center> |
| 176 | |
Chris Lattner | 8a4baf4 | 2003-01-22 16:13:10 +0000 | [diff] [blame] | 177 | <h2>Programs/MultiSource</h2> |
| 178 | |
| 179 | <center> |
| 180 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
Chris Lattner | bf6a4dc | 2003-08-18 06:05:21 +0000 | [diff] [blame] | 181 | $MultiSourceProgramsTable |
Chris Lattner | 8a4baf4 | 2003-01-22 16:13:10 +0000 | [diff] [blame] | 182 | </td></tr></table></center> |
| 183 | |
| 184 | <h2>Programs/SingleSource</h2> |
| 185 | |
Chris Lattner | bf6a4dc | 2003-08-18 06:05:21 +0000 | [diff] [blame] | 186 | <center> |
| 187 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
| 188 | $SingleSourceProgramsTable |
| 189 | </td></tr></table></center> |
| 190 | |
Chris Lattner | 8a4baf4 | 2003-01-22 16:13:10 +0000 | [diff] [blame] | 191 | |
Chris Lattner | 4c7e303 | 2003-01-20 06:11:03 +0000 | [diff] [blame] | 192 | |
| 193 | <br><br><center> |
| 194 | <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |
| 195 | <table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77" |
| 196 | <font size=+2 face=Verdana><b><a name="Regression">Regression Tests</font></b> |
| 197 | </td></tr></table></td></tr></table></center><p> |
| 198 | |
| 199 | Not yet implemented<p> |
| 200 | |
| 201 | </td></tr> |
| 202 | |
| 203 | </html> |