blob: 1c54f63462a07c5248844b9bc93f0da0840a7c84 [file] [log] [blame]
Steve Blocka7e24c12009-10-30 11:49:00 +00001<html>
2<head>
3<title>V8 Benchmark Suite Revisions</title>
4<link type="text/css" rel="stylesheet" href="style.css" />
5</head>
6<body>
7<div>
8 <div class="title"><h1>V8 Benchmark Suite Revisions</h1></div>
9 <table>
10 <tr>
11 <td class="contents">
12
13<p>
14
15The V8 benchmark suite is changed from time to time as we fix bugs or
16expand the scope of the benchmarks. Here is a list of revisions, with
17a description of the changes made. Note that benchmark results are
18not comparable unless both results are run with the same revision of
19the benchmark suite.
20
21</p>
22
Kristian Monsen25f61362010-05-21 11:50:48 +010023<div class="subtitle"><h3>Version 6 (<a href="http://v8.googlecode.com/svn/data/benchmarks/v6/run.html">link</a>)</h3></div>
24
Steve Block8defd9f2010-07-08 12:39:36 +010025<p>Removed dead code from the RayTrace benchmark and fixed a couple of
26typos in the DeltaBlue implementation. Changed the Splay benchmark to
27avoid converting the same numeric key to a string over and over again
28and to avoid inserting and removing the same element repeatedly thus
29increasing pressure on the memory subsystem.</p>
30
31<p>Furthermore, the benchmark runner was changed to run the benchmarks
32for at least a few times to stabilize the reported numbers on slower
33machines.</p>
Kristian Monsen25f61362010-05-21 11:50:48 +010034
Steve Blocka7e24c12009-10-30 11:49:00 +000035<div class="subtitle"><h3>Version 5 (<a href="http://v8.googlecode.com/svn/data/benchmarks/v5/run.html">link</a>)</h3></div>
36
37<p>Removed duplicate line in random seed code, and changed the name of
38the Object.prototype.inherits function in the DeltaBlue benchmark to
39inheritsFrom to avoid name clashes when running in Chromium with
40extensions enabled.
41</p>
42
43<div class="subtitle"><h3>Version 4 (<a href="http://v8.googlecode.com/svn/data/benchmarks/v4/run.html">link</a>)</h3></div>
44
45<p>The <i>Splay</i> benchmark is a newcomer in version 4. It
46manipulates a splay tree by adding and removing data nodes, thus
47exercising the memory management subsystem of the JavaScript engine.
48</p>
49
50<p>
51Furthermore, all the unused parts of the Prototype library were
52removed from the RayTrace benchmark. This does not affect the running
53of the benchmark.
54</p>
55
56
57<div class="subtitle"><h3>Version 3 (<a href="http://v8.googlecode.com/svn/data/benchmarks/v3/run.html">link</a>)</h3></div>
58
59<p>Version 3 adds a new benchmark, <i>RegExp</i>. The RegExp
60benchmark is generated by loading 50 of the most popular pages on the
61web and logging all regexp operations performed. Each operation is
62given a weight that is calculated from an estimate of the popularity
63of the pages where it occurs and the number of times it is executed
64while loading each page. Finally the literal letters in the data are
65encoded using ROT13 in a way that does not affect how the regexps
66match their input.
67</p>
68
69
70<div class="subtitle"><h3>Version 2 (<a href="http://v8.googlecode.com/svn/data/benchmarks/v2/run.html">link</a>)</h3></div>
71
72<p>For version 2 the Crypto benchmark was fixed. Previously, the
73decryption stage was given plaintext as input, which resulted in an
74error. Now, the decryption stage is given the output of the
75encryption stage as input. The result is checked against the original
76plaintext. For this to give the correct results the crypto objects
77are reset for each iteration of the benchmark. In addition, the size
78of the plain text has been increased a little and the use of
79Math.random() and new Date() to build an RNG pool has been
80removed. </p>
81
82<p>Other benchmarks were fixed to do elementary verification of the
83results of their calculations. This is to avoid accidentally
84obtaining scores that are the result of an incorrect JavaScript engine
85optimization.</p>
86
87
88<div class="subtitle"><h3>Version 1 (<a href="http://v8.googlecode.com/svn/data/benchmarks/v1/run.html">link</a>)</h3></div>
89
90<p>Initial release.</p>
91
92</td><td style="text-align: center">
93</td></tr></table>
94
95</div>
96
97</body>
98</html>