Copy Page

You are not logged in. Any changes you make will be marked as anonymous. You may want to Log In if you already have an account. You can also Sign Up for a new account.

<h3>The need for performance metrics and comparison</h3>

Since we released AspectWerkz 1.0, and more generally for every release of any AOP / interceptor framework (AspectWerkz, AspectJ, JBoss AOP, Spring AOP, cglib, dynaop etc), a question is always raised: &quot;what is the performance cost of such an approach?&quot;, &quot;how much do I loose per method invocation when an advice / interceptor is applied?&quot;.

This is indeed an issue that needs to be carefully addressed, and that in fact has affected the design of every mature enough framework.

We are probably all scared by the cost of the java.lang.reflect despite its relative power, and usually, even before starting to evaluate semantics robustness and ease of use in general - we start doing some Hello World bench.

We have started AWbench for that purpose. Offering a single place to measure the relative performance of AOP/Interceptor frameworks, and measure it by your own.

More than providing performance comparison, AWbench is a good place to figure out the semantic differences and ease of use of each framework by using them for the same rather simple purpose. A &quot;line of count&quot; metrics will be provided in a next report.

<h3>Current performance results</h3>

This table provides the figures from a bench in &quot;nanosecond per advised method invocation&quot;. A single method invocation is roughly about 5 ns/iteration on the bench hardware/software that was used. Note that an advised application will have more behavior than just a non advised method so you should not compare non advised version to advised version. AWbench does not provide yet metrics for a hand written implementation of the AOP concepts.

The results were obtained with 2 million iterations.

In this table, the two first lines in bold are the most important ones. In a real world application, it is likely that the before or around advice will interact with the code it is advising and to be able to do that it needs to access runtime information (contextual information) like method parameters values and target instance. It is also likely that the join point is advised by more than one advice.

On the opposite it is very unlikely to have just a before advice that does nothing, but it gives us a good evaluation on the most minimal overhead we can expect.

Note: comparing such results when the difference is small (f.e. 15 ns vs 10 ns) might not be relevant. Before doing so you should run the bench several time and compute an average after removing the smallest and highest measurements.
 
<table class="confluenceTable"><tbody>
<tr>
<th class="confluenceTh">AWBench (ns/invocation)</th>
<th class="confluenceTh">aspectwerkz</th>
<th class="confluenceTh">awproxy</th>
<th class="confluenceTh">aspectwerkz_1_0</th>
<th class="confluenceTh">aspectj</th>
<th class="confluenceTh">jboss</th>
<th class="confluenceTh">spring</th>
<th class="confluenceTh">dynaop</th>
<th class="confluenceTh">cglib</th>
<th class="confluenceTh">ext:aopalliance</th>
<th class="confluenceTh">ext:spring</th>
<th class="confluenceTh">ext:aspectj</th>
</tr>
<tr>
<td class="confluenceTd">before, args() target()</td>
<td class="confluenceTd">10</td>
<td class="confluenceTd">25</td>
<td class="confluenceTd">606</td>
<td class="confluenceTd">10</td>
<td class="confluenceTd">220</td>
<td class="confluenceTd">355</td>
<td class="confluenceTd">390</td>
<td class="confluenceTd">145</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">220</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">around x 2, args() target()</td>
<td class="confluenceTd">80</td>
<td class="confluenceTd">85</td>
<td class="confluenceTd">651</td>
<td class="confluenceTd">50</td>
<td class="confluenceTd">290</td>
<td class="confluenceTd">436</td>
<td class="confluenceTd">455</td>
<td class="confluenceTd">155</td>
<td class="confluenceTd">465</td>
<td class="confluenceTd">476</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">before</td>
<td class="confluenceTd">15</td>
<td class="confluenceTd">20</td>
<td class="confluenceTd">520</td>
<td class="confluenceTd">15</td>
<td class="confluenceTd">145</td>
<td class="confluenceTd">275</td>
<td class="confluenceTd">320</td>
<td class="confluenceTd">70</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">40</td>
<td class="confluenceTd">10</td>
</tr>
<tr>
<td class="confluenceTd">before, static info access</td>
<td class="confluenceTd">30</td>
<td class="confluenceTd">30</td>
<td class="confluenceTd">501</td>
<td class="confluenceTd">25</td>
<td class="confluenceTd">175</td>
<td class="confluenceTd">275</td>
<td class="confluenceTd">330</td>
<td class="confluenceTd">70</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">35</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">before, rtti info access</td>
<td class="confluenceTd">50</td>
<td class="confluenceTd">55</td>
<td class="confluenceTd">535</td>
<td class="confluenceTd">50</td>
<td class="confluenceTd">175</td>
<td class="confluenceTd">275</td>
<td class="confluenceTd">335</td>
<td class="confluenceTd">75</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">35</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">after returning</td>
<td class="confluenceTd">10</td>
<td class="confluenceTd">20</td>
<td class="confluenceTd">541</td>
<td class="confluenceTd">10</td>
<td class="confluenceTd">135</td>
<td class="confluenceTd">285</td>
<td class="confluenceTd">315</td>
<td class="confluenceTd">85</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">45</td>
<td class="confluenceTd">15</td>
</tr>
<tr>
<td class="confluenceTd">after throwing</td>
<td class="confluenceTd">3540</td>
<td class="confluenceTd">3870</td>
<td class="confluenceTd">6103</td>
<td class="confluenceTd">3009</td>
<td class="confluenceTd">5032</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">6709</td>
<td class="confluenceTd">8127</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">3460</td>
</tr>
<tr>
<td class="confluenceTd">before + after</td>
<td class="confluenceTd">20</td>
<td class="confluenceTd">30</td>
<td class="confluenceTd">511</td>
<td class="confluenceTd">20</td>
<td class="confluenceTd">160</td>
<td class="confluenceTd">445</td>
<td class="confluenceTd">345</td>
<td class="confluenceTd">80</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">35</td>
<td class="confluenceTd">20</td>
</tr>
<tr>
<td class="confluenceTd">before, args() primitives</td>
<td class="confluenceTd">10</td>
<td class="confluenceTd">20</td>
<td class="confluenceTd">555</td>
<td class="confluenceTd">10</td>
<td class="confluenceTd">195</td>
<td class="confluenceTd">350</td>
<td class="confluenceTd">375</td>
<td class="confluenceTd">145</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">210</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">before, args() objects</td>
<td class="confluenceTd">5</td>
<td class="confluenceTd">25</td>
<td class="confluenceTd">546</td>
<td class="confluenceTd">10</td>
<td class="confluenceTd">185</td>
<td class="confluenceTd">325</td>
<td class="confluenceTd">345</td>
<td class="confluenceTd">115</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">200</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">around</td>
<td class="confluenceTd">60</td>
<td class="confluenceTd">95</td>
<td class="confluenceTd">470</td>
<td class="confluenceTd">10</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">225</td>
<td class="confluenceTd">315</td>
<td class="confluenceTd">75</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">90</td>
</tr>
<tr>
<td class="confluenceTd">around, rtti info access</td>
<td class="confluenceTd">70</td>
<td class="confluenceTd">70</td>
<td class="confluenceTd">520</td>
<td class="confluenceTd">50</td>
<td class="confluenceTd">140</td>
<td class="confluenceTd">250</td>
<td class="confluenceTd">340</td>
<td class="confluenceTd">80</td>
<td class="confluenceTd">70</td>
<td class="confluenceTd">70</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">around, static info access</td>
<td class="confluenceTd">80</td>
<td class="confluenceTd">90</td>
<td class="confluenceTd">486</td>
<td class="confluenceTd">25</td>
<td class="confluenceTd">135</td>
<td class="confluenceTd">245</td>
<td class="confluenceTd">330</td>
<td class="confluenceTd">75</td>
<td class="confluenceTd">80</td>
<td class="confluenceTd">80</td>
<td class="confluenceTd">-</td>
</tr>
</tbody></table>

This table provides the figures from the same bench where for each category AspectWerkz 2.0.RC2-snapshot is the reference. 
The first line illustrates that for the most simple before advice, AspectWerkz is 13 times faster than JBoss AOP 1.0.

<table class="confluenceTable"><tbody>
<tr>
<th class="confluenceTh">AWBench (relative %)</th>
<th class="confluenceTh">aspectwerkz</th>
<th class="confluenceTh">awproxy</th>
<th class="confluenceTh">aspectwerkz_1_0</th>
<th class="confluenceTh">aspectj</th>
<th class="confluenceTh">jboss</th>
<th class="confluenceTh">spring</th>
<th class="confluenceTh">dynaop</th>
<th class="confluenceTh">cglib</th>
<th class="confluenceTh">ext:aopalliance</th>
<th class="confluenceTh">ext:spring</th>
<th class="confluenceTh">ext:aspectj</th>
</tr>
<tr>
<td class="confluenceTd">before, args() target()</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">2.5 x</td>
<td class="confluenceTd">60.6 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">22 x</td>
<td class="confluenceTd">35.5 x</td>
<td class="confluenceTd">39 x</td>
<td class="confluenceTd">14.5 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">22 x</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">around x 2, args() target()</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">8.1 x</td>
<td class="confluenceTd">0.6 x</td>
<td class="confluenceTd">3.6 x</td>
<td class="confluenceTd">5.4 x</td>
<td class="confluenceTd">5.6 x</td>
<td class="confluenceTd">1.9 x</td>
<td class="confluenceTd">5.8 x</td>
<td class="confluenceTd">5.9 x</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">before</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1.3 x</td>
<td class="confluenceTd">34.6 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">9.6 x</td>
<td class="confluenceTd">18.3 x</td>
<td class="confluenceTd">21.3 x</td>
<td class="confluenceTd">4.6 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">2.6 x</td>
<td class="confluenceTd">0.6 x</td>
</tr>
<tr>
<td class="confluenceTd">before, static info access</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">16.7 x</td>
<td class="confluenceTd">0.8 x</td>
<td class="confluenceTd">5.8 x</td>
<td class="confluenceTd">9.1 x</td>
<td class="confluenceTd">11 x</td>
<td class="confluenceTd">2.3 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">1.1 x</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">before, rtti info access</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1.1 x</td>
<td class="confluenceTd">10.7 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">3.5 x</td>
<td class="confluenceTd">5.5 x</td>
<td class="confluenceTd">6.7 x</td>
<td class="confluenceTd">1.5 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">0.7 x</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">after returning</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">2 x</td>
<td class="confluenceTd">54.1 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">13.5 x</td>
<td class="confluenceTd">28.5 x</td>
<td class="confluenceTd">31.5 x</td>
<td class="confluenceTd">8.5 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">4.5 x</td>
<td class="confluenceTd">1.5 x</td>
</tr>
<tr>
<td class="confluenceTd">after throwing</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1.7 x</td>
<td class="confluenceTd">0.8 x</td>
<td class="confluenceTd">1.4 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">1.8 x</td>
<td class="confluenceTd">2.2 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">0.9 x</td>
</tr>
<tr>
<td class="confluenceTd">before + after</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1.5 x</td>
<td class="confluenceTd">25.5 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">8 x</td>
<td class="confluenceTd">22.2 x</td>
<td class="confluenceTd">17.2 x</td>
<td class="confluenceTd">4 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">1.7 x</td>
<td class="confluenceTd">1 x</td>
</tr>
<tr>
<td class="confluenceTd">before, args() primitives</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">2 x</td>
<td class="confluenceTd">55.5 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">19.5 x</td>
<td class="confluenceTd">35 x</td>
<td class="confluenceTd">37.5 x</td>
<td class="confluenceTd">14.5 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">21 x</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">before, args() objects</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">5 x</td>
<td class="confluenceTd">109.2 x</td>
<td class="confluenceTd">2 x</td>
<td class="confluenceTd">37 x</td>
<td class="confluenceTd">65 x</td>
<td class="confluenceTd">69 x</td>
<td class="confluenceTd">23 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">40 x</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">around</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1.5 x</td>
<td class="confluenceTd">7.8 x</td>
<td class="confluenceTd">0.1 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">3.7 x</td>
<td class="confluenceTd">5.2 x</td>
<td class="confluenceTd">1.2 x</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">-</td>
<td class="confluenceTd">1.5 x</td>
</tr>
<tr>
<td class="confluenceTd">around, rtti info access</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">7.4 x</td>
<td class="confluenceTd">0.7 x</td>
<td class="confluenceTd">2 x</td>
<td class="confluenceTd">3.5 x</td>
<td class="confluenceTd">4.8 x</td>
<td class="confluenceTd">1.1 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">-</td>
</tr>
<tr>
<td class="confluenceTd">around, static info access</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1.1 x</td>
<td class="confluenceTd">6 x</td>
<td class="confluenceTd">0.3 x</td>
<td class="confluenceTd">1.6 x</td>
<td class="confluenceTd">3 x</td>
<td class="confluenceTd">4.1 x</td>
<td class="confluenceTd">0.9 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">1 x</td>
<td class="confluenceTd">-</td>
</tr>
</tbody></table>

Bench were run on a Java HotSpot 1.4.2, Windows 2000 SP4, Pentium M 1.6 GHz, 1 Go RAM.

Notes:
<ul>
	<li>Some figures are not available when the underlying framework does not allow the feature. For the ext: ones, that can be due to pending work (AOP alliance interfaces can emulate a before advice just as it is the case in JBoss AOP).</li>
	<li>after throwing advice appears to be slow since it first, is an overhead in throwing the exception (user code) and second, in catching the exception and do an instanceof to check the exception type (advice code).</li>
	<li>latest run: Dec 20, 2004, as per Spring Framework team feedback.</li>
</ul>

<h3>AWbench internals</h3>
<h4>Summary</h4>

AWbench is a micro benchmark suite, which aims at staying simple. The test application is very simple, and AWbench is mainly the glue around the test application that applies one or more very simple advice / interceptor of the framework of your choice.

AWbench comes with an Ant script that allows you to run it on you own box, and provide some improvement if you know some for a particular framework.

<h4>What is the scope for the benchmark?</h4>

So far, AWbench includes method execution pointcuts, since call side pointcuts are not supported by proxy based framework (Spring AOP, cglib, dynaop etc).

The awbench.method.Execution class is the test application, and contains one method per construct to bench. An important fact is that bytecode based AOP may provide much better performance for before advice and after advice, as well as much better performance when it comes to accessing contextual information. 
Indeed, proxy based frameworks are very likely to use reflection to give the user access to intercepted method parameters at runtime from within an advice, while bytecode based AOP may use more advanced constructs to provide access at the speed of a statically compiled access.

The current scope is thus:

For method execution pointcut
<table class="confluenceTable"><tbody>
<tr>
<th class="confluenceTh">Construct </th>
<th class="confluenceTh"> Contextual information access </th>
<th class="confluenceTh"> Notes </th>
</tr>
<tr>
<td class="confluenceTd"> </td>
<td class="confluenceTd"> </td>
<td class="confluenceTd"> </td>
</tr>
<tr>
<td class="confluenceTd">before advice </td>
<td class="confluenceTd"> none </td>
<td class="confluenceTd"> </td>
</tr>
<tr>
<td class="confluenceTd">before advice </td>
<td class="confluenceTd"> static information (method signature etc) </td>
<td class="confluenceTd"> </td>
</tr>
<tr>
<td class="confluenceTd">before advice </td>
<td class="confluenceTd"> contextual information accessed reflectively </td>
<td class="confluenceTd"> Likely to use of casting and unboxing of primitives </td>
</tr>
<tr>
<td class="confluenceTd">before advice </td>
<td class="confluenceTd"> contextual information accessed with explicit framework capabilities </td>
<td class="confluenceTd"> Only supported by AspectJ and AspectWerkz 2.x</td>
</tr>
<tr>
<th class="confluenceTh"> </th>
<th class="confluenceTh"> </th>
<th class="confluenceTh"> </th>
</tr>
<tr>
<td class="confluenceTd">after advice </td>
<td class="confluenceTd"> none </td>
<td class="confluenceTd"> </td>
</tr>
<tr>
<td class="confluenceTd">after returning advice </td>
<td class="confluenceTd"> return value </td>
<td class="confluenceTd"> </td>
</tr>
<tr>
<td class="confluenceTd">after throwing advice </td>
<td class="confluenceTd"> exception instance </td>
<td class="confluenceTd"> </td>
</tr>
<tr>
<th class="confluenceTh"> </th>
<th class="confluenceTh"> </th>
<th class="confluenceTh"> </th>
</tr>
<tr>
<td class="confluenceTd"> before + after advice </td>
<td class="confluenceTd"> none </td>
<td class="confluenceTd"> </td>
</tr>
<tr>
<th class="confluenceTh"> </th>
<th class="confluenceTh"> </th>
<th class="confluenceTh"> </th>
</tr>
<tr>
<td class="confluenceTd"> around advice </td>
<td class="confluenceTd"> optimized </td>
<td class="confluenceTd"> AspectJ and AspetWerkz 2.x provides specific optimizations (thisJoinPointStaticPart vs thisJoinPoint) </td>
</tr>
<tr>
<td class="confluenceTd"> around advice </td>
<td class="confluenceTd"> non optimizezd </td>
<td class="confluenceTd"> </td>
</tr>
<tr>
<th class="confluenceTh"> </th>
<th class="confluenceTh"> </th>
<th class="confluenceTh"> </th>
</tr>
<tr>
<td class="confluenceTd"> 2 around advice </td>
<td class="confluenceTd"> contextual information </td>
<td class="confluenceTd"> </td>
</tr>
</tbody></table>

By accessing contextual information we means:
<ul>
	<li>accessing a method parameter using its real type (i.e. boxing and unboxing might be needed)</li>
	<li>accessing a the advised instance using its real type (i.e. casting might be needed)</li>
</ul>

A pseudo code block is thus likely to be:
<table class="wysiwyg-macro" data-macro-name="code" data-macro-default-parameter="java" style="background-image: url(/plugins/servlet/confluence/placeholder/macro-heading?definition=e2NvZGU6amF2YX0&amp;locale=en_GB&amp;version=2); background-repeat: no-repeat;" data-macro-body-type="PLAIN_TEXT"><tr><td class="wysiwyg-macro-body"><pre>
class awbench.method.Execution {

int m_field;

void before(int i) {
    // very simple test application method body - does not vary
    m_field++;
  }
}

class XXframework {

// might be optimized by some framework using lazy instantiation
  .. interceptWithoutContextualInformationAccess(..) {
    // very simple advice body - does not vary
    awbench.Run.staticIntField++;
  }

.. interceptWithReflectiveContextualInformationAccess(.., XXInvocation invocation, ..) {
    // very simple advice body - does not vary
    awbench.Run.staticIntField++;
    // reflective access to target instance and intercepted method argument
    Execution target = (Execution) invocation.getTarget();
    int arg0 = (int) (Integer(invocation.getArgument_0())).intValue();
  }

// may not be supported by all framework
 .. interceptWithDirectContextualInformationAccess(.., Execution executionTargetInstance, int arg0Intercepted, ..) {
 // very simple advice body - does not vary
 awbench.Run.staticIntField++;
 // direct access to target instance and intercepted method argument thru rich framework facilities
 Execution target = executionTargetInstance; // no casting
 int arg0 = arg0Intercepted; // no casting
 }
}
</pre></td></tr></table>

<h4>Which AOP and Proxy frameworks are benched?</h4>

The following are included in AWbench:

Bytecode based frameworks
<table class="confluenceTable"><tbody>
<tr>
<th class="confluenceTh">Framework </th>
<th class="confluenceTh"> URL </th>
</tr>
<tr>
<td class="confluenceTd"> AspectWerkz 1.0 </td>
<td class="confluenceTd"> <a class="external-link" href="http://aspectwerkz.codehaus.org" rel="nofollow">http://aspectwerkz.codehaus.org</a> </td>
</tr>
<tr>
<td class="confluenceTd"> AspectWerkz 2.x </td>
<td class="confluenceTd"> <a class="external-link" href="http://aspectwerkz.codehaus.org" rel="nofollow">http://aspectwerkz.codehaus.org</a> </td>
</tr>
<tr>
<td class="confluenceTd"> AspectJ (1.2) </td>
<td class="confluenceTd"> <a class="external-link" href="http://eclipse.org/aspectj/" rel="nofollow">http://eclipse.org/aspectj/</a> </td>
</tr>
<tr>
<td class="confluenceTd"> JBoss AOP (1.0) </td>
<td class="confluenceTd"> <a class="external-link" href="http://www.jboss.org/developers/projects/jboss/aop" rel="nofollow">http://www.jboss.org/developers/projects/jboss/aop</a> </td>
</tr>
</tbody></table>

Proxy based frameworks
<table class="confluenceTable"><tbody>
<tr>
<th class="confluenceTh">Framework </th>
<th class="confluenceTh"> URL </th>
</tr>
<tr>
<td class="confluenceTd"> Spring AOP (1.1.1) </td>
<td class="confluenceTd"> <a class="external-link" href="http://www.springframework.org/" rel="nofollow">http://www.springframework.org/</a> </td>
</tr>
<tr>
<td class="confluenceTd"> cglib proxy (2.0.2) </td>
<td class="confluenceTd"> <a class="external-link" href="http://cglib.sourceforge.net/" rel="nofollow">http://cglib.sourceforge.net/</a> </td>
</tr>
<tr>
<td class="confluenceTd"> dynaop (1.0 beta) </td>
<td class="confluenceTd"> <a class="external-link" href="https://dynaop.dev.java.net/" rel="nofollow">https://dynaop.dev.java.net/</a> </td>
</tr>
</tbody></table>

Moreover, AWbench includes AspectWerkz Extensible Aspect Container that allow to run any Aspect / Interceptor framework within the AspectWerkz 2.x runtime:
<table class="confluenceTable"><tbody>
<tr>
<th class="confluenceTh"> AspectWerkz Extensible Aspect Container running </th>
<th class="confluenceTh"> Notes</th>
</tr>
<tr>
<td class="confluenceTd"> AspectJ </td>
<td class="confluenceTd"> </td>
</tr>
<tr>
<td class="confluenceTd"> AOP Alliance </td>
<td class="confluenceTd"> <a class="external-link" href="http://aopalliance.sourceforge.net/" rel="nofollow">http://aopalliance.sourceforge.net/</a> </td>
</tr>
<tr>
<td class="confluenceTd"> Spring AOP </td>
<td class="confluenceTd"> </td>
</tr>
</tbody></table>

AWbench is extensible. Refer to the How to contribute? section (below) for more info on how to add your framework to the bench.

<h4>Running awbench by your own</h4>

AWBench is released under LGPL. 
There will never be a distribution of it, but source can be checked out:
<table class="wysiwyg-macro" data-macro-name="code" data-macro-default-parameter="java" style="background-image: url(/plugins/servlet/confluence/placeholder/macro-heading?definition=e2NvZGU6amF2YX0&amp;locale=en_GB&amp;version=2); background-repeat: no-repeat;" data-macro-body-type="PLAIN_TEXT"><tr><td class="wysiwyg-macro-body"><pre>
cvs -d :pserver:anonymous@cvs.aspectwerkz.codehaus.org:/home/projects/aspectwerkz/scm login

cvs -z3 -d :pserver:anonymous@cvs.aspectwerkz.codehaus.org:/home/projects/aspectwerkz/scm co awbench
</pre></td></tr></table>

Once checked out, you can run the bench using several different Ant target
<table class="wysiwyg-macro" data-macro-name="code" data-macro-default-parameter="java" style="background-image: url(/plugins/servlet/confluence/placeholder/macro-heading?definition=e2NvZGU6amF2YX0&amp;locale=en_GB&amp;version=2); background-repeat: no-repeat;" data-macro-body-type="PLAIN_TEXT"><tr><td class="wysiwyg-macro-body"><pre>
ant run

ant run:aspectwerkz
ant run:aspectj
ant run:jboss

ant run:ext:aspectj
ant run:ext:spring
ant run:ext:aopalliance

ant run:cglib
ant run:spring
ant run:dynaop

ant run:all
</pre></td></tr></table>

<h4>How to contribute?</h4>

If you notice some optimizations for one of the implementation by respecting the requirements, we will add the fix in awbench and update the results accordingly.

If you are willing to write a non-AOP, non-Proxy based version of this bench so that a comparison between AOP approach and regular OO design patterns is possible send us an email.

<h4>Limitations</h4>

The current implementation is not covering fine grained deployment models like perInstance / perTarget, whose underlying implementation are unlikely to be neutral on performance results.