You are viewing an old version of this page. View the current version.
Compare with Current ·
View Page History
There are many Continuous Integration systems available. This page is an attempt to keep an unbiased comparison of as many as possible of them. The goals are:
- Make it easier to choose an appropriate CI tool for your project.
- "Healthy competition aid" for the people involved in the development of these various CI systems.
Note: In order to be as neutral as possible, it would be favourable if this page was hosted somewhere else, in a publicly available place. Let us know if you have any suggestions regarding this.
Note: If you want a new feature in one of these, please use the respective project's issue trackers. Don't add feature requests here.
Note: If you want to update this page (maybe you are a developer of one of these), just sign up as a user in this Confluence and select the edit link at the bottom of this page. Email me (aslak dot hellesoy at google's mail) if you have any questions.
Legend:
The feature exists
The feature exists, but is buggy or not well tested
The feature is planned for the near future
The feature doesn't exist
|
||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Project info |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Project origin |
|
|
|
|
||||||||||||||
Open Source |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Implementation language |
Java |
C# |
C# |
Perl |
Python |
Java |
Java |
Java |
Java |
Java |
Java |
C# |
Java |
C# |
Java |
Perl |
Java |
Java |
Free |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Issue tracker |
|
private |
|
|
|
|
||||||||||||
Online demo |
|
|
|
|
|
coming soon |
||||||||||||
Number of active developers |
5 |
2 |
5 |
|
1 |
|
|
|
|
3 |
|
|
4 |
1 |
|
|
2 |
5~7 |
SCM support |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AccuRev |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
AlienBrain |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Bazaar |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
BitKeeper |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
ClearCase |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
CA Harvest |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
CM Synergy |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
CVS |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Dimensions |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
"File system SCM" |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
HTTP file |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
MKS |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Perforce (p4) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
PVCS |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
SourceGear Vault |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
StarTeam |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Subversion |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Surround |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Team Foundation Server |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
VSS |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
VSS Journal |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
SCM related support |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
Can create new SCM repositories |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Build management |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Parallel builds (ability to build several projects simultaneously) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Distributed builds |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Agents' code auto-updated |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Manually force builds |
|
|
|
|
|
|
|
|
|
|
|
|
|
Not needed |
|
|
|
|
SCM trigged builds |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
SCM poll based builds |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Temporal build scheduling |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Builds promotion |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Interproject Dependencies |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Builds deletion |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Reproduce history builds |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Proactive (can prevent build breakages) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Detect new failing tests while build |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Notify when first test in build fails |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Security |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
User authentication |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
User authorization schemes |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
LDAP Integration |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Kerebos |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Single Sign On |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Custom JAAS |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
RSA SecureID |
? |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
? |
|
|
Publishing |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Confluence |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Run executable |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
FTP |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
IRC |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Jabber |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Lotus Sametime |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
NetSend |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
ProjectStart |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
RSS |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
SCP |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Windows System Tray |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Formatted Logging |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Yahoo Messenger |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
MSN Messenger |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
X10 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Web interface |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
View changesets |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
Add new projects |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Clone projects |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Delete projects |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Modify projects |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Kill builds |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Pause builds |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Access to build artifacts |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Browse CI's working copy |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Delete CI's working copy |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Search in builds |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Historic graphs |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Self-updating web page |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Multi project support |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Multi project view |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Add/remove agent machines (for distributed builds) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Directly supported build tools |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Shell / command script |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Ant |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Groovy |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
NAnt |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Maven |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Maven2 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Make |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
MsBuild |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Visual Studio ('devenv') |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Tools integration |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
ViewCVS |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Fisheye |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Bonsai |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Bugzilla |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Scarab |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Trac |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
sourceforge.net |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
rubyforge.org |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
JIRA |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Confluence |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
ClearQuest |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
JUnit result rendering |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
NUnit result rendering |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Clover result rendering |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Selenium result rendering |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
IntelliJ Plugin |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Eclipse Plugin |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
VS 2005 Plugin |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Remote Management API |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
SOAP |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
XML-RPC |
|
|
n/a |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
JMX |
|
N/A |
n/a |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Hessian |
|
|
n/a |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Client Library |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Installation and Configuration |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Windows installer |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Self contained distribution (except SCM clients) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Additional dependencies |
JRE, SCM client |
.NET Runtime, IIS, SCM client |
.NET Runtime, SQL Server (MSDE Included in distribution) |
Perl, CVS |
Python, Twisted |
JRE, SCM client |
JDK, Servlet container, SCM client |
|
jdk, SCM client |
jdk,tomcat,SCM client |
|
|
JRE, SCM client |
Subversion, .NET runtime/IIS or Mono/XSP |
|
Perl, CVS, SCP |
JDK, some SCM clients |
Some SCM clients |
Execution platform |
JVM |
Windows, .NET, Mono |
Windows, .NET, Mono |
Perl |
Python |
JVM |
JVM |
|
JVM |
JVM |
|
|
JVM |
Windows, Linux |
Windows, Unix, Linux, Mac OS X, Solaris, HP UX |
Perl |
JVM |
JVM |
Project platform (what it can build) |
Java + anything Ant/Maven/NAnt can build |
.NET or anything with a command line interface build |
Any language |
Any language |
Any language |
Any language |
Any language with supplied ant wrapper |
|
Any language |
Any language with supplied ant wrapper |
|
|
Any language |
Any language |
Any language |
(i)Any language |
Any Language |
Any Language |
Preferred build tool |
Ant, Maven |
Nant |
NAnt |
Make |
Make |
Any build tool |
Ant |
|
Any build tool |
Ant, Maven |
|
|
Maven 2 |
Any build tool |
Any build tool |
Make |
Any build tool |
Any |
Requires modifications to build scripts |
NO |
NO |
NO |
|
No |
NO |
NO |
|
NO |
NO |
|
|
NO |
NO |
NO |
|
NO |
NO |
Supports multiple projects |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Automatic configuration from build script |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Text file configuration |
|
|
Stored in SQL Db - XML input/export coming soon |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
