Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 41 Next »

There are many Continuous Integration systems available. This page is an attempt to keep an unbiased comparison of as many as possible of them. The goals are:

  • Make it easier to choose an appropriate CI tool for your project.
  • "Healthy competition aid" for the people involved in the development of these various CI systems.

Note: In order to be as neutral as possible, it would be favourable if this page was hosted somewhere else, in a publicly available place. Let us know if you have any suggestions regarding this.

Note: If you want a new feature in one of these, please use the respective project's issue trackers. Don't add feature requests here.

Note: If you want to update this page (maybe you are a developer of one of these), just sign up as a user in this Confluence and request write access to this page in a comment at the bottom of this page. Then we'll add you.

Legend:
(tick) The feature exists
(warning) The feature exists, but is buggy or not well tested
(error) The feature doesn't exist

 

CruiseControl

CruiseControl.NET

DamageControl

Tinderbox

BuildBot

Anthill Professional

Anthill

BeetleJuice

LuntBuild

Gump

Draco.NET

Project info

 

 

 

 

 

 

 

 

 

 

 

Project origin

ThoughtWorks

ThoughtWorks

ThoughtWorks

?

?

Urbancode

Urbancode

?

luntsys

?

?

Open Source

(tick)

(tick)

(tick)

(tick)

(tick)

(error)

(tick)

(error)

(tick)

(tick)

(tick)

Implementation language

Java

C#

Ruby

Perl

Python

Java

Java

Java

Java

Java

C#

Free

(tick)

(tick)

(tick)

(tick)

(tick)

(error) Free for Open Source Projects

(tick)

(error)

(tick)

(tick)

(tick)

Issue tracker

JIRA

JIRA

JIRA

?

?

JIRA

JIRA

?

SourceForge

?

?

Online demo

here

here

openauthenticated

?

?

(error)

(error)

?

(error)

?

?

Number of active developers

5

2

3

?

?

?

?

?

2

?

?

SCM support

 

 

 

 

 

 

 

 

 

 

 

AccuRev

(error)

?

?

?

?

(tick)

(error)

?

?

?

?

ClearCase

(tick)

(tick)

(error)

?

?

(tick)

(error)

?

(tick)

?

?

CVS

(tick)

(tick)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

"File system SCM"

(tick)

(tick)

(error)

?

?

(tick)

(tick)

?

(error)

?

?

HTTP file

(tick)

(error)

(error)

?

?

(error)

(error)

?

(error)

?

?

MKS

(tick)

(error)

(error)

?

?

(tick)

(tick)

?

(error)

?

?

Perforce (p4)

(tick)

(tick)

(error)

?

?

(tick)

(tick)

?

(tick)

?

?

PVCS

(tick)

(tick)

(error)

?

?

(tick)

(tick)

?

(error)

?

?

SourceGear Vault

(error)

(tick)

(error)

?

?

(error)

(error)

?

(error)

?

?

StarTeam

(tick)

(tick)

(error)

?

?

(tick)

(tick)

?

(tick)

?

?

Subversion

(tick)

(tick)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Surround

(tick)

(error)

(error)

?

?

(error)

(error)

?

(error)

?

?

VSS

(tick)

(tick)

(error)

?

?

(tick)

(tick)

?

(tick)

?

?

VSS Journal

(tick)

(error)

(error)

?

?

?

?

?

(error)

?

?

SCM related support

 

 

 

 

 

 

 

 

 

 

 

SCM filtering

(tick)

(tick)

(error)

?

?

(error)

(error)

?

(error)

?

?

Multi-SCM

(tick)

(tick)

(error)

?

?

(error)

(error)

?

(tick)

?

?

Can create new SCM repositories

(error)

(error)

(tick) Via web admin

?

?

(error)

(error)

?

(error)

?

?

Build management

 

 

 

 

 

 

 

 

 

 

 

Parallel builds (ability to build several projects simultaneously)

(tick) Release 2.2

(tick)

(tick)

?

?

(tick)

(error)

?

(tick)

?

?

Distributed builds

(error) read how they did it at SAS

(error)

(error)

?

?

(error)

(error)

?

(error)

?

?

Manually force builds

(tick)

(tick)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

SCM trigged builds

(tick) CVS only

(error)

(tick) (if supported by SCM)

?

?

(error)

(error)

?

(tick)

?

?

SCM poll based builds

(tick)

(tick)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Temporal build scheduling

(tick)

(tick)

(error)

?

?

(tick)

(tick)

?

(tick)

?

?

Builds promotion

(error)

?

?

?

?

(question)

(question)

?

(tick)

?

?

Builds deletion

(error)

?

?

?

?

(tick)

(error)

?

(tick)

?

?

reproduce history builds

(error)

(question)

(question)

?

?

(tick)

(error)

?

(tick)

?

?

Security

 

 

 

 

 

 

 

 

 

 

 

User authentication

(error)

(error)

(error) Apache recommended

?

?

(tick)

(error)

?

(error)

?

?

User authorization schemes

(error)

(error)

(tick)

?

?

(tick)

(error)

?

(error)

?

?

Publishing

 

 

 

 

 

 

 

 

 

 

 

Confluence

(error)

(error)

(warning)

?

?

(error)

(error)

?

(error)

?

?

Email

(tick)

(tick)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Run executable

(tick)

(tick)

(error)

?

?

?

?

?

(error)

?

?

FTP

(tick)

(error)

(error)

?

?

?

?

?

(error)

?

?

IRC

(error)

(error)

(tick)

?

?

?

?

?

(error)

?

?

Jabber

(tick)

(error)

(warning)

?

?

?

?

?

(error)

?

?

Lotus Sametime

(tick)

(error)

(error)

?

?

?

?

?

(error)

?

?

NetSend

(error)

(tick)

(error)

?

?

?

?

?

(error)

?

?

ProjectStart

(error)

(tick)

(error)

?

?

?

?

?

(error)

?

?

RSS

(error)

(warning)

(error)

?

?

?

?

?

(error)

?

?

SCP

(tick)

(error)

(error)

?

?

?

?

?

(error)

?

?

Windows System Tray

(tick)

(tick)

(tick)

?

?

?

?

?

(error)

?

?

Formatted Logging

(tick) XML

(tick) XML

(tick) YAML

?

?

(error)

(error)

?

(error)

?

?

Yahoo Messenger

(error)

(warning)

(warning)

?

?

?

?

?

(error)

?

?

MSN Messenger

?

?

?

?

?

?

?

?

(tick)

?

?

X10

(tick)

(error)

(error)

?

?

?

?

?

(error)

?

?

Web interface

(tick)

(tick)

(tick)

 

 

 

 

 

 

 

 

View changesets

(error)

(error)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Add new projects

(error)

(error)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Clone projects

(error)

(error)

(tick)

?

?

(tick)

(error)

?

(error)

?

?

Delete projects

(error)

(error)

(error)

?

?

(tick)

(tick)

?

(tick)

?

?

Modify projects

(error)

(error)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Kill builds

(tick)

(error)

(tick)

?

?

(tick)

(error)

?

(error)

?

?

Pause builds

(tick)

(error)

(error)

?

?

(error)

(error)

?

(error)

?

?

Access to build artifacts

(tick)

(error)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Browse CI's working copy

(error)

(error)

(tick)

?

?

?

(error)

?

(error)

?

?

Delete CI's working copy

(error)

(error)

(tick)

?

?

(error)

(error)

?

(error)

?

?

Search in builds

(error)

(error)

(tick)

?

?

(error)

(error)

?

(tick)

?

?

Historic graphs

(tick)

(error)

(error)

?

?

(error)

(error)

?

(error)

?

?

Self-updating web page

(tick)

(tick)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Multi project support

(tick)

(tick)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Multi project view

(tick)

(tick)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Directly supported build tools

 

 

 

 

 

 

 

 

 

 

 

Shell / command script

(error)

(tick)

(tick)

?

?

(tick)

(error)

?

(error)

?

?

Ant

(tick)

(error)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

NAnt

(error)

(tick)

(error)

?

?

(error)

(error)

?

(error)

?

?

Maven

(tick)

(error)

(tick)

?

?

(tick)

(error)

?

(error)

?

?

Make

(error)

(error)

(tick)

?

?

(tick)

(error)

?

(error)

?

?

Visual Studio ('devenv')

(error)

(tick)

(error)

?

?

(error)

(error)

?

(error)

?

?

Tools integration

 

 

 

 

 

 

 

 

 

 

 

ViewCVS

(error)

(error)

(tick)

?

?

(error)

(error)

?

(error)

?

?

Fisheye

(error)

(error)

(tick)

?

?

(error)

(error)

?

(error)

?

?

Bugzilla

(error)

(error)

(tick)

?

?

(error)

(error)

?

(error)

?

?

JIRA

(error)

(error)

(tick)

?

?

(error)

(error)

?

(error)

?

?

Confluence

(error)

(error)

(warning)

?

?

(error)

(error)

?

(error)

?

?

JUnit result rendering

(tick)

(error)

(tick)

?

?

?

?

?

(error)

?

?

NUnit result rendering

(error)

(tick)

(error)

?

?

?

?

?

(error)

?

?

IntelliJ Plugin

(tick)

(error)

(error)

?

?

(error)

(error)

?

(error)

?

?

Eclipse Plugin

(tick)

(error)

(error)

?

?

(error)

(error)

?

(error)

?

?

Remote Management API

 

 

 

 

 

 

 

 

 

 

 

SOAP

(error)

(tick)

(error)

?

?

(error)

(error)

?

(error)

?

?

XML-RPC

(error)

(warning)

(tick)

?

?

(error)

(error)

?

(error)

?

?

JMX

(tick)

N/A

N/A

?

?

(error)

(error)

?

(error)

?

?

Hessian

?

?

?

?

?

?

?

?

(tick)

?

?

Installation and Configuration

 

 

 

 

 

 

 

 

 

 

 

Windows installer

(error)

(error)

(tick)

?

?

(error)

(error)

?

(error)

?

?

Self contained distribution (except SCM clients)

(error)

(error)

(tick)

?

?

(error)

(error)

?

(error)

?

?

Additional dependencies

JRE, Servlet container, SCM client

.NET Runtime, IIS, SCM client

SCM client

?

?

JDK, Servlet container, SCM client

JDK, Servlet container, SCM client

?

jdk,tomcat,SCM client

?

?

Execution platform

Anything that can run a JVM

Windows

Anything that can run Ruby

?

?

Anything that can run a JVM

Anything that can run a JVM

?

Anything that can run a JVM

?

?

Project platform (what it can build)

Java, C++, anything Ant/Maven can build

.NET or anything with a command line interface build

Any language

?

?

Any language

Any language with supplied ant wrapper

?

Any language with supplied ant wrapper

?

?

Preferred build tool

Ant, Maven

Nant

Any build tool

?

?

Any build tool

Ant

?

Ant

?

?

Requires modifications to build scripts

NO

NO (for certain SCMs)

NO

?

?

NO

NO

?

slight modification

?

?

Supports multiple projects

(tick)

(tick)

(tick)

?

?

(tick)

(tick)

?

(tick)

?

?

Text file configuration

(tick) XML

(tick) XML

(tick) YAML

?

?

(error)

(error)

?

(error)

?

?

  • No labels