Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 77 Next »

There are many Continuous Integration systems available. This page is an attempt to keep an unbiased comparison of as many as possible of them. The goals are:

  • Make it easier to choose an appropriate CI tool for your project.
  • "Healthy competition aid" for the people involved in the development of these various CI systems.

Note: In order to be as neutral as possible, it would be favourable if this page was hosted somewhere else, in a publicly available place. Let us know if you have any suggestions regarding this.

Note: If you want a new feature in one of these, please use the respective project's issue trackers. Don't add feature requests here.

Note: If you want to update this page (maybe you are a developer of one of these), just sign up as a user in this Confluence and send an email to aslak dot hellesoy at gmail dot com to request access.

Legend:
(tick) The feature exists
(warning) The feature exists, but is buggy or not well tested
(info) The feature is planned for the near future
(error) The feature doesn't exist

WARNING: THE CURRENT DC 0.5 BRANCH CURRENTLY LACKS A LOT OF THESE FEATURES DUE TO AN ONGOING REDESIGN. THE GOAL IS TO MAKE THEM REAPPEAR BEFORE dc 0.6 IS RELEASED

 

CruiseControl

CruiseControl.NET

DamageControl

Tinderbox & Tinderbox2

BuildBot

Anthill Professional

Anthill

BeetleJuice

Luntbuild professional

LuntBuild

Gump

Draco.NET

Continuum

Sin

Parabuild Server

Tinderbox3

Project info

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Project origin

ThoughtWorks

ThoughtWorks

ThoughtWorks

Mozilla Project

?

Urbancode

Urbancode

?

PMEase

PMEase

?

?

Apache

CSH Consult

Viewtier Systems

John Keiser

Open Source

(tick)

(tick)

(tick)

(tick)

(tick)

(error)

(tick)

(error)

(error)

(tick)

(tick)

(tick)

(tick)

(tick)

(error)

(tick)

Implementation language

Java

C#

Ruby

Perl

Python

Java

Java

Java

Java

Java

Java

C#

Java

C#

Java

Perl

Free

(tick)

(tick)

(tick)

(tick)

(tick)

(error) Free for Open Source Projects

(tick)

(error)

(error) Free for Open Source Projects

(tick)

(tick)

(tick)

(tick)

(tick)

(error) Free for Open Source Projects

(tick)

Issue tracker

JIRA

JIRA

JIRA

Bugzilla

?

JIRA

JIRA

?

Supports

SourceForge

?

?

JIRA

(error)

Official support

Bugzilla

Online demo

here

here

openauthenticated

Working implementation

?

(error)

(error)

?

here

Use demo/domo

?

?

Working implementation on Codehaus

here

Eval download

Working implementation

Number of active developers

5

2

3

?

?


?

?

?

2

?

?

4

1

?

?

SCM support

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

AccuRev

(tick)

?

?

(error)

?

(tick)

(error)

?

(info)

(tick)

?

?

(info)

(error)

(info)

(error)

AlienBrain

(tick)

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

Bazaar

?

?

?

?

?

?

?

?

?

?

?

?

(tick)

?

?

?

BitKeeper

?

?

?

?

?

(tick)

?

?

?

?

?

?

?

?

?

?

ClearCase

(tick)

(tick)

(error)

(error)

?

(tick)

(error)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

CM Synergy

(tick)

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

CVS

(tick)

(tick)

(tick)

(tick)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(tick)

"File system SCM"

(tick)

(tick)

(error)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(info)

(error)

HTTP file

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(error)

(error)

(error)

MKS

(tick)

(error)

(error)

(error)

?

(tick)

(tick)

?

(error)

(error)

?

?

?

(error)

(info)

(error)

Perforce (p4)

(tick)

(tick)

(error)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

PVCS

(tick)

(tick)

(error)

(error)

?

(tick)

(tick)

?

(error)

(error)

?

?

(info)

(error)

(tick)

(error)

SourceGear Vault

(error)

(tick)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

?

(error)

(tick)

(error)

StarTeam

(tick)

(tick)

(error)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(warning)

(error)

(info)

(error)

Subversion

(tick)

(tick)

(tick)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(tick)

(tick)

(error)

Surround

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

?

(error)

(tick)

(error)

VSS

(tick)

(tick)

(error)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(info)

(error)

(tick)

(error)

VSS Journal

(tick)

(error)

(error)

(error)

?

(error)

?

?

(error)

(error)

?

?

?

(error)

(error)

(error)

SCM related support

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

SCM filtering

(tick)

(tick)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

?

(error)

(tick)

(error)

Multi-SCM

(tick)

(tick)

(error)

(error)

?

(error)

(error)

?

(tick)

(tick)

?

?

?

(error)

(tick)

(error)

Can create new SCM repositories

(error)

(error)

(tick) Via web admin

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(error)

(error)

(error)

Build management

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Parallel builds (ability to build several projects simultaneously)

(tick)

(tick)

(tick)

(error)

?

(tick)

(error)

?

(tick)

(tick)

?

?

(tick)

(tick)

(tick)

(error)

Distributed builds

(warning)

(error)

(error)

(tick)

?

(info)

(error)

?

(tick)

(error)

?

?

(info)

(tick)

(tick)

(tick)

Agents' code auto-updated

?

?

?

(error)

?

(info)

?

?

?

?

?

?

?

?

?

(tick)

Manually force builds

(tick)

(tick)

(tick)

(tick) Email

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

Not needed

(tick)

(tick)

SCM trigged builds

(tick) (if supported by SCM)

(error)

(tick) (if supported by SCM)

(tick)

?

(error)

(error)

?

(info)

(tick)

?

?

(tick)

(tick)

(info)

(tick)

SCM poll based builds

(tick)

(tick)

(tick)

(tick) Tinderbox2

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

Temporal build scheduling

(tick)

(tick)

(error)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

Builds promotion

(error)

?

?

(error)

?

(question)

(question)

?

(tick)

(error)

?

?

(info)

(error)

?

(error)

Builds deletion

(error)

?

?

(question)

?

(tick)

(error)

?

(tick)

(tick)

?

?

(info)

(error)

(tick)

(question)

Reproduce history builds

(error)

(question)

(question)

(error)

?

(tick)

(error)

?

(tick)

(tick)

?

?

(info)

(error)

(tick)

(error)

Proactive (can prevent build breakages)

(error)

(question)

(question)

(error)

(question)

(question)

(question)

(question)

(question)

(question)

(question)

(question)

(question)

(tick)

(tick)

(error)

Security

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

User authentication

(tick)

(error)

(error) Apache recommended

(tick) For management

(question)

(tick)

(error)

(question)

(tick)

(tick)

(question)

(question)

(tick)

(error)

(tick)

(tick) For management

User authorization schemes

(error)

(error)

(tick)

(question)

(question)

(tick)

(error)

(question)

(tick)

(tick)

(question)

(question)

(tick)

(error)

(tick)

(error) Database

LDAP Integration

(error)

(error)

(question)

(question)

(question)

(tick)

(error)

(question)

(question)

(tick)

(question)

(question)

(question)

(error)

(question)

(question)

Publishing

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Confluence

(error)

(error)

(warning)

(error)

(question)

(error)

(error)

(question)

(error)

(error)

(question)

(question)

(question)

(error)

(error)

(error)

Email

(tick)

(tick)

(tick)

(tick)

(question)

(tick)

(tick)

(question)

(tick)

(tick)

(question)

(question)

(tick)

(tick)

(tick)

(error)

Run executable

(tick)

(tick)

(error)

(error)

(question)

(tick)

(tick)

(question)

(tick)

(error)

(question)

(question)

(error)

(error)

(tick)

(error)

FTP

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(error)

(tick)

(error)

IRC

(error)

(error)

(tick)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(tick)

(error)

(error)

(error)

Jabber

(tick)

(error)

(info)

(error)

?

(tick)

(error)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

Lotus Sametime

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(error)

(tick)

?

?

(error)

(error)

(error)

(error)

NetSend

(error)

(tick)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(error)

(error)

(error)

ProjectStart

(error)

(tick)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(error)

(error)

(error)

RSS

(tick)

(warning)

(error)

(error)

?

(tick)

(error)

?

(error)

(tick) 

?

?

(info)

(error)

(info)

(error)

SCP

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(error)

(tick)

(tick)

Windows System Tray

(tick)

(tick)

(tick)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(tick)

(tick)

(error)

Formatted Logging

(tick) XML

(tick) XML

(tick) YAML

(error)

?

(error)

(error)

?

(error)

(tick) Xml, Html 

?

?

(error)

(error)

(tick)

(error)

Yahoo Messenger

(error)

(warning)

(warning)

(error)

?

?

(tick)

(error)

?

(error)

(error)

?

?

(info)

(error)

(info)

MSN Messenger

?

?

?

(error)

?

(error)

(error)

?

(tick)

(tick)

?

?

(tick)

(error)

(info)

(error)

X10

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

?

(error)

(error)

(error)

Web interface

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

View changesets

(error)

(error)

(tick)

Bonsai

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

Bonsai

Add new projects

(warning)

(error)

(tick)

(error) "Tree" only

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error) "Tree" only

Clone projects

(error)

(error)

(tick)

?

?

(tick)

(error)

?

(tick)

(tick)

?

?

(error)

(error)

(tick)

(error)

Delete projects

(warning)

(error)

(error)

(tick)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(tick)

Modify projects

(warning)

(error)

(tick)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

Kill builds

(tick)

(error)

(tick)

(error)

?

(tick)

(error)

?

(tick)

(tick)

?

?

(info)

(error)

(tick)

(error)

Pause builds

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(info)

(error)

(tick)

(error)

Access to build artifacts

(tick)

(error)

(tick)

(tick)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(info)

(error)

(tick)

(tick)

Browse CI's working copy

(error)

(error)

(tick)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(tick)

(error)

(info)

(error)

Delete CI's working copy

(error)

(error)

(tick)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(tick)

(error)

(tick)

(error)

Search in builds

(error)

(error)

(tick)

(error)

?

(error)

(error)

?

(tick)

(tick)

?

?

?

(error)

(tick)

(error)

Historic graphs

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(info)

(error)

(tick)

(error)

Self-updating web page

(tick)

(tick)

(tick)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(tick)

(tick)

(error)

Multi project support

(tick)

(tick)

(tick)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

Multi project view

(tick)

(tick)

(tick)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

Add/remove agent machines (for distributed builds)

?

?

?

(error)

?

(info) automatic

(error)

?

?

?

?

?

?

?

(tick)

(tick)

Directly supported build tools

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Shell / command script

(info) 2.4.1

(tick)

(tick)

(tick)

?

(tick)

(error)

?

(tick)

(tick)

?

?

(tick)

(tick)

(tick)

(tick)

Ant

(tick)

(error)

(tick)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

NAnt

(tick)

(tick)

(error)

(error)

?

(tick)

(error)

?

(info)

(error)

?

?

(error)

(error)

(tick)

(error)

Maven

(tick)

(error)

(tick)

(error)

?

(tick)

(error)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

Maven2

(info) 2.4.1

(error)

(error)

(error)

(error)

(tick)

(error)

(error)

(info)

(tick) 

(error)

(error)

(tick)

(error)

(tick)

(error)

Make

(error)

(error)

(tick)

(tick)

?

(tick)

(error)

?

(question)

(error)

?

?

(tick)

(error)

(tick)

(tick)

Visual Studio ('devenv')

(error)

(tick)

(error)

(error)

?

(error)

(error)

?

?

(error)

?

?

(error)

(error)

(tick)

(error)

Tools integration

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

ViewCVS

(error)

(error)

(tick)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(info)

(error)

(tick)

(error)

Fisheye

(error)

(error)

(tick)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(info)

(error)

?

(error)

Bonsai

?

?

?

(tick)

?

(error)

(error)

?

?

?

?

?

?

?

?

(tick)

Bugzilla

(error)

(error)

(tick)

(error)

?

(error)

(error)

?

(info)

(error)

?

?

(info)

(error)

(tick)

(error)

Scarab

(error)

(error)

(tick)

(error)

(question)

(question)

(question)

(question)

(error)

(question)

(question)

(question)

(error)

(error)

(error)

(error)

Trac

(error)

(error)

(tick)

(error)

(question)

(question)

(question)

(question)

(question)

(question)

(question)

(question)

(error)

(error)

(error)

(error)

sourceforge.net

(error)

(error)

(tick)

(error)

(question)

(question)

(question)

(question)

(question)

(question)

(question)

(question)

(error)

(error)

(error)

(error)

rubyforge.org

(error)

(error)

(tick)

(error)

(question)

(question)

(question)

(question)

(question)

(question)

(question)

(question)

(error)

(error)

(error)

(error)

JIRA

(error)

(error)

(tick)

(error)

?

(error)

(error)

?

(info)

(error)

?

?

(info)

(error)

(tick)

(error)

Confluence

(error)

(error)

(warning)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(error)

(error)

(error)

JUnit result rendering

(tick)

(error)

(tick)

(error)

?

?

?

?

(tick)

(tick)

?

?

(info)

(error)

(tick)

(error)

NUnit result rendering

(error)

(tick)

(error)

(error)

?

?

?

?

(info)

(error)

?

?

(error)

(error)

(error)

(error)

IntelliJ Plugin

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(info)

(error)

?

?

(info)

(error)

(info)

(error)

Eclipse Plugin

(tick)

(error)

(error)

(error)

?

(error)

(error)

?

(info)

(tick)

?

?

(info)

(error)

(info)

(error)

Remote Management API

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

SOAP

(error)

(tick)

(error)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(tick)

(tick)

(tick)

(error)

XML-RPC

(error)

(warning)

(tick)

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(tick)

(error)

(tick)

(error)

JMX

(tick)

N/A

N/A

(error)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(error)

(error)

(error)

Hessian

?

?

?

(error)

?

(error)

(error)

?

(info)

(tick)

?

?

(error)

(error)

(tick)

(error)

Installation and Configuration

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Windows installer

(error)

(error)

(tick)

(error)

?

(error)

(error)

?

(error)

(tick)

?

?

(info)

(tick)

(tick)

(error)

Self contained distribution (except SCM clients)

(tick)

(error)

(tick)

(error)

?

(error)

(error)

?

(tick)

(tick) 

?

?

(tick)

(tick)

(tick)

(tick)

Additional dependencies

JRE, SCM client

.NET Runtime, IIS, SCM client

SCM client

Perl, CVS

?

JDK, Servlet container, SCM client

JDK, Servlet container, SCM client

?

jdk, SCM client

jdk,tomcat,SCM client

?

?

JRE, SCM client

Subversion, .NET runtime/IIS or Mono/XSP

(tick)

Perl, CVS, SCP

Execution platform

JVM

Windows

Ruby

Perl

?

JVM

JVM

?

JVM

JVM

?

?

JVM

Windows, Linux

Windows, Unix, Linux, Mac OS X, Solaris, HP UX

Perl

Project platform (what it can build)

Java + anything Ant/Maven/NAnt can build

.NET or anything with a command line interface build

Any language

Any language

?

Any language

Any language with supplied ant wrapper

?

Any language

Any language with supplied ant wrapper

?

?

Any language

Any language

Any language

(i)Any language

Preferred build tool

Ant, Maven

Nant

Any build tool

Make

?

Any build tool

Ant

?

Any build tool

Ant, Maven

?

?

Maven 2

Any build tool

Any build tool

Make

Requires modifications to build scripts

NO

NO (for certain SCMs)

NO

(tick)

?

NO

NO

?

NO

NO

?

?

NO

NO

NO

(tick)

Supports multiple projects

(tick)

(tick)

(tick)

(error)

?

(tick)

(tick)

?

(tick)

(tick)

?

?

(tick)

(error)

(tick)

(error)

Automatic configuration from build script

(error)

(error)

(error)

(error)

(error)

(error)

(error)

(error)

(error)

(error)

(error)

(error)

(tick) Maven only

(error)

(error)

(tick)

Text file configuration

(tick) XML

(tick) XML

(tick) YAML

(tick)

?

(error)

(error)

?

(error)

(error)

?

?

(error)

(tick)

(tick)

(tick)

 

  • No labels