Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

 

CIT

INV

ITP

VER

STY

VRP

Able to stage local repository state

(tick)

(error)

(error)

(error)

(error)

(error)

Able to compile custom sources

(error)

(error)

(error)

(error)

(error)

(error)

Able to add custom dependencies

(error)

(error)

(error)

(error)

(error)

(error)

Supports pre-build hook

(green star)

(tick)

(error)

(tick)

(tick)

(error)

Supports verification

(green star)

(tick)

(error)

(tick)

(tick)

(tick)

Supports post-build hook for tearDown

(green star)

(tick)

(error)

(green star)

(tick)

(tick)

Beanshell support

(error)

(tick)

(error)

(error)

(error)

(error)

Groovy support

(error)

(error)

(error)

(error)

(tick)

(error)

Capture Maven exit code and exceptions

(error)

(tick)

(tick)

(tick)

(tick)

(error)

Supports ANSI output

(red star)

(error)

(error)

(red star)

(tick)

(error)

Can ignore failures

(green star)

(error) (green star)

(error)

(green star)

(tick)

(error)

Can skip execution

(green star)

(error) (green star)

(error)

(green star)

(tick)

(error)

Integration/System Testing - Execution

...

 

CIT

INV

ITP

VER

STY

Can stage or use a pre-staged local repository

(tick)

(tick)

(error)

(error)

(error)

Runs with Surefire

(tick)

(error)

(error)

(tick)

(tick)

Generates JUnit XML

(green star)

(error)

(error)

(green star)

(error)

Can measure coverage using standard techniques

(question)

(error)

(error)

(tick)

(error)

Can be used for contextual integration testing

(error)

(error)

(error)

(error)

(error)

Run tests against multiple versions of Maven

(error)

(tick)

(error)

(tick)

(error)

Run tests against multiple versions of the plugin

(error)

(error)

(error)

(error)

(error)

Forked Maven

(question)

(tick)

(error)

(tick)

(tick)

Embedded Maven

(question)

(error)

(tick)

(error)

(error)

Does not pollute source tree on execution

(question)

(error) (tick)

(error)

(tick)

(error)

Cleans up anything stored outside target directory

(error)

(error)

(error)

(error)

(tick)

Includes local repository and system temporary directory

Uses unique storage location for all execution files

(tick)

(error)

(error)

(error)

(error)

This is a concurrency issue if it uses the same location.

Isolated from user's environment/settings by default

(question)

(error)

(error)

(error)

(error)

Can be achieved by passing a separate settings file for those that support it.

Able to run from the IDE regular test functionality

(tick)

(error)

(error)

(tick)

(error)

Able to run offline (unless plugin requires it)

(question)

(tick)

(tick)

(error)

(tick)

Offline by default

(error)

(error)

(error)

(error)

(error)

Able to run a single test

(green star)

(tick)

(error)

(green star)

(tick)

Able to run wildcard/regex set of tests

(green star)

(tick)

(error)

(green star)

(error)

Able to run a suite of tests

(green star)

(tick)

(tick)

(green star)

(tick)

Able to run in a separate Maven project

(error)

(tick)

(tick)

(tick)

(tick)

Able to run in the same Maven project

(tick)

(error)

(error)

(error)

(tick)

Fast execution

(question)

(error)

(tick)

(error)

(error)

Maven home is configurable

(question)

(tick)

(error)

(tick)

(error)

Configurable Maven settings file

(question)

(tick)

(error)

(tick)

(tick)

Configurable individual Maven settings

(question)

(tick)

(error)

(error)

(error)

Configurable working directory

(question)

(tick)

(error)

(tick)

(error)

Configurable input/output handlers for Maven

(question)

(tick)

(error)

(error)

(error)

Configurable Maven logger

(question)

(tick)

(error)

(error)

(error)

Can select which projects to run (include/exclude)

(question)

(tick)

(tick)

(tick)

(tick)

Able to run Maven in batch mode

(question)

(tick)

(error)

(tick)

(error)

Able to run Maven in debug mode

(question)

(tick)

(error)

(tick)

(tick)

Able to inherit shell environment

(question)

(tick)

(error)

(tick)

(error)

Pass goals to run Maven with

(question)

(tick)

(tick)

(tick)

(tick)

Pass goals to run Maven with in a file

(question)

(tick)

(tick)

(tick)

(tick)

Interpolate goals to run Maven with

(question)

(tick)

(error)

(error)

(error)

Pass properties to run Maven with

(question)

(tick)

(error)

(tick)

(tick)

Pass properties to run Maven with in a file

(question)

(tick)

(error)

(tick)

(tick)

Interpolate properties to run Maven with

(question)

(tick)

(error)

(tick)

(error)

Pass profiles to run Maven with

(question)

(tick)

(error)

(tick)

(error)

Pass profiles to run Maven with in a file

(question)

(tick)

(error)

(tick)

(error)

Pass flags to run Maven with

(question)

(error) (tick)

(error)

(tick)

(tick)

Pass flags to run Maven with in a file

(question)

(error) (tick)

(error)

(tick)

(tick)

Able to run tests in parallel

(green star)

(error)

(error)

(green star)

(tick)

Able to timeout tests run in parallel

(green star)

(error)

(error)

(green star)

(tick)

...