Test Ordering

When defining multiple tests in a Spec, there's a certain order to how Kotest will execute them.

By default, a sequential order is used (order that the tests are defined in the file), but it's also possible to configure them to be executed in a random order or lexicographic order.

This setting can be configured in either each Spec individually (if you wish fine-grained control) or in ProjectConfig by overriding the testCaseOrder function (if you wish for project wide defaults). If both exist, the Spec's configuration will have priority.

note

Nested tests will always run in sequential order regardless of test ordering setting.

Sequential Ordering

Root tests are dispatched in the order they are defined in the spec file.

class SequentialSpec : FreeSpec() {

    override fun testCaseOrder(): TestCaseOrder? = TestCaseOrder.Sequential

    init {
      "foo" {
        // I run first as I'm defined first
      }

      "bar" {
        // I run second as I'm defined second
      }
    }
}

Random Ordering

Root tests are dispatched in a random order.

class RandomSpec : FreeSpec() {

    override fun testCaseOrder(): TestCaseOrder? = TestCaseOrder.Random

    init {
      "foo" {
        // This test may run first or second
      }

      "bar" {
        // This test may run first or second
      }
    }
}

Lexicographic Ordering

Root tests are dispatched in a lexicographic order.

class LexicographicSpec : FreeSpec() {

    override fun testCaseOrder(): TestCaseOrder? = TestCaseOrder.Lexicographic

    init {
      "foo" {
        // I run second as bar < foo
      }

      "bar" {
        // I run first as bar < foo
      }
    }
}