Skip to main content
Version: 2.x

Introduction To Property Testing

What is Property-Based Testing?โ€‹

In property-based testing, instead of testing individual values and making assertions on the results, we rely on testing the properties of the system which is under the test.

To be more acquainted with property-based testing, let's look at how we can test a simple addition function. So assume we have a function add that adds two numbers:

def add(a: Int, b: Int): Int = ???

in a typical test we start with some well-known values as test inputs and check if the function returns the expected values for each of the pair inputs:

InputExpected Output
(0, 0)0
(1, 0)1
(0, 1)1
(0, -1)-1
(-1, 0)-1
......

Now we can test all the inputs and make sure the add function returns the expected values:

import zio.test._

object AdditionSpec extends ZIOSpecDefault {

def add(a: Int, b: Int): Int = ???

val testData = Seq(
((0, 0), 0),
((1, 0), 1),
((0, 1), 1),
((0, -1), -1),
((-1, 0), -1),
((1, 1), 2),
((1, -1), 0),
((-1, 1), 0)
)

def spec =
test("test add function") {
assertTrue {
testData.forall { case ((a, b), expected) =>
add(a, b) == expected
}
}
}
}

This is not a very good approach because it is very hard to find a set of inputs that will cover all possible behaviors of the addition function.

Instead, in property-based testing, we extract the set of properties that our function must satisfy. So let's think about the add function and find out what properties it must satisfy:

  1. Commutative Propertyโ€” It says that changing the order of addends does not change the result. So for all a and b, add(a, b) must be equal to add(a, b):
assertTrue(add(a, b) == add(b, a))
  1. Associative Propertyโ€” This says that changing the grouping of addends does not change the result. So for all a, b and c, the add(add(a, b), c) must be equal to add(a, add(b, c)):
assertTrue(add(add(a, b), c) == add(a, add(b, c)))
  1. Identity Propertyโ€” For all a, add(a, 0) must be equal to a:
assertTrue(add(a, 0) == a)

If we test all of these properties we can be sure that the add function works as expected, so let's see how we can do that using the Gen data type:

import zio.test._

object AdditionSpec extends ZIOSpecDefault {

def add(a: Int, b: Int): Int = ???

def spec = suite("Add Spec")(
test("add is commutative") {
check(Gen.int, Gen.int) { (a, b) =>
assertTrue(add(a, b) == add(b, a))
}
},
test("add is associative") {
check(Gen.int, Gen.int, Gen.int) { (a, b, c) =>
assertTrue(add(add(a, b), c) == add(a, add(b, c)))
}
},
test("add is identitive") {
check(Gen.int) { a =>
assertTrue(add(a, 0) == a)
}
}
)
}

ZIO Chat

Hi there! ๐Ÿ‘‹ I'm ZIO Chat, your friendly neighborhood ZIO expert. I'm here to help you navigate the world of ZIO. Whether you're a seasoned pro or just starting out, fire away with your ZIO questions. I will hit you back with the best insights I've got. Let's dive into the world of ZIO together!