Understanding the test plan manifest

Search…
Inside the root of every test plan is a file called manifest.toml. This file is used to explain the test plan to the Testground daemon. In this file, a plan can be restricted to specific runners. Additionally, this is the file where test cases and parameters are defined.
If you have created the quickstart plan in the previous article, let's have a look at the manifest file we have just created.
Test plan name
The name of the test plan is a top-level of the file's schema.
1
name = "quickstart"
Copied!
Defaults
Enclosed in a defaults section are default builders. These are variables which can be used as defaults for the plan. In this section, we set the default builder and runner.
1
[defaults]
2
builder = "exec:go"
3
runner = "local:exec"
Copied!
Builder and runner options
The next few sections are options passed to each builder and runner when they are selected. Make sure to enable any builders and runners you want to use! The following section enables all runners and passes configurations. Of particular interest is the module path. Make sure this is correct to ensure code can be correctly imported.
1
[builders."docker:go"]
2
enabled = true
3
go_version = "1.14"
4
module_path = "github.com/your/module/name"
5
exec_pkg = "."
6
​
7
[builders."exec:go"]
8
enabled = true
9
module_path = "github.com/your/module/name"
10
​
11
[runners."local:docker"]
12
enabled = true
13
​
14
[runners."local:exec"]
15
enabled = true
16
​
17
[runners."cluster:k8s"]
18
enabled = true
Copied!
Test cases
Finally, we have test cases. Test cases are defined in an array of tables which specify the name of the test case, boundaries for the number of instances and the values of any parameters being tested in a particular test case.
1
[[testcases]]
2
name= "quickstart"
3
instances = { min = 1, max = 5, default = 1 }
Copied!
The resulting manifest.toml  test plan manifest
Putting it all together:
1
name = "quickstart"
2
​
3
[defaults]
4
builder = "exec:go"
5
runner = "local:exec"
6
​
7
[builders."docker:go"]
8
enabled = true
9
go_version = "1.14"
10
module_path = "github.com/your/module/name"
11
exec_pkg = "."
12
​
13
[builders."exec:go"]
14
enabled = true
15
module_path = "github.com/your/module/name"
16
​
17
[runners."local:docker"]
18
enabled = true
19
​
20
[runners."local:exec"]
21
enabled = true
22
​
23
[runners."cluster:k8s"]
24
enabled = true
25
​
26
[[testcases]]
27
name= "quickstart"
28
instances = { min = 1, max = 5, default = 1 }
29
​
30
# Add more testcases here...
31
# [[testcases]]
32
# name = "another"
33
# instances = { min = 1, max = 1, default = 1 }
34
#   [testcase.params]
35
#   param1 = { type = "int", desc = "an integer", unit = "units", default = 3 }
Copied!
Quick start
Parameters and test cases
Last modified 1yr ago
Copy link
Contents
Test plan name
Defaults
Builder and runner options
Test cases
The resulting manifest.toml test plan manifest