-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy pathplugin.spec
235 lines (235 loc) · 12.1 KB
/
plugin.spec
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
---
config:
plugin_type: test
subparsers:
tempest:
description: The tempest test runner
include_groups: ["Ansible options", "Inventory", "Common options", "Common variables", "Answers file"]
groups:
- title: Tempest
options:
tempest-config:
type: Bool
help: |
Create tempest configuration file
default: yes
tests:
type: ListOfVarFiles
help: |
The set of tests to execute. Should be specified as list
constructed from the allowed values.
For example: smoke,network,volumes
__LISTYAMLS__
required: yes
mode:
type: Value
help: |
Mode tempest plugin should run in.
normal - use RPM version of Tempest (the usual way Tempest is ran)
debug_failing - installs tempest patches with highly experimental
features (i.e.: run_on_failure) that are not yet merged to
main Tempest project. See https://review.opendev.org/#/c/553896/
for more details.
Tested only on OSP12 and above.
debug_all - an extended version of 'debug_failing' but running
debugging/info capturing commands on _all_ tempest tests.
Useful when troubleshooting resource leaks and other problems
not directly related to tempest tests failures.
Use with caution (i.e.: only with small test suites) as it consumes
build time and disk space considerably.
NOTE: See 'debug-command' below.
choices:
- normal
- debug_failing
- debug_all
default: normal
debug-command:
type: Value
help: |
Value of this parameter takes effect only when --mode is 'debug_failing'
or 'debug_all'. Command given here will be run by tempest on each test's
teardown phase (before resources used by that test are torn down).
The command can be any command available on the 'tester' node (the one tempest
runs on) or a URL to an shell executable file (it will be downloaded
and executed).
Examples:
--debug-command 'ovs-vsctl show br-int'
--debug-command 'http://someurl/my_debug_script.sh'
default: 'sosreport --batch --build --tmp-dir /var/log/extra --log-size=1 -p openstack'
plugin:
type: Value
action: append
help: |
The list of additional plugins with tests to install.
Should be specified in the following format:
--plugin=repo_url
The plugin flag can also specify the version/branch to clone.
In order to specify version the repo_url should be separated by comma:
--plugin=repo_url,version
More than one --plugin option can be provided.
openstack-version:
type: Value
help: |
The OpenStack under test version.
Numbers are for OSP releases
Names are for RDO releases
choices:
- "6"
- "7"
- "8"
- "9"
- "10"
- "11"
- "12"
- "13"
- "14"
- "15"
- "15-trunk"
- liberty
- kilo
- liberty
- mitaka
- newton
- ocata
- pike
- queens
- rocky
- stein
openstack-installer:
type: Value
help: |
The OpenStack installation type.
choices:
- packstack
- tripleo
required: yes
setup:
type: Value
help: |
The setup type for tests and for the tempestconf tool.
__LISTYAMLS__
default: rpm
deployer-input-file:
type: FileValue
help: |
The deployer input file absolute or relative path.
By default will try to use the 'deployer-input-file.conf' file from active workspace folder.
openstackrc:
type: FileValue
help: |
The full path or relative path to the openstackrc file.
When empty, infrared will search active workspace for the 'keystonerc' file and use it.
image:
type: Value
help: |
An image to be uploaded to glance and used for testing. Path have to be a url.
images-packages:
type: Value
help: |
Comma delimited list of packages to install in guest image tempest will use for testing.
This option requires 'image' option to be specified and will fail without it.
config-longopt:
action: append
help: |
Extra long argument without the leading '--' passed to python-tempestconf.
Format: --config-longopt image-disk-format=raw
config-options:
type: IniType
action: append
help: |
Forces additional Tempest configuration (tempest.conf) options.
Format: --config-options section.option:value1 --config-options section.option:value
remove-options:
type: IniType
action: append
help: |
Remove additional Tempest configuration (tempest.conf) options.
Format: --remove-options section.option:value1 --remove-options section.option:value
blackre:
type: Value
help: |
Adds an extra black (skip) regex to the ostestr/tempest invocation.
To add multiple tests seperate by pipe.
regexlist-file:
type: Value
help: |
A path to a file that contains a list of regular expressions with black/white-listed tests.
Black/white-listed tests will be ammended to the tempest black/white-list files.
Example of the regexlist-file content
blacklist: [
test.foo.1,
test.foo.2
]
whitelist: [
test.zoo.1,
test.zoo.2
]
foo.1, foo.2 will be ammended to the tempest blacklist file, while zoo.1, zoo.2 will
be ammended to the tempest whitelist file (in addition to the tests that were contained
therein). For more details on how black/white list operate refer to:
http://stestr.readthedocs.io/en/latest/MANUAL.html#test-selection
revision:
type: Value
help: The setup (git) revision if applicable
threads:
type: Value
help: The number of concurrent threads to run tests
default: 8
dir:
type: Value
help: The tempest working directory on the tester node
default: tempest-dir
legacy-config:
type: Bool
help: |
Specifies whether the tempest configuration should use legacy method by running configuration
from the tempest repo itself without using the tempestconf package. Suitable only when
setup is 'git'
default: no
cleanup:
type: Bool
help: |
Use tempest cleanup to clean the leftover from the tests (usually when tests fail)
default: no
python_tempest_conf_dir:
type: Value
help: |
The full or relative path to the python-tempestconf destination.
Suitable when setup is 'git'. When the path is specified, python-tempestconf is not cloned
from the repository but the code in a location specified by the path is used instead.
results-formats:
type: Value
help: |
Output format of tempest results report to generate. Currently supported: junitxml, html.
Format: --results-formats junitxml,html
default: junitxml
list:
type: Bool
help: List all the tests which will be run.
default: no
packages:
type: Value
help: Comma,delimited list of packages to install system-wide before installing tests packages and their requirements.
pip-packages:
type: Value
help: Comma,delimited list of pip packages to install system-wide before installing tests packages and their requirements.
post-config-commands:
type: ListValue
help: |
Comma separated list of commands to execute after tempest config is executed.
For example: 'ls -l','echo awesome'
configure-whitebox-plugin:
type: Bool
help: |
This configures "[whitebox]\nhypervisors" field in tempest.conf based on Whitebox Tempest Plugin.
A list of mapped hypervisors with their external IP are configured automatically based on the deployment.
Ex- hypervisors=compute-0.localdomain:192.168.24.5,compute-1.localdomain:192.168.24.11
Plugin url: https://review.rdoproject.org/r/openstack/whitebox-tempest-plugin
NOTE: vars/tests/whitebox_plugin.yml need to be included to execute Whitebox tests
default: no
- title: ansible facts
options:
collect-ansible-facts:
type: Bool
help: Save ansible facts as json file(s)
default: False