Test cases listed in Test Requirements and Assertions page are not executed

[lgoltz]

Following are the 65 test cases which are listed in the WCS Test Requirements and Assertions page (http://cite.opengeospatial.org/teamengine/about/wcs/1.0.0/site/testreq.html), but are not getting executed when we run WCS (with GET-KVP + POST-XML) in TeamEngine.

"ID: wcs/1.0.0/basic_service_elements/general_http_request_rules/1"
"ID: wcs/1.0.0/basic_service_elements/general_http_request_rules/2"
"ID: wcs/1.0.0/basic_service_elements/general_http_request_rules/3"
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/get/kvp/1"
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/get/kvp/8"
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/get/kvp/9"
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/get/kvp/10"
"ID: wcs/1.0.0/describecoverage_operations/describecoverage_request/get/kvp/3"
"ID: wcs/1.0.0/describecoverage_operations/describecoverage_request/get/kvp/4"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/service_version/get/kvp/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/service_version/get/kvp/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/service_version/get/kvp/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/coverage/get/kvp/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/crs/get/kvp/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/response_crs/get/kvp/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/response_crs/get/kvp/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/response_crs/get/kvp/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/get/kvp/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/get/kvp/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/get/kvp/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/time/get/kvp/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/time/get/kvp/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/get/kvp/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/get/kvp/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/get/kvp/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/get/kvp/4"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/grid_size/get/kvp/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/format/get/kvp/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_response/get/kvp/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_response/get/kvp/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_response/get/kvp/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_response/get/kvp/4"

"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/post/xml/1"
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/post/xml/8"
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/post/xml/9"
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/post/xml/10"
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_response/1"
"ID: wcs/1.0.0/describecoverage_operations/describecoverage_request/post/xml/3"
"ID: wcs/1.0.0/describecoverage_operations/describecoverage_request/post/xml/4"
"ID: wcs/1.0.0/describecoverage_operations/describecoverage_response/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/service_version/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/service_version/post/xml/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/service_version/post/xml/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/coverage/post/xml/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/crs/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/crs/post/xml/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/response_crs/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/response_crs/post/xml/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/response_crs/post/xml/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/post/xml/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/post/xml/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/time/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/time/post/xml/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/post/xml/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/post/xml/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/post/xml/4"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/grid_size/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/grid_resolution/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/grid_resolution/post/xml/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/format/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/interpolationmethod/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/interpolationmethod/post/xml/2"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/interpolationmethod/post/xml/3"

[lgoltz]

I assume all of them (not checked for all) are assigned to test class B or D which are untestable as described in the preface of http://cite.opengeospatial.org/teamengine/about/wcs/1.0.0/site/testreq.html

[TPSEDNeha]

Thanks for your reply Igoltz,

I have analysed the above 65 testcases. Out of which,
Group B & D = 39
Group A & C = 26
From the 26 group A&C testcases, the console results are as follows:
Passed = 18
Failed = 1
No Result = 1
Not shown in console = 6

Below are the ids of A & C test cases not shown in console:
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/post/xml/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/post/xml/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/post/xml/2"
"ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/get/kvp/1"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/get/kvp/3"
"ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/get/kvp/2"

As per me, based on our current capability these test cases should have got executed.
Need your guidance on this.
Regards.

PS: Tried to attach excel sheet with analysis but no success.

[lgoltz]

Thank you for the the further analysis. Two of the six tests you mentioned depends on the UpdateSequence in the Capabilities document, they are executed only if the server advertise an UpdateSequence number. These are:

• "ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/post/xml/1"
• "ID: wcs/1.0.0/getcapabilities_operations/getcapabilities_request/get/kvp/1"

Please check if the server fulfils this requirement.

The other tests seems to be missing:

• "ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/post/xml/3"
• "ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/bbox/get/kvp/3"
• "ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/post/xml/2"
• "ID: wcs/1.0.0/getcoverage_operations/getcoverage_request/parameter/get/kvp/2"