Releases: red-hat-data-services/ods-ci
Releases · red-hat-data-services/ods-ci
2.8.1
2.7.0
What's Changed
New Tests
- New Tests in Model Serving: Verify changes to existing model resources by @manosnoam in #1185
- Run pipeline upstream tests in ods-ci by @diegolovison in #1144
- Add tests for OVMS on Kserve by @lugi0 in #1194
- Fix modelmesh suite, add test for productbug RHOAIENG-2869 by @lugi0 in #1211
- Add OVMS on Kserve GPU test by @lugi0 in #1212
- Add parity between Caikit+TGIS and TGIS standalone test suites by @bdattoma in #1218
- [RHOAIENG-223] Test VSCode - add checks for VS Code image by @jstourac in #1102
- Automated test for checking the input for duplicated pipeline run by @diegolovison in #1220
Enhancements
- Add log gather when pod doesn't get ready by timeout by @bdattoma in #1179
- [Fix] wait for the RHOAI/ODH operator CSV to be in state condition Su… by @jstourac in #1177
- Add event and pod logs fetch in Model Mesh tests by @bdattoma in #1184
- Fix for the wait of the CatalogSource to be in Ready state by @jstourac in #1187
- Fix data science pipeline tests in Smoke due to changes related to pipeline versions by @jgarciao in #1189
- Remove managed starburst files by @bdattoma in #1190
- Fix 'Csv Is Ready' KW that fails due to wrong oc command by @manosnoam in #1191
- Update runtime yamls by @bdattoma in #1182
- Verify Pipeline Run Is Completed by @diegolovison in #1205
- Fix 'Clean All Models Of Current User' KW by @manosnoam in #1203
- Update ODS-CI image with Python version arg = 3.11 by @manosnoam in #1216
- Fix Custom Serving Runtime sanity tests by @bdattoma in #1226
- Add error message and continue on failure of bug RHOAIENG-404 by @manosnoam in #1225
- [Fix] jupyter notebook spawn checks by @jstourac in #1228
- fix to create user or idp by cluster id by @kobihk in #1229
Enhancements in scripts and CI/CD
- Pin Python version to 3.11 by @jiridanek in #1118
Misc
Other Changes
- Decrease TTL for our DNS records for the cluster creation. by @jstourac in #1178
- Add Kueue tests to Tier2 by @jiripetrlik in #1181
- Transition to utilizing the latest version of OpenShift Pipeline Operator by @diegolovison in #1175
- Add support for kueue component whihc got added in 2.7 by @tarukumar in #1183
- Enable & Disable kueue as DSC component by @ChughShilpa in #1188
- Stick with pipelines v1 by @diegolovison in #1193
- [Fix] the image content source repo link has changed recently by @jstourac in #1105
- Another fix to
Wait Until Csv Is Ready
keyword by @manosnoam in #1195 - Add support to UI admin group in explore cluster by @tarukumar in #1196
- Fix problem with Ray image in DW by @jiripetrlik in #1197
- Increase timeouts for Kuberay tests by @jiripetrlik in #1198
- Fix missing GIT params for DW repo by @jiripetrlik in #1199
- Fix codeflare timeouts by @jiripetrlik in #1201
- Add wait time for the pod to become ready by @tarukumar in #1208
- Disable kueue tests by @jiripetrlik in #1206
- Skip a PV Storage test on disconnected by @jstourac in #1204
- Test Automation for Pipeline Log by @diegolovison in #1210
- Update oc_install.robot by @tarukumar in #1214
- Add Polarion ID to Run Data Science Pipelines Operator Integration Tests by @diegolovison in #1219
- remove bias tests by @nehachopra27 in #1222
- Check kserve is enabled by @lugi0 in #1221
- Fix DW sanity tests parameters by @jiripetrlik in #1224
- Remove visibility test & add env var 'NAMESPACE' by @ChughShilpa in #1217
- Update the line length to 120 by @kobihk in #1230
New Contributors
Full Changelog: 2.6.0...2.7.0
2.6.0
What's Changed
New Tests
- Add edit/admin permissions tests for Kserve UI by @lugi0 in #1081
- RHOAIENG-1179 Verify user can create a workbench with an existing data connection by @jiridanek in #1094
- New Test ODS-2223 by @manosnoam in #1101
- Verify GPU AcceleratorProfile is created after restarting Dashboard by @manosnoam in #1103
- ODS-1975 - Verify user can cancel workbench start from event log [AUTOMATION] by @jiridanek in #1104
- Add e2e test for Caikit Nlp Client by @bdattoma in #1075
- Test Automation ODS-2173 Verify user can create a workbench using Intel AiKit image by @asanzgom in #1107
- [RHOAIENG-1574] - Add codeflare-sdk e2e tests by @ChughShilpa in #1112
- Add automated test for TGIS Standalone serving runtime (gRPC CLI) by @bdattoma in #1124
- Add test to verify Dashboard detects OpenShift Pipelines operator by @Raghul-M in #1141
- DIR SPD tests for Trusty AI by @nehachopra27 in #1088
- Add UI testing for TGIS Standalone by @bdattoma in #1151
- Add Kueue tests by @ChughShilpa in #1148
Enhancements
- [Fix] the Tests.Jupyterhub.Test-Jupyterlab-Git-Notebook by @jstourac in #1014
- [Fix] the test that checks the User/Group privileges permissions by @jstourac in #1064
- After installation, verify the monitoring stack only for managed by @jgarciao in #1077
- Improve Hive deployment to fail fast on fatal error, and fix deprovision logic by @manosnoam in #1078
- Pass Execution at the end of 'Provision Self-Managed Cluster' by @manosnoam in #1083
- Remove SMMR clean up from KServe test teardown by @bdattoma in #1082
- Workaround for old Hive with Openstack by @manosnoam in #1089
- Keywords for management of components by @jiripetrlik in #1085
- Add missing taint for gpu node by @tarukumar in #1091
- RHODS-13159: Use the new parameter 'base_domain' in ods-ci by @apodhrad in #1097
- Flip coin pipeline compiled by @diegolovison in #1109
- Fix ODS-493 (and other Explore tab tests) for ODH 2.6 by @jiridanek in #1111
- Fix test "Verify CSS Style Of Getting Started Descriptions" by @jgarciao in #1116
- Fix: 2.6 xpath fixes by @FedeAlonso in #1114
- Fix "Click Action From Actions Menu" and CustomServingRuntime test by @bdattoma in #1117
- Patternfly changes for gpu model serving by @tarukumar in #1123
- Fix ODS-2206, ODS-2226 for ODH 2.6 by @jiridanek in #1113
- Fix pf5 xpaths for
Verify User Can Create And Start A Workbench Adding A New PV Storage
by @jiridanek in #1126 - Move LLM CLI tests from Smoke to Sanity by @bdattoma in #1127
- Fix model serving tests in 2.6 by @bdattoma in #1125
- Fix projects page selector path by @bdattoma in #1130
- Remove ODS-1005(KFDEF) TC from the repo by @tarukumar in #1129
- Enhance "Verify That XXXXXX Image Is A CPaaS Built Image" tests by @jgarciao in #1131
- Add support for self-signed certificates by @apodhrad in #1135
- Fix for RHOAM check of the tile on the Explore page by @jstourac in #1147
- Fix xpath to env var remove button for notebook spawn by @jstourac in #1146
- Give a bit more time to load the UI elements for DS project page tests by @jstourac in #1145
- Add RHOSi Setup and RHOSi Teardown in all test suites of distributed workloads by @ChughShilpa in #1133
- Remove busybox workaround for ray by @diegolovison in #1152
- Fix: Dashboard automation errors for 2.6 pt1 by @FedeAlonso in #1132
- Adjust tests for Kuberay 1.0 by @jiripetrlik in #1150
- Fix timing issue when logging into OpenShift. Remove deprecated jupyter test by @jgarciao in #1154
- Fix library versions tests by @lugi0 in #1143
- Fix pipeline url by @diegolovison in #1156
- Trivial logging update attempt and increase of timeout by @jstourac in #1155
- Update CA_BUNDLE whenever we create DS pipeline server by @apodhrad in #1153
- Fix the broken dryrun tests with Trusty deployment by @nehachopra27 in #1159
- Revert "[Fix] attempt to stabilize the
Logged Into OpenShift
test (… by @jstourac in #1164 - Increase timeout for DSPO reconciliation retry by @diegolovison in #1163
- Fix broken sanity tests + Add skip wait option in test teardown in model serving by @bdattoma in #1157
- Fix CI ruff check for the
take_nap.py
file recently added by @jstourac in #1166 - Updating incorrect variable syntax metrics by @nehachopra27 in #1167
- Fix multiple Sanity failures in 2.6 by @lugi0 in #1158
- Use must-gather with sha256 digest by @apodhrad in #1169
- Enhancements for Trusty Tests by @nehachopra27 in #1172
- Fix test some LLM UI tests from Smoke by @bdattoma in #1170
- [Fix] Workbenches - fix xpaths for env variables section by @jstourac in #1173
- [Fix] for the window title to accomodate with RHOAI 2.5 by @jstourac in #1050
Enhancements in scripts and CI/CD
- Add
__init__.py
files inutils/
to mark directories as Python packages in PyCharm by @jiridanek in #1098 - Add ruff Python linter and suppress reported issues by @jiridanek in #1099
- Fix various Python lint warnings using ruff auto-fixes by @jiridanek in #1100
- Improve the code quality ruff action by @jiridanek in #1119
- Check for pre-created virtual environment to save time on repeated poetry installs by @jiridanek in #1128
- Declare and use
currentpath
andbasepath
constants in shell script by @jiridanek in #1137 - Removal of unused Polarion scripts by @jstourac in #1174
- Update defaults for test variables generation. by @jstourac in #1096
Misc
- Rename
Force Tags
toTest Tags
due to deprecation by @jstourac in #1134 - Add take-nap example pipeline by @jgarciao in #1162
Other Changes
- Fix 'Operator Subscription Last Condition Should Be' by @manosnoam in #1079
- Add Check for dependent operator(Serverless and servicemesh) if it is Installed or not by @tarukumar in #1080
- Update of the CONTRIBUTING guide. by @jstourac in #1095
- Add support to validate gpu driver ,demonset etc validator pod verifcation after NFD resource are created by @tarukumar in #1090
- RHODS-12892: Parameterize the hive namespace by @apodhrad i...
2.5.0
What's Changed
New Tests
- [RHOAIENG-136] ODS CI tests which run Codeflare E2E by @jiripetrlik in #1054
- Add Kserve UI tests by @lugi0 in #1062
- Ray and Pipelines integration test by @diegolovison in #1057
Enhancements
- fix: Dashboards UI Tests 1775 and 1814 by @FedeAlonso in #1043
- Update dsc default name by @bdattoma in #1045
- Install Kserve Dependency before RHOAI installation starts by @tarukumar in #1052
- [Fix] for datascience project tests for RHOAI 2.5 by @jstourac in #1049
- Keep ReadWriteOnce as a default for storage class by @diegolovison in #1058
- Enable Ray and Codeflare for DW tests by @jiripetrlik in #1060
- Update Model Serving tests for 2.5 by @bdattoma in #1044
- Always describe clusters with ID by @apodhrad in #1056
- Adding keywords for kserve UI testing by @mwaykole in #1061
- [Fix] capital letters for the particular menu sections by @jstourac in #1063
- Update logic to check requests/limits in containers by @lugi0 in #1072
- [Fix] References to RHOAI in Explore page in our tests by @jstourac in #1073
- [Fix] to distinguish between PVC in pending and PVC in bound status by @jstourac in #1070
- [Fix] The test for the expected error message to be shown to the user by @jstourac in #1074
Enhancements in scripts and CI/CD
Other Changes
- Merge changes for RHOAI 2.5 from temporary branch to master by @jstourac in #1042
- install Dependent operator for kserve by @tarukumar in #1039
- Added suite variable for the Dependent operator to be installed from tasks by @tarukumar in #1051
- Skip pre-req install by default in the KServe test suite by @bdattoma in #1053
- Add bucket_name parameter in upload_download sample pipeline by @diegolovison in #1047
- Add additional logs to installation process by @jiripetrlik in #1048
- Remove verification of monitoring pod for modelmserving by @tarukumar in #1055
- [Fix] attempt to stabilize the
Logged Into OpenShift
test by @jstourac in #1065 - Add fix for must gather log by @tarukumar in #1069
- Remove extra brackets by @tarukumar in #1071
Full Changelog: 2.4.0...2.5.0
2.4.0
What's Changed
New Tests
- Test Pipeline YAML context menu and verify read only by @manosnoam in #995
- Verify DSPO Operator Reconciliation Retry by @diegolovison in #981
Enhancements
- FIx install issue for Beta channel for managed rhods by @tarukumar in #1004
- [Fix] indentation of the robotframework keyword by @jstourac in #1001
- Add support for odh nightly with new changes by @tarukumar in #1006
- Fix faulty kserve tests by @bdattoma in #1005
- Fix uninstall for odh by @tarukumar in #1007
- Wait pipeline server button be enabled by @diegolovison in #999
- fix button for model serving in 2.4 by @lugi0 in #1008
- Delete csv for odh-nightly by @tarukumar in #1012
- [Fix] Verify Elyra Pipelines In SDS-Based Images by @jstourac in #1016
- Fix monitoring tests in Smoke for RHODS 2.4.0 by @jgarciao in #1017
- [Fix] Tests.Jupyterhub.test-pipChanges-not-permanent by @jstourac in #1015
- fix capitalization of nvidia gpu accelerator by @lugi0 in #1018
- [Fix] of the xpath for the jupyterlab workbench image version check by @jstourac in #1019
- [Fix] test versions for the RHODS 2.4; add TrustyAI and HabanaAI by @jstourac in #1011
- Update tests to use new Caikit + TGIS images by @bdattoma in #1009
- [Fix] make dry-run happy again by @jstourac in #1020
- Update Monitoring tests for RHODS 2.4.0 RC2 by @jgarciao in #1021
- [Fix] we should click on elements that have some size by @jstourac in #1023
- Increase pipeline run timeout by @diegolovison in #1028
- Increase timeout to wait for No pipeline server by @diegolovison in #1029
- Update Model Serving test tags and skip if component is enabled by @bdattoma in #1010
- Add tag with Polarion test case to DW test by @jiripetrlik in #1024
- Check DS listed project by link instead of xpath by @manosnoam in #1036
- [Fix] custom image tests and one test removal by @jstourac in #1030
- Temporally disable verifications of CodeFlare alerting and recording rules for 2.4 by @jgarciao in #1041
- [Fix] test to check various user group access by @jstourac in #1034
Other Changes
- Add support to create DSC without any conditon for rhods24 by @tarukumar in #996
- Revert "Delete csv for odh-nightly" by @tarukumar in #1013
- RHODS-12410 - Create a Robot framework test for running DW tests by @jiripetrlik in #980
- Removal of "Verify Anaconda in Kfdef" Keyword by @asanzgom in #1025
- Change the DSC name based on new changes by @tarukumar in #1026
- Fix managed by @tarukumar in #1022
- Add check for odh nightly by @tarukumar in #1038
New Contributors
- @jiripetrlik made their first contribution in #980
Full Changelog: 1.34.0...2.4.0
1.34.0
What's Changed
New Tests
- Add option to install KServe stack from Script instead of simulating step-by-step by @bdattoma in #947
- Add support to deploy custom runtime for upgrade testing by @tarukumar in #967
- [RHODS-11955] Verify user can edit name and description in a workbenc… by @jstourac in #942
- Add Custom Serving Runtime UI test suite by @bdattoma in #964
- Automate embedded RHODS install by @lugi0 in #924
- Add watsonx basic deployment tests for additional models by @bdattoma in #974
- Add runtime image upgrade test by @bdattoma in #975
- Add WatsonX metrics test by @bdattoma in #985
- Fix custom image tests by @lugi0 in #988
Enhancements
- Revert "workaround for section header regression (#937)" by @bdattoma in #955
- Fix xpath selectors for workbenches and model serving dropdowns in 1.34 by @lugi0 in #960
- Fix for V2 operator install for rhods1.34 by @tarukumar in #961
- Fix starburst enteprise tests by @bdattoma in #958
- Add version check on Elyra libraries by @lugi0 in #962
- Change the ns to have same config as documented by @tarukumar in #973
- Update OpenShift Pipelines to latest version by @diegolovison in #979
- Make DS Project tests independent by @bdattoma in #978
- Compiled upload download yaml for testing purpose by @diegolovison in #982
- Restore two tensor flow tests into sanity by @bdattoma in #986
- Reduce the scope of the mlpipeline_minio_artifact_secret parameter value and dynamic bucket name for Tekton test by @diegolovison in #987
- Changed oc command to get RHODS version on Common.robot by @asanzgom in #989
- Make the ht password shorter by @apodhrad in #990
- [Stabilize] Let's wait for DOM ready before we start to edit workbenches by @jstourac in #993
- [Fix] name of the robotframework keyword
Set NVidia GPU Accelerator
by @jstourac in #998
Enhancements in scripts and CI/CD
Other Changes
- Fix generating XML for polarion with not passed tests by @kornys in #963
- Increase timeout for end to end pipeline using Kfp_tekton by @diegolovison in #966
- Base image for tekton tests by @diegolovison in #984
- fix: Jupyuterhub, workbench and model serving related tests by @FedeAlonso in #971
- [Fix] Typo in the variable name by @jstourac in #994
- addding rosa as supported env by @mwaykole in #997
New Contributors
Full Changelog: 1.33.0...1.34.0
1.33.0
What's Changed
New Tests
- Add support for model serving in upgrade suite by @tarukumar in #945
- Add support to validate that image provide is based on digest not tags by @tarukumar in #949
Enhancements
- [Fix] Update the expected CUDA version to 12.2 by @jstourac in #917
- Reduce number of IDE errors and wrong imports by @kornys in #913
- [Fix] Update version of numpy to 1.24.4 by @jstourac in #918
- fix culler suite git issues by @lugi0 in #921
- Bump kfp-tekton to 1.5.8 by @diegolovison in #905
- Use 'Create File From Template' KW in 'Compile Inference Service YAML' by @manosnoam in #900
- Update global variables of Prometheus if required by @manosnoam in #903
- Bump kfp-tekton to 1.5.9 by @diegolovison in #932
- Data Science Pipeliens: fix Xpath for Get Workflow Name From Topology Page by @diegolovison in #935
- Update expected external links for Starburst Enterprise test by @bdattoma in #939
- increase scroll amount on env variables section by @lugi0 in #940
- update the locator path for Container size drop down by @tarukumar in #941
- Workaround for Import Pipeline button is ready by @diegolovison in #938
- Fix wrong import of operating system lib by @kornys in #933
- Adding support to look only operator pod in operator namespace by @tarukumar in #950
- Update to Robot Framework 6 by @lugi0 in #923
- util.execute_command() real-time output and ocm.py verbosity level option by @manosnoam in #926
- Fix Openshift Pipelines installation in OCP 4.14 & fix timing issue by @jgarciao in #946
- Small change in README + addition of a flag to open the test reports in a browser after test execution by @jstourac in #936
- Update Smoke Suite by @lugi0 in #948
- fix namespace for odh-nightly by @tarukumar in #954
- [Fix] run_robot_test.sh - OC login and return value by @jstourac in #943
- [Dockerfile] Add fix for using chromium with selenium 4.13 by @bdattoma in #957
- Add sanity tag to DS Project smoke tests by @bdattoma in #959
Enhancements in scripts and CI/CD
Other Changes
- Update nightlies install to V2 by @lugi0 in #912
- Add support to uninstall odh-nightly operator by @tarukumar in #914
- Add fix for odh-nightlies on managed cluster by @tarukumar in #915
- Add Test For Non Admin User for Watsonx stack by @tarukumar in #916
- Multiple fixes for GPU scripts by @manosnoam in #922
- Add support to get the RHODS/ODH dashboard URL during run time by @aloganat in #925
- Rename imageSetRef in hive_osp_cluster_template.yaml by @manosnoam in #899
- Use Addon CatalogSource from openshift-marketplace by @winklerm in #920
- Revert "Use Addon CatalogSource from openshift-marketplace" by @tarukumar in #929
- change placeholder text in model serving path field by @lugi0 in #931
- Workaround for section header regression by @lugi0 in #937
- Fix installation of OpenShift Pipelines by @jgarciao in #944
- Add support for CodeFlare operator in RHODS task by @winklerm in #927
- upgrade to Selenium 4.13 by @lugi0 in #952
- fix the machine pool exiting function by @tarukumar in #956
New Contributors
Full Changelog: 1.32.0...1.33.0
1.32.0
What's Changed
New Tests
- Add test for multiple models served with WatsonX stack in the same namespace by @bdattoma in #876
- Add support for canary roll out by @tarukumar in #883
- Add test for auto scale using Concurrency by @tarukumar in #889
- Add tests for deploying models with multiple replicas by @bdattoma in #885
- Add Test for scale to zero using kserve by @tarukumar in #896
- Add new tests for WatsonX serving stack by @bdattoma in #893
Enhancements
- Enhance the keyword and remove duplicate keyword call by @tarukumar in #884
- Clean unused Floating IPs in Openstack, before creating new ones by @manosnoam in #881
- Add initial support for running tests on Open Data Hub by @jgarciao in #873
- Update the keyword for odh nightlies by @tarukumar in #892
- Update pyyaml to work ods-ci on macos by @kornys in #891
- Modify DSC CR install for 1.32 RC4 by @lugi0 in #890
- fix uninstall for v2 operator by @lugi0 in #888
- Wait 30 seconds to check if pods are equals to 0 when deleting pipeline server by @diegolovison in #895
- Update keyword to work with V1 and V2 operator by @tarukumar in #901
- ODH support - Use namespace global variables & Rename jupyter notebook ids by @jgarciao in #898
- Check rhods-notebooks namespace only when needed after install by @lugi0 in #902
Documentation
- fix: Inconsisten path in Readme by @FedeAlonso in #894
Other Changes
- Support odh-nightlies channel and update operatorhub install logic by @lugi0 in #880
- Add buckets variables in test-variables.yml by @bdattoma in #882
- Upload Download Pipeline Example by @diegolovison in #875
- Bump kfp-tekton to 1.5.6 by @diegolovison in #886
- Update watsonX tests by @bdattoma in #904
- Remove typo in file path for operatorhub install by @lugi0 in #906
- odh nightlies moved to v2 operator by @tarukumar in #911
New Contributors
- @FedeAlonso made their first contribution in #894
Full Changelog: 1.31.0...1.32.0
1.31.0
What's Changed
New Tests
- First round of automation for new serving stack by @bdattoma in #867
- Add test and keyword to deploy and query models by @bdattoma in #868
- First keywords for operator rearch by @lugi0 in #859
Enhancements
- Add oauth login step by @lugi0 in #870
- Add fixes for Jupyter oauth caching and workbenches xpaths by @lugi0 in #871
- Use the 'Jump to section' links to scroll elements into view by @lugi0 in #872
- Improve the teardown not to fail for corner case scenario by @tarukumar in #878
Other Changes
- Fix rhods installation for build 1.31 by @tarukumar in #863
- Verify No Metadata Pods Were Deployed by @diegolovison in #869
- Install OpenShift Pipelines before running the test by @diegolovison in #874
- Change from Smoke to Sanity to reduce noise by @diegolovison in #879
Full Changelog: 1.30.0...1.31.0
1.30.0
What's Changed
Enhancements
- fix uninstall issue with operatorhub by @tarukumar in #854
- Add option to use custom user settings in ods-ci image by @bdattoma in #841
- Import ODHDataScienceProject/Pipelines.resource to fix dryrun by @diegolovison in #847
- Increase workbench timeout in first Elyra test by @lugi0 in #855
- Disable sharing memory usage for temp file by @kornys in #857
- Delete Pipeline Server by @diegolovison in #848
- Fix model framework heading path for RHODS 1.30 by @lugi0 in #862
Other Changes
- Add extra message by @tarukumar in #858
- Add support for rosa cluster creation by @mwaykole in #837
- Fix login to cluster step with right kubeconfig path by @kornys in #861
- Add support to change-components-stage in test-variable by @mwaykole in #866
New Contributors
Full Changelog: 1.29.0...1.30.0