Releases: red-hat-data-services/ods-ci
Releases · red-hat-data-services/ods-ci
1.13.0
What's Changed
New Tests
- Add test cases to check error messages about RHODS groups by @bdattoma in #424
- Add test Verify That The Operator Pod Does Not Get Stuck After Upgrade by @pablofelix in #425
- Add Tests to verify Cuda Image builds in cluster(ODS-444) by @prudhvi-165 in #431
- Add test to verify user can access documentation by @risusing in #331
- Add test to Verify ODS Availability After OpenShift Node Failure by @pablofelix in #432
- Add test to check if Intel images are pinned to a numeric version by @bdattoma in #443
- Add new tests to verify alert RHODS JupyterHub Probe Success Burn Rate by @jgarciao in #450
- Add test to Verify Culler Settings are not overwritten [RHODS-4336] by @tarukumar in #451
Enhancements
- Update tests for RHODS Alerts by @VaishnaviHire in #417
- Add flaky test tags for some TCs in Sanity by @bdattoma in #433
- Fix Tier2 tag in ODS-1303 by @jgarciao in #435
- modify script with new changes in latest rhods version by @tarukumar in #434
- Fix issue while getting token for prometheus by @aloganat in #438
- Add gpu details for ods 488 by @tarukumar in #442
- Add header to GET request by @bdattoma in #445
- Update addon ID for GPU addon by @lugi0 in #447
- Change nfd operator name by @lugi0 in #448
- Fix usage data collection flaky test by @jgarciao in #437
- Slim down Sanity moving some tests to Tier2 (execution time > 15 mins) by @jgarciao in #453
- Wait until cuda builds are Completed in deployment test by @jgarciao in #452
Enhancements in scripts and CI/CD
Documentation
- Adding README to ocm script by @mrrajan in #246
- Update example file for test-variables.yml by @bdattoma in #439
Misc
- Dockerfile: expose utils/scripts/testconfig/test-variables.yml as test-variables.yml.model by @kpouget in #426
Other Changes
New Contributors
Full Changelog: 1.12.0...1.13.0
1.12.0
What's Changed
New Tests
- Add test to Verify Git Plugin by @risusing in #337
- Verify Monitoring Stack Is Reconciled Without Restarting The ODS Operator by @rkamble5 in #391
- Add test to verify dashboard's favorite resource cards behavior (ODS-389) by @pranavsuryaw in #367
- Verify JupyterHub DB Is Shipped And Enabled Within ODS by @pablofelix in #396
- Add Tests to Verify Empty User Groups Doesn't Allow Users to Spawn Notebooks(ODS-572) by @prudhvi-165 in #332
- Verify PostgreSQL Is Not Deployed When AWS RDS Is Enabled by @pablofelix in #398
- Verify JupyterHub Receives Credentials And Creates Instance Of AWS RDS by @pablofelix in #401
- Add test to verify that Odh-deployer Checks Cluster Platform Type by @pablofelix in #411
- Check enabled page is loading after uninstalling operator by @rkamble5 in #415
- Add Test To Verify Cuda Is Succesful In PSI Clusters(ODS-481) by @prudhvi-165 in #420
- Added Tests to Verify Notifications Are Shown When Notebook Builds Are Not Started(ODS-1347) by @prudhvi-165 in #323
- Add tests to Verify CPU and Memory requests for the CUDA and Image Pods(ODS-313) by @prudhvi-165 in #400
- Add Tests to Verify Failing Notebook Names Are Shown In Notifications(ODS-470) by @prudhvi-165 in #260
New Tasks
- Add ODS-543 label by @pablofelix in #423
Enhancements
- Add Test To Verify If Pachyderm Pipeline Can Be Created Using Jupyterlab by @risusing in #322
- Fix test "Verify That MT-SRE Are Not Paged For Alerts ..." with new keyword "Get Cluster Name From Console URL" by @tarukumar in #395
- Add fix for RHOSAK e2e test case by @bdattoma in #394
- Modify keyword to fetch the name and added retrun to the notification… by @tarukumar in #397
- Fix some test Tags, Documentation and Title by @bdattoma in #399
- Remove version check from ODS-1165 by @bdattoma in #403
- Reenable url-parse check by @lugi0 in #416
- Fix error in Smoke test of Anaconda by @bdattoma in #414
- Add timeout in select explore keyword for monitoring in grafana by @pablofelix in #422
- Update GPU add-on testing for new SKU by @lugi0 in #412
- Added steps to disable csvcopy to diable by @tarukumar in #413
Enhancements in scripts and CI/CD
Misc
- Fix Dockerfile by @fcami in #404
- Add Tests to Verify Tensorflow GPU(ODS-474) by @prudhvi-165 in #410
- venv: only create when absent by @fcami in #407
- Small changes in Sanity by @bdattoma in #421
Other Changes
- Add func in ocm.py to Automated Trigger smoke sanity with candidate version by @mwaykole in #371
- Disable npm check for 1.12 by @lugi0 in #402
- Add test to ensure users can log into RHODS using LDAP after they configure it as an identity provider (ODS-532) by @prudhvi-165 in #408
New Contributors
Full Changelog: 1.11.0...1.12.0
1.11.0
What's Changed
New Tests
- Add Grafana test to verify if it is shipped and enabled by @pablofelix in #347
- Verify that Blackbox exporter is shipped and enabled within RHODS by @pablofelix in #357
- Verify that Dashboard is shipped and enabled within RHODS by @pablofelix in #352
- Verify Traefik Proxy is deployed in HA by @pablofelix in #354
- Verify Alert Manager Is Shipped And Enabled Within ODS by @pablofelix in #359
- Added Tests to Verify MT-SRE Can Connect To Prometheus , Alert Manager Using OpenShift Port-Forwarding by @prudhvi-165 in #348
- Add jupyterhub test tag by @pablofelix in #356
- Add test cases for testing QuickStart worflows by @bdattoma in #364
- Add Tests to verify Grafana Connected to Prometheus using TLS(ODS-963) by @prudhvi-165 in #340
- Verify pushing project changes to a git repository [ODS-326] by @pranavsuryaw in #276
- verify rhods-dashboard cluster role by @pablofelix in #365
- Add test to verify JupyterHub leader monitoring using RHODS Prometheus(ODS-689) by @rkamble5 in #320
- Verify that Prometheus is shipped and enabled within RHODS by @pablofelix in #353
- Calculates avg time taken by server to start by @pranavsuryaw in #314
- Add performance test by @tarukumar in #379
- Checking for oauth container ODS-355 by @pranavsuryaw in #369
- Verify CPU And Memory Requests And Limits by @pablofelix in #360
- Add test to Verify Telemetry Data Is Accessible from jupyterhub/api page by @rkamble5 in #368
- Add test case to "Verify That MT-SRE Are Not Paged For Alerts In Clusters Used For Development Or Testing" (ODS-1058) by @rkamble5 in #370
Enhancements
- Anaconda image name change in v1.11 by @lugi0 in #362
- Changes in ods-1227(verify alert severity) by @rkamble5 in #361
- Added code to verify the default size by @tarukumar in #373
- Update tensorflow version check in minimal image by @lugi0 in #375
- fix RHOSAK test case after changes in UI by @bdattoma in #374
- added pattern to check failed entry by @tarukumar in #377
- update ods-ci container to install python3.8 and use RH ubi image by @bdattoma in #372
- Update ODS-CI container with new features by @bdattoma in #378
- Add ods-ci serviceaccount variables to test-variables yaml by @bdattoma in #382
- Sec update for ODS-CI by @bdattoma in #380
- Add keyword to check for npm library installed version in container by @lugi0 in #381
- Fix "Verify JupyterHub Deployment" for RHODS < 1.12 by @lugi0 in #384
- Fix "Usage Data Collection" test. Add keyword "Save Changes In Cluster Settings" by @jgarciao in #383
- Fix automation bug in "Verify RHODS operator information" (ODS-644) by @pablofelix in #385
- Fix configuration of autogeneration of release notes by @jgarciao in #351
- Fix "Test Metric "Notebook CPU Usage" (ODS-178) when cpu usage is null by @rkamble5 in #387
- fix ODS-293 by adding wait for rollout to start by @bdattoma in #388
- Miscellaneous fixes for ods-ci 1.11.0 by @jgarciao in #386
- Update tags for nvcc TC by @lugi0 in #393
Documentation
Other Changes
- Add test cases for metrics in OpenShift Monitoring: notebook cpu usage, rhods_total_users and rhods_aggregate_availability (RHODS-3288) by @rkamble5 in #312
Full Changelog: 1.10.0...1.11.0
1.10.0
What's Changed
New Tests
- Add tests to Verify A Default Image Is Provided And Server Starts Successfully(ODS-469) by @prudhvi-165 in #311
- Add Tests to Verify NVCC Version in Minimal Cuda Image(ODS-483) by @prudhvi-165 in #315
- OSD sandbox test case by @tarukumar in #304
- Add Tests to Verify Package Versions in Notebooks(ODS-468) by @prudhvi-165 in #290
- Add test to check access, Gid, Uid of /opt/app-root/lib and /opt/app-root/share (ODS-486) by @pranavsuryaw in #288
- Add testcases for Prometheus metrics "Notebook CPU Usage", "Rhods_Total_Users" and "Rhods_Aggregate_Availability" (ODS-178, ODS-628, ODS-636) by @rkamble5 in #281
- NB culler test cases by @lugi0 in #295
- Add test to check dynamic update of available GPUs by @lugi0 in #310
- Add test case to verify filters in RHODS Dashboard resources page (ODS-489) by @rkamble5 in #286
- Add Test to Verify that MT-SRE can connect to Grafana using port-forwarding by @mwaykole in #306
- Add testcase Alert notification emails can be updated but changes don't get updated in alertmanager configuration by @rkamble5 in #296
- Add Test to Verify Default Access Groups Settings And JupyterLab Notebook Access (ODS-1164) by @prudhvi-165 in #244
- Verify Tensorflow Can Be Installed In The Minimal Python Image Via Pip [RHODS-3350 ODS-555 ODS-908 ODS-535] by @pranavsuryaw in #262
- Add Tests to Verify "Notebook images are building" is not shown when no images are building(ODS-307) by @prudhvi-165 in #319
- add test cases to verify custom notebooks by @lugi0 in #317
Enhancements
- Add email report feature to ods-ci plus RF task compatibility by @bdattoma in #307
- By default, disable email report by @jgarciao in #324
- pvc save changes button by @tarukumar in #316
- change notbook size by @tarukumar in #330
- add jq to test container image by @jbpratt in #313
- add Tier tag to ODS-1226 by @bdattoma in #338
- Add logic to hide variables values from sensitive keyword by @bdattoma in #248
- Replacing load witrh safe_load for yaml lib by @mwaykole in #334
- Close all browsers before starting minimal CUDA test by @lugi0 in #342
- Modify update_notification_email_address keyword so that it doesn't stop test execution on errors by @tarukumar in #341
- Update culler wait strategy by @lugi0 in #344
- Fix some automation bugs in Tier2 by @bdattoma in #343
- remove explicit secret creation from RHOAM Interop test by @bdattoma in #329
- Fix CUDA suite setup failure by @lugi0 in #350
Enhancements in scripts and CI/CD
- Add script to upload results in report portal by @aloganat in #321
- Workaround fix for idp discovery issue by @aloganat in #326
- Add support to provide notification email during rhods installation by @aloganat in #349
Documentation
New Contributors
Full Changelog: 1.9.0...1.10.0
1.9.0
What's Changed
New Tests
- Add test case to verify jupyterlab and notebook version in Anaconda i… by @risusing in #284
- Add test to verify if users can use custom rhods groups to access JH by @bdattoma in #208
- Add test for RHODS/RHOAM install and unistall scenarios by @bdattoma in #239
- Added Tests to Verify JupyterHub Pod Logs Dont Have Errors About Distutil Library(ODS-586) by @prudhvi-165 in #252
- Added tests to Verify A Default Image Is Provided And Starts Successfully(ODS-469) by @prudhvi-165 in #250
- Add test to verify if Pachyderm can be installed using OpenShift console by @risusing in #275
Enhancements
- Fix bug in test to verify GPU learning resources in RHODS Resource Section by @risusing in #294
- precise timeout for JH Deploy by @tarukumar in #301
- Fix build alert tests adjusting the expected alert timeout by @jgarciao in #291
Enhancements in scripts and CI/CD
- Add email address to addon notification field by @tarukumar in #297
- Fix and update ods-ci to run in container by @bdattoma in #205
Misc
- Add keyword for setting addon notification email by @tarukumar in #299
Other Changes
- Revert "Added tests to Verify A Default Image Is Provided And Starts Successfully(ODS-469)" by @lugi0 in #308
- Add Smoke tag by @lugi0 in #309
Full Changelog: 1.8.0...1.9.0
1.8.0
What's Changed
New Tests
- Add new tests for alerts (DeadManSnitch and SLO) by @jgarciao in #226
- [Test/lib]capture and verify if kfdef event is streaming in openshift or not by @tarukumar in #213
- implement verification for jupyterlab server pods spawning in the rhods-notebooks namespace by @pranavsuryaw in #229
- Add test case for verifying if pachyderm is installed by @risusing in #228
- Add test for backend of custom notebook images by @lugi0 in #233
- Add test for verifiying alert severity by @lucferbux in #242
- Add Test Pager Duty Secret Verification by @milindw96 in #245
- Add test to check blackbox_exporter is protected with auth-proxy(ODS-1090) by @rkamble5 in #251
- Add test to check JupyterHub version >=1.5,<2.0 by @lugi0 in #257
- Verify documentation link from dashboard [ods-327 , ods-492] by @pranavsuryaw in #197
- Added test case to verify starburst beta text have been removed, chan… by @risusing in #261
- Add tests to verify access to the dashboard settings and Usage Data Collection by @jgarciao in #264
- Add test to verify RHODS Release version number(ODS-478) by @prudhvi-165 in #240
- Add Test to Verify git plugin by @pranavsuryaw in #256
- Add test to verify Login Page Appears While Reaching RHODS Page by @risusing in #273
- Add test to verify Oath-Proxy Image is fetched From CPaaS by @risusing in #270
- Add tests to verify logged in users is displayed in dashboard (ODS-354) by @prudhvi-165 in #199
- Verify GPU Items Appears In Resources Page by @risusing in #272
- Verify functionality for multiple GPUs in same cluster [RHODS-3190] by @lugi0 in #280
- Add test case for backend and ui of PVC change by @tarukumar in #282
Enhancements
- Use "Fix Spawner Status" in between server teardowns by @lugi0 in #237
- Fix keyword conflict for post-install by @lugi0 in #235
- Fix HCC Splash page on login and increased timeout to check card existence on Enabled page by @bdattoma in #253
- Change User Server Cleanup Keyword by @lugi0 in #255
- Change requirements to robotframework 4.* (and not 5.x) by @jgarciao in #277
- Skip alert severity test for RHODS < 1.9.0 by @jgarciao in #267
- Add machine pool if the machine pool not exists with given name by @aloganat in #283
- Add Execution-Time-Over-30m to build alert tests + small enhacenments by @jgarciao in #287
Enhancements in scripts and CI/CD
- Add ldap-admin users as dedicated-admins when creating test clusters by @pablofelix in #258
Other Changes
- Add support to install gpu addon and to create machine pool by @aloganat in #230
- Add test to verify users get notifications if storage capacity limits get exceeded (ODS-539) by @pranavsuryaw in #227
- Add JH tag by @lugi0 in #254
- Add tier1 tag in the TC by @milindw96 in #285
New Contributors
- @pranavsuryaw made their first contribution in #229
- @risusing made their first contribution in #228
- @prudhvi-165 made their first contribution in #232
Full Changelog: 1.7.0...1.8.0
1.7.0
What's Changed
New Tests
- Refactoring, GPU Keywords, minimal CUDA test by @lugi0 in #206
- Add new test case to check disabled cards in ODS Dashboard by @bdattoma in #209
- Add test case to verify OOM kill by creating multiple namespace in openshift by @tarukumar in #204
- Verify that Prometheus image is a CPaaS built image with oc(ODS-734) by @rkamble5 in #225
- Automated test for text formatting bug - RHODS-3149 by @bdattoma in #216
- Add new test case for traefik proxy pod container restart count by @tarukumar in #219
New Libraries
- Add keyword to Install import package and Test to verify Pip Changes by @milindw96 in #202
Enhancements
- Fix failures in library version check TC by @lugi0 in #215
- change tier tags for AiApps installation test cases by @bdattoma in #214
- add three additional test users to test-variables for automating ODS-293 by @bdattoma in #212
- Add support to remove disabled card for ovms and aikit by @tarukumar in #211
- Add some polarion IDs and KnownIssues tags to Dashboard/AiApps TCs by @bdattoma in #218
- Fix for spawner failures in 1.7 automated runs by @lugi0 in #217
- Remove Anaconda Teardown for Smoke TCs by @bdattoma in #220
- Fix compatibility issue with OCP4.10 discovered in Anaconda TCs by @bdattoma in #220
- Refactor prometheus alerts. Lint and check robocop rules by @jgarciao in #221
- Add Polarion ID for CUDA TC by @lugi0 in #223
Documentation
Misc
Other Changes
- request and limit size verification by @tarukumar in #193
New Contributors
Full Changelog: 1.6.0...1.7.0
1.6.0
What's Changed
- Add olm installation by @pablofelix in #152
- ignore teardown failure on Splash Page by @bdattoma in #178
- Basic keyword to work with Marketplace by @tarukumar in #163
- Added TC to check error in rhods operator logs by @tarukumar in #174
- update test-variables example file by @bdattoma in #192
- Hotfix patch for rhods operator by @tarukumar in #187
- created new PR to have both Tcs AIKIT/openvino by @tarukumar in #181
- Implementation of ODS-488 by @bdattoma in #183
- delete empty directory by @bdattoma in #194
- Add robocop & robotidy configuration and document usage by @jgarciao in #195
- Disable RenameKeywords transformer in robotidy.toml by @jgarciao in #200
- Unify version check TC by @lugi0 in #184
- integrate RHOSAK TC for new UI changes by @bdattoma in #190
- Integrate ACE and RHOSAK TCs with new feature to remove disabled cards from dashboard by @bdattoma in #189
Full Changelog: 1.5.0...1.6.0
1.5.0
What's Changed
- Added Keyword in Teardown to reset Setting for ACe using OpenShiftCLi by @tarukumar in #132
- Fix polarion update script to handle multiple instances of testcases by @aloganat in #153
- Refactoring ocm.py wrt usability by @aloganat in #150
- Fix uninstall addon check in ocm.py by @aloganat in #156
- Update JupyterLab version by @VaishnaviHire in #126
- Add support to pick versions from channel group by @aloganat in #157
- Fix PVC alert test teardown by @jgarciao in #158
- remove logout keyword from Jupyterlab Git Notebook test case by @bdattoma in #155
- fix select region html id for RHOSAK ODS-242 by @bdattoma in #154
- Added ODS-498 for text verification by @tarukumar in #124
- Add script to check plugin image changes by @tarukumar in #142
- add rhosak test configs in testvariables by @bdattoma in #161
- Add support to create vm instances in openstack by @aloganat in #160
- Upgrade pip to latest version by @aloganat in #164
- to handle the failure occurs for smoke by @tarukumar in #167
- [WIP] 1.3 new UI by @lugi0 in #125
- Added code to show missing plugins by @tarukumar in #168
- Adapt test ODS-175 to RHODS-1.5.0 by @jgarciao in #169
- Use branch "main" when cloning pylero by @jgarciao in #173
- Automation of RHOSAK UseCase by @bdattoma in #141
- remove ODS-242 from suite by @bdattoma in #176
- Catch ValueError exception in GTE keyword on invalid SemVer by @LaVLaS in #175
- Make pvc alert test teardown more robust by @jgarciao in #177
- Add precise wait for spawner being ready by @lugi0 in #170
- Enabled images check by @lugi0 in #171
- Update
Spawn Notebook With Arguments
and related TCs by @lugi0 in #172 - remove wait for JL splash page and kernel popup from RHOSAK test by @bdattoma in #179
- Fix failing spawn keyword by @lugi0 in #180
Full Changelog: 1.3.0...1.5.0
1.3.0
What's Changed
- Fixes for 1.3 sanity run (python ver, new doc keyword) by @lugi0 in #133
- Add support to get osd version by @aloganat in #131
- version compare keyword by @lugi0 in #137
- Update polarion tags and Python version check (tensorflow+pytorch) by @lugi0 in #127
- Add prefix to RequestLibrary.Get & Fix PVC alert error by @jgarciao in #140
- Drop .z check from python version by @lugi0 in #143
- HA components test by @lugi0 in #130
- Add tag selector option by @pablofelix in #146
- add keyword to open sidebar before clicking on root folder icon by @bdattoma in #121
- Automate RHOSAK Enablement and Launch - ODS-392 by @bdattoma in #128
- Automate test case to Enable and Delete a Kafka Stream (ods 242) by @bdattoma in #134
- Fix pvc alert teardown by @jgarciao in #144
- Update Polarion IDs due to document cleanup by @lugi0 in #148
- enhancement of some keywords to fix anaconda TC by @bdattoma in #145
- Remove PVC alerts from Smoke and Sanity by @jgarciao in #151
- Open RHODS apps using hyperlink instead of dropdown by @samuelvl in #149
New Contributors
Full Changelog: 1.2.0...1.3.0