2.16.0

What's Changed

New Tests

• Add TC Check value for serverless cert on CSV by @asanzgom in #2010
• Add negative test for dashboard RBAC on Model Registry by @lugi0 in #2039
• Add Operator DSC Workbenches Component Tests by @mattmahoneyrh in #2072

Enhancements

• Fix Pipelines upgrade test by @jgarciao in #1971
• Change pipeline in order to make the test also working on airgap environment by @diegolovison in #1973
• Increase timeout when waiting for pipeline server to be created by @jgarciao in #1976
• Add checks for RHOAIENG-15033 bug in post upgrade scenario by @lugi0 in #1979
• Fix 0410__ods_dashboard_projects Suite Setup and Tags by @manosnoam in #1933
• update vllm cuda runtime image based on rc2 by @tarukumar in #1985
• RHOAIENG-11849 Refactor is required for edit DSP form by @ConorOM1 in #1964
• Update images used in the pipeline GPU tests to use RHOAI 2.15 workbench runtimes by @jgarciao in #1993
• Don't fail GPU Operators install script if RHOAI is not present by @bdattoma in #1968
• [Fix] the modal window checks when stopping a workbench by @jstourac in #2013
• Update DW-Rocm tag by @bdattoma in #2019
• RHAOIENG-15527: enhance ODS-1877 to use data-testid by @ConorOM1 in #2021
• Hotfix/validate service mesh control plane already created by @asanzgom in #2024
• Chore: Added sleep and timeout for while loop by @asanzgom in #2029
• Fix dashboard RBAC issue, fix cli timing issue for Model Registry smoke tests by @lugi0 in #2026
• fix: new Connection Types feature issues by @FedeAlonso in #2034
• post upgrade starting version check for Model Registry by @lugi0 in #2044
• [fix] the vscode minimal check by @jstourac in #2067
• Update the way how to remove environment variables for Jupyter ntb by @jstourac in #2068
• Update new runtime imaged based on RC2 by @tarukumar in #2069
• Fix dsp post upgrade. Add keyword "Skip If Operator Starting Version Is Not Supported" by @jgarciao in #2073

Other Changes

• fix: add statement to approve the installplan when a new operator is being installed by @CFSNM in #1963
• Removing Python Client Keyword by @tonyxrmdavidson in #1974
• enhancement: move dsc keywords to separate robot file by @CFSNM in #1984
• This PR adds a sleep to allow the DSC model-registry flag setting to Managed to be implemented by @tonyxrmdavidson in #1983
• Test Case check for correct component images by @asanzgom in #1965
• Re-organise the Model Registry Tests by @tonyxrmdavidson in #1992
• Add wait for deployment ready by @asanzgom in #1996
• Add workaround for TestHeterogenousClustersOauth test by @jiripetrlik in #1975
• Automation tests for keras rest model for triton by @rpancham in #1841
• Update codeflare-sdk tests to run against Python 3.11 and 3.9 version by @Srihari1192 in #1986
• Modify available OCP versions logic by @omrirh in #1991
• Added While Loop to wait until Kw succeeds to get installplan name by @asanzgom in #1997
• Update to Model Registry Smoke Test to remove the need for the Sleep 90s keyword by @tonyxrmdavidson in #1998
• Exclude must gather test case on disconnected by @asanzgom in #2005
• DW: Add ROCm GPU ray tests by @ChughShilpa in #2012
• Update single serving deploy button name by @rnetser in #2014
• Fix: Dashboard ODS-2206 and ODS-1814 by @FedeAlonso in #2017
• Fix some single model dashboard issues by @rnetser in #2020
• Fix: Dashboard related model serving issues by @FedeAlonso in #2022
• RHOAIENG-15629 - DSC And DSCI Release.Version Attribute ODS-CI test c… by @MarianMacik in #2015
• enhancement: improve component readiness check when operator is being installed by @CFSNM in #2016
• fix: typo in cmp check keyword by @CFSNM in #2032
• Update Codeflare SDK release tag for 2.16 release by @Srihari1192 in #2035
• Fix Test Check Application Switcher Links for OCM by @manosnoam in #2033
• Fix Clean Up Test Project passed value by @rnetser in #2040
• Add new image for runtime in regards to 2.16 by @tarukumar in #2049
• Update DW tests to run with both Python 3.11 and Python 3.9 by @ChughShilpa in #2006
• [UI] Runtime framework selection in model deployment - dropdown is available only if there's multiple selection by @rnetser in #2051
• Raise Timeout to wait for SMCP to be present by @asanzgom in #2063
• fix: increase timeout for the dsci to 180 seconds by @CFSNM in #2064
• DW: Add KFTO Training tests by @ChughShilpa in #2062
• Update fms-hf-tuning image to version v2.1.2 by @sutaakar in #2065
• fix: use cleanup.sh script to uninstall in sm clusters by @CFSNM in #2071
• Add cloud provider during aws cluster creation by @aloganat in #2075
• Add keywords to skip tests on Self managed cluster by @ChughShilpa in #2074

Full Changelog: 2.15.0...2.16.0

2.15.0

What's Changed

New Tests

• Adds a new tests to check the notebook controllers deployments by @jstourac in #1957
• Added Tensorflow model REST protocol test on triton for Modelmesh by @Raghul-M in #1840
• Add pre/post upgrade test for Model Registry by @lugi0 in #1970

Enhancements

• Only upload the openshift CA cert if the cluster is self-managed in MR test by @lugi0 in #1936
• Fix: new start and stop wb buttons by @FedeAlonso in #1953
• RHOAIENG-14857 Update the test to implement data-testids by @ConorOM1 in #1954

Other Changes

• Increase timeout for Iris Pipeline by @diegolovison in #1935
• Automated test to verify AMD GPU's can be used in Data Science Pipelines by @diegolovison in #1932
• Add GPU specific Tags by @bdattoma in #1938
• fix for single serving test by @ConorOM1 in #1934
• Updating Python Client to 0.2.8a1 by @tonyxrmdavidson in #1949
• Update latest Codeflare-SDK release tag by @Srihari1192 in #1950
• Remove generation validation from Pipelines Test by @diegolovison in #1955
• enhancement: adding trustyai coverage for it to be GA in 2.15 by @CFSNM in #1956
• Update images for 2.15 release by @ChughShilpa in #1958
• Automation tests for tensorflow model gRPC RHOAIENG-9052 for triton by @rpancham in #1844
• RHOAIENG-14416 - Implement check for missing tests by @jiripetrlik in #1951
• Add AutomationBug tag to drift tests by @adolfo-ab in #1946
• Update 0110__service_mesh.robot by @asanzgom in #1961
• Update codeflare-sdk python env use by @Srihari1192 in #1960
• fix: minor fix in deployment command to find replicas by @CFSNM in #1962
• [DW] - Update test name by @ChughShilpa in #1966
• Smoke Test for Model-Registry Deploment without UI by @tonyxrmdavidson in #1969

Full Changelog: 2.14.0...2.15.0

2.14.0

What's Changed

New Tests

• RHOAIENG-12725 - Trusted CA Bundle Namespace Exclusion by @mattmahoneyrh in #1797
• Add test for CVE-2024-7557 by @lugi0 in #1816
• Enhance kfp client keywords and add basic DSP acceptance test suite by @jgarciao in #1828
• Added onnx model gRPC protocol test on triton by @Raghul-M in #1790
• Automate Validate ServiceMeshControlPlaneAlreadyCreated Test Case by @asanzgom in #1762
• Add dsp-gpu-nvidia testsuite by @jgarciao in #1842
• Add initial upgrade testing for Data Science Pipelines by @jgarciao in #1869

Enhancements

• fix: DSProjects view wrong xpath by @FedeAlonso in #1801
• Add support for provisioning GPUs from GCP by @bdattoma in #1794
• Remove two Model Serving tests from Smoke by @lugi0 in #1793
• RHOAIENG-12833 - Validate Image Pull Path Is From registry.redhat.io by @mattmahoneyrh in #1809
• Increase cluster provisioning timeout by @bdattoma in #1820
• Update button xpath to work with latest ODH by @lugi0 in #1837
• Updating Model Registry E2E Test to Use the Latest Python Client by @tonyxrmdavidson in #1838
• Set DSCInitialization timeout to 3 minutes if TEST_ENV is CRC by @manosnoam in #1845
• Fix for the Elyra pipeline execution by @jstourac in #1858
• Fix: xpath=//input[@data-testid="resource-manage-project-modal-name"] failure by @ConorOM1 in #1857
• Introduce support for the Jupyter/Elyra 4. by @jstourac in #1859
• RHOAIENG-12022 - Enable DSC Modelregistry Tests To Run On RHOAI by @mattmahoneyrh in #1831
• fix: ODS-2206, wrong pipelines xpath by @FedeAlonso in #1868
• Add ModelRegistry Namespace Check by @mattmahoneyrh in #1862
• Fix check for nvidia-device-plugin-daemonset when deploying NVIDIA operator stack by @bdattoma in #1871
• Shorten the name of a project resource name to pass the check by @jstourac in #1881
• Model Registry e2e UI test + breaking ui changes by @lugi0 in #1879
• Enable Model Registry test in Smoke by @lugi0 in #1883
• Status for the starting workbench doesn't contain three dots anymore by @jstourac in #1884
• Add 2.14 tgis runtime image by @tarukumar in #1889
• Remove kube-rbac-proxy container due to RHOAIENG-13837 by @lugi0 in #1893
• Add new runtime image for vllm by @tarukumar in #1894
• Update the Python version and other requirements for the 2024b OOTB images by @jstourac in #1870
• Increase timeout when saving permissions in Dashboard by @jgarciao in #1897
• Fix the workbench start for the Jupyter 4 (images 2024.2) by @jstourac in #1899
• Dynamically change python target version for MR dependencies by @lugi0 in #1898
• fix: increase logo's timeout by @FedeAlonso in #1904
• fix: ODS-1813 wrong span by @FedeAlonso in #1903
• [Fix] partially reverts #1901 as we should keep using the library keyword by @jstourac in #1905
• Reorganize sample pipelines in "cache-enabled" and "cache-disabled" folders by @jgarciao in #1891
• [Fix] the Jupyter tests for working with git repository by @jstourac in #1909
• Fix user permission tests by @jstourac in #1913
• [Fix] test that checks that Notebook resource has expected size by @jstourac in #1916
• Fix suite 0401__ods_dashboard Tests and Keywords by @manosnoam in #1912
• [Fix] the tests for custom image import by @jstourac in #1920
• [Fix] expected version in the 2024.2 images by @jstourac in #1919
• Fix: Dashboard UI tests by @FedeAlonso in #1922
• [Fix] the test for the package versions on images by @jstourac in #1923
• [Fix] the project selector on the pipelines page by @jstourac in #1929
• [Fix] the tests for the minimal image by @jstourac in #1930
• [Fix] this fixes the negative test for the Anaconda app integration by @jstourac in #1931
• Remove Deprovision on failure from OCP provisioning task by @bdattoma in #1924

Enhancements in scripts and CI/CD

• Fix pip installs in GitHub Actions by @jiridanek in #1926

Other Changes

• Update RHODS to RHOAI on README.md by @asanzgom in #1805
• Added support env variables to run Codeflare and Codeflare-SDK tests … by @abhijeet-dhumal in #1657
• Update to reflect changes in model-registry-operator config files. by @tonyxrmdavidson in #1804
• Bump kfp to 2.9.0 and kfp-kubernetes to 1.3.0 by @diegolovison in #1795
• Added File for triton REST Input by @Raghul-M in #1812
• Automation tests for pytorch model RHOAIENG-9071 for triton by @rpancham in #1814
• Automation tests for pytorch model RHOAIENG-9066 for triton Kserve by @rpancham in #1811
• Fix Verify User Can Validate Scale To Zero test case by @hdefazio in #1788
• Apply workaround for FIPS installation by @apodhrad in #1826
• RHOAIENG-12880 - Split Distributed Workloads test suites by @jiripetrlik in #1818
• Adjusted distributed workloads UI metrics test keyword for post upgra… by @abhijeet-dhumal in #1792
• RHOAIENG-13014 - Rewrite Verify RHODS Operator Logs test by @MarianMacik in #1822
• fix typo in create_project_btn by @lugi0 in #1839
• Add customRayImage test by @ChughShilpa in #1836
• add pre/during/post upgrade tags to be able to use it more efficiently by @kobihk in #1832
• fix: include modelregistry in the dsc template by @CFSNM in #1823
• Add QLoRA sanity test for training operator by @abhijeet-dhumal in #1852
• fix: include model registry condition to wait for ready by @CFSNM in #1855
• Fix Verify User Can Set Requests And Limits For A Model test case in ods-ci by @hdefazio in #1810
• Disable QLoRA sanity test because the required model supported for QL… by @abhijeet-dhumal in #1860
• Add support to provide runtime image dynamically for vllm by @tarukumar in #1863
• Fix dry run by @tarukumar in #1864
• add RESOURCE_EDIT_BTN variable and check for it by @ConorOM1 in #1865
• Disable Test SMCP Already Created by @mattmahoneyrh in #1874
• Removing hard coded auth_provider by @tonyxrmdavidson in #1878
• Add the Resources-GPU tag to a test that requires GPU by @jstourac in #1882
• Update Ray image to latest available by @sutaa...

2.13.0

What's Changed

New Tests

• RHOAIENG-7217 KServe and KServe.Serving management states by @mattmahoneyrh in #1736
• Added onnx model REST protocol test on triton by @Raghul-M in #1737
• caikit standalone embeddings test endpoints for kserve by @nehachopra27 in #1744
• Added onnx model Modelmesh test on triton by @Raghul-M in #1777

New Tasks

• Add support for provisioning GPUs on Azure by @bdattoma in #1740

Enhancements

• Rename some root suite directories to reflect new scrum org by @bdattoma in #1734
• Fix "SKIPPED" status in Post upgrade suite by @bdattoma in #1738
• Create root suite directory for unassigned components and move culler suite under IDE by @bdattoma in #1743
• Disable ModelRegistry Tests On RHOAI by @mattmahoneyrh in #1749
• Check KServer Managment State To Ensure That It Is Not Empty by @mattmahoneyrh in #1751
• [fix] xpaths to couple of elements in dashboard data science projects by @jstourac in #1756
• Fix keyword to watch SM cluster provisioning logs and increase timeout by @bdattoma in #1754
• [fix] xPaths with regards the change in RHOAI 2.13 by @jstourac in #1763
• Refactor Data Science Pipelines Backend Tests introducing new keywords by @jgarciao in #1767
• Fix Verify User Can Change The Minimum Number Of Replicas For A Model test case in ods-ci by @hdefazio in #1765
• Fix variable evaluation in "Verify Model Inference" and associated keywords by @lugi0 in #1773
• Fix JupyterHub tag in special-user-testing test suite by @jgarciao in #1771
• Fix wrong argument in test case, missing argument in keyword call (deployment_mode) by @lugi0 in #1782
• Add additional params for object storage configuration in CreatePipelineServer, fixing tests on disconnected by @jgarciao in #1781
• Use single tier/gate tag, fix robocop complaints in Model Serving Test Suites by @lugi0 in #1778
• Fix pipeline server creation when url ends with / by @jgarciao in #1791
• Increase Trusted CA Bundle Resource Check Timeouts by @mattmahoneyrh in #1796

Other Changes

• Support disconnected environment for Pipeline SDK tests by @diegolovison in #1730
• fix: solve issues when uninstalling and reinstalling serverless operator due to operator group not being removed by @CFSNM in #1739
• Pipeline for Importer Components by @diegolovison in #1723
• fix: use common vars in the oc uninstall keywords by @CFSNM in #1745
• Fix "Verify User Can Access Model Metrics From UWM" test in "Model Serving Llm" suite by @hdefazio in #1755
• Fix DW UI test image to use image digest by @Srihari1192 in #1760
• Added new tests to validate release.name and release.version attributes of a dsc/dsci by @CFSNM in #1750
• Create pipeline run with different user by @diegolovison in #1628
• Update runtime image for 2.13 by @tarukumar in #1766
• fix: rework in some of the operator test cases by @CFSNM in #1761
• Allow to install gpu-operator-certified in disconnected env by @apodhrad in #1639
• Fix for Authorino TC by @mwaykole in #1770
• Update DW UI tests to accommodate changes introduced in 2.13 and instability tests by @Srihari1192 in #1758
• reworking platform tests tagging following the 1-tag approach by @CFSNM in #1769
• fix: increase dsci timeout by @CFSNM in #1774
• Add verification for container images in smoke test by @ChughShilpa in #1759
• Use newer fms-hf-tuning image by @sutaakar in #1775
• fix: solving some issues in the must gather tests by @CFSNM in #1776
• Add Rhods Osd Install Repo to generateTestConfigFile by @asanzgom in #1780
• fix: add rhosi setup as a requirement for post-upgrade setup by @CFSNM in #1785
• [RHOAIENG-11805] Avoid multiple suite tags for IDE tests by @jstourac in #1787
• Update to allow installation of the Python Client without external access by @tonyxrmdavidson in #1779
• Add new runtime image with chat-template for vllm by @tarukumar in #1798
• fix: remove flaky condition to avoid false negative results for the rhods log test by @CFSNM in #1799

New Contributors

• @hdefazio made their first contribution in #1755

Full Changelog: 2.12.0...2.13.0

2.12.0

Fix Test `Verify Documentation Links HTTP Status Code` (#1731)

Signed-off-by: manosnoam <[email protected]>

2.11.0

What's Changed

New Tests

• RHOAIENG-8546 - Platform DSC Modelmeshserving Test Case by @mattmahoneyrh in #1530
• Feat: Authorino UI basic test by @FedeAlonso in #1485

Enhancements

• Set default SR for Kserve to Caikit+TGIS by @lugi0 in #1558
• Force Caikit TGIS SR in UI tests by @lugi0 in #1559
• [vllm/tgis]Add support for amd for model deployment by @tarukumar in #1564
• Adapt Data Science Pipelines tests to changes introduced by Pipeline Experiments by @jgarciao in #1576
• Check that the URL list is not empty before verifying HTTP status by @manosnoam in #1584

Enhancements in scripts and CI/CD

• Update amd script by @bdattoma in #1540
• Generalize GPU provisioning script to ease the addition of new providers by @bdattoma in #1568

Misc

• Move Serving and Pipelines suites out of Dashboard folder by @bdattoma in #1553
• Create IDE test suite directory with proper nested suites by @bdattoma in #1562
• Move ai explainability suite in dedicated directory by @bdattoma in #1575

Other Changes

• Add Upgrade test scenarios for Distributed workloads by @Srihari1192 in #1491
• moved 144 Dsc Negative No Dependant Op to Tier3 by @asanzgom in #1566
• Tag both Operator and ModelRegistry on 112_model_registry by @asanzgom in #1567
• RHOAIENG-3472: Added test to validate the DSC without dependant operator when kserver is unmanaged by @CFSNM in #1556
• update test name in codeflare tests by @ChughShilpa in #1573
• Access job submission as non-admin by @diegolovison in #1571
• Update repo for codeflare tests by @ChughShilpa in #1570
• All pipelines connections are secured by default from the client perspective by @diegolovison in #1577
• Fix Test Verify Resource Link HTTP Status Code by @manosnoam in #1582
• Add granite 7b lab model by @tarukumar in #1579
• Update rhoai 2.11 runtime images by @tarukumar in #1585
• RHOAIENG-7226 - Add TestMnistRayGpu by @jiripetrlik in #1580
• RHOAIENG-2512: Added test to validate the DSC and DSCI when Serverless operator is not installed by @CFSNM in #1574
• RHOAIENG-7919 Istio Kserve Gateway For Internal Endpoint by @mattmahoneyrh in #1583
• Update AppsInfoDictionary_latest.json with the new App: Elasticsearch by @manosnoam in #1590
• Add DW test to verify requested resources in case of multiple local queue exists by @Srihari1192 in #1565

Full Changelog: 2.10.0...2.11.0

2.10.0

What's Changed

New Tests

• RHOAIENG-5435 - Distributed Workloads Components by @mattmahoneyrh in #1392
• RHOAIENG-6627 - Training-Operator test case by @mattmahoneyrh in #1430
• Add base test for vLLM and its metrics by @lugi0 in #1438
• RHOAIENG-7181 Check DW Components are Enabled by Default by @asanzgom in #1502
• Expanded vLLM metrics test by @lugi0 in #1500
• RHOAIENG-7298 - New DSC Component Dashboard and Datasciencepipelines Test Cases by @mattmahoneyrh in #1509
• Add support for embedded endpoint for vllm by @tarukumar in #1511
• RHOAIENG-6517 Automate support for configuration of controller resources by @asanzgom in #1515
• Add Support for vllm model deployment from UI by @tarukumar in #1531
• ODS-2584 Create DSCI and DSC with Service Mesh operator NOT installed by @CFSNM in #1487
• Add embedding model deployment from ui for vllm by @tarukumar in #1548

Enhancements

• [Fix] check for the CUDA version installed on image by @jstourac in #1418
• Add support to uninstall odh-nightly from managed cluster by @tarukumar in #1421
• [fix] Update image used for must-gather test by @jstourac in #1420
• Fix "PLC0415", # import should be at the top-level of a file by @jiridanek in #1423
• Add Test and Kw for authorino by @mwaykole in #1396
• Fix "F403", # from python_terraform import * used; unable to detect undefined names by @jiridanek in #1424
• Parameterize the model deployment for tgis and using ratio to match model response by @tarukumar in #1447
• Add ProductBug tag to tgis metrics test cases by @bdattoma in #1448
• [fix] the test for special usernames by @jstourac in #1451
• [fix] two test that starts Standard Data Science workbench on ODH by @jstourac in #1456
• [fix] expected title of the browser window when running with ODH by @jstourac in #1457
• [fix] the expected network policy content for the ODH execution by @jstourac in #1454
• Bumping timeout or retries to avoid flaky timeless issues by @CFSNM in #1461
• Bumping default retry to 150 in Wait Until Operator Subscription Last Condition Is by @CFSNM in #1470
• Moved API to v2beta1 by @diegolovison in #1480
• RHOAIENG-7580 - Add Pod Ready Check by @mattmahoneyrh in #1478
• Fix "E402", # Module level import not at top of file by @jiridanek in #1483
• Refactor Data Science Pipelines to slim down sanity (Sanity on a diet) by @jgarciao in #1481
• Fix iris-pipeline sample to use the standard_scaler parameter in step normalize_dataset by @diegolovison in #1489
• Update Xpath for AiKit Card by @asanzgom in #1505
• Fix missing poetry run in run_robot_test.sh by @jiridanek in #1496
• [fix] installation of servicemesh dependant operator on managed cluster by @jstourac in #1508
• Modify Pipeline UI test in Smoke to use pip_index_url (making it compatible with disconnected clusters) by @jgarciao in #1507
• Update installation channel for the authorino dependency operator by @jstourac in #1514
• Small two DS project test fixes/stabilization by @jstourac in #1523
• [fix] close browser after each test in 415__ods_dashboard_projects.robot by @jstourac in #1524
• [fix] stabilize the ODS-1864 test by scrolling button into view by @jstourac in #1526
• fix: use activeModelState to wait ISVC status by @FedeAlonso in #1528
• Remove auth from ray by @diegolovison in #1482
• fix: 30s sleep when ISVC is loaded in order to avoid polling treshold by @FedeAlonso in #1534
• [fix] Update must-gather image reference for the RHOAI 2.10 by @jstourac in #1535
• fix: ODS-2574 wrong xpaths by @FedeAlonso in #1539
• fix: Model serving LLM UI tests by @FedeAlonso in #1541
• Simplify pipeline setting pip_index_url and pip_trusted_host by @jgarciao in #1549
• fix: Dashboard tests diet by @FedeAlonso in #1552
• Add sleep to ovms test, skip fail if UWM configmaps already present by @lugi0 in #1557

Enhancements in scripts and CI/CD

• Add script to fetch new test cases by @bdattoma in #1459
• Add option in fetch_new_test.py to automatically fetch previous release branch by @bdattoma in #1474
• Add tagger date and version:refname sort attribute for fetching releases branches by @bdattoma in #1503
• fix: wait for kserve inference host via cli by @FedeAlonso in #1518
• Add Dashboard tag to Dashboard related suites by @FedeAlonso in #1529

Misc

• [fix] disable the custom manifest support temporarily by @jstourac in #1458
• [Jupyter] RHOAIENG-7490 update test tags - remove many from Sanity by @jstourac in #1471
• Add support for amd operator installation by @tarukumar in #1498
• Finalize WIP task for fixing outstanding linter warnings by @jiridanek in #1497
• Add a trainingoperator component to the DSC template list by @jstourac in #1519
• Add SeaLights integration files and deps. Configure SonarCloud inclusions/exclusions by @jgarciao in #1533

Other Changes

• After filling the form, Create a Run button element should be enabled by @diegolovison in #1415
• Select project before checking the pipeline run status by @diegolovison in #1416
• Create kueue resources for the project by @diegolovison in #1414
• Increase the dsci timeout by @tarukumar in #1422
• Explicit move to Applications Enabled page by @diegolovison in #1432
• Add tag for Model Registry test to execute only on ODH for now by @nehachopra27 in #1426
• Include Git mirror details into test-variables.yaml by @apodhrad in #1434
• Properly set multiline custom CA Bundle by @apodhrad in #1433
• Add Training operator smoke tests to DW stack by @sutaakar in #1436
• Update codeflare-sdk tests to run against latest release tag by @Srihari1192 in #1435
• Skip Training operator smoke tests until brought to RHOAI by @sutaakar in #1446
• Fix "FA100", # Missing from __future__ import annotations, but uses typing.Optional by @jiridanek in #1441
• Fix "E721", # Use is and is not for type comparisons, or isinstance() for isinstance checks by @jiridanek in #1443
• Add python-Levenshtein to remove fuzzywuzzy warning by @tarukumar in #1450
• Add Polarion test cases for DW smoke tests by @jiripetrlik in #1449
• Fix "F841", # Local ...

2.8.0

Note: the original release date was March 15, 2024 against 1ce419d commit but we updated this so the required back-ported changes are part of this release.

What's Changed

New Tests

• Add TGIS test for fetching model from Minio object storage by @bdattoma in #1231
• adding TC for model serving setting page by @mwaykole in #1076
• Add TGIS test for bigscience/mt0-xxl model by @bdattoma in #1244
• Add support for flan-t5-xl model by @tarukumar in #1252
• Add test for flant5-xxl by @tarukumar in #1254
• Feat: Accelerators Profile Administration UI e2e Tests by @FedeAlonso in #1209
• Add test for ELYZA-japanese-Llama-2-7b-instruct by @bdattoma in #1253
• Add flan-ul test case by @tarukumar in #1261
• Add test for ibm/mpt-7b-instruct2 model by @lugi0 in #1258
• add codellama-34b-instruct-hf test by @lugi0 in #1263
• Add query to ModelInfo and Tokenize endpoints by @bdattoma in #1266
• adding TC for llama-2-13b-chat by @mwaykole in #1267
• Add test for deploying and querying a prompt-tuned google/flan-t5-xl LLM by @bdattoma in #1272

Enhancements

• RHOAIENG-23 - Cleanup CodeFlare installation code by @jiripetrlik in #1180
• Stabilize Dashboard Test Suite (415) by @manosnoam in #1235
• Improve utils.execute_command, add a Pytest selftest for it, and run it in GHA by @jiridanek in #1243
• Set namespace for dummy-storage-creds.yaml by @diegolovison in #1256
• Fix the issue with model path by @tarukumar in #1264
• For purley Kserv raw deployment teardown will fail when OSSM operator and resources are not deployed by @tarukumar in #1265
• Fix for Multi-Attach error PVC by @tarukumar in #1268
• FIx: Automation Issues from 2.8 RC1 Sanity execution by @FedeAlonso in #1274
• fix: ODS-282 Verify Content In RHODS Explore Section by @FedeAlonso in #1280
• fix: ODS-1226 Open links by @FedeAlonso in #1282
• fix: ODS-1718 update endpoint by @FedeAlonso in #1286
• Add baseline 40Gi memory request to all llm models by @lugi0 in #1278
• fix: get started and cards related tests by @FedeAlonso in #1292
• Make feature tests running on GPU and Default Raw by @bdattoma in #1277
• Fix for model response file by @tarukumar in #1294
• [Fix] Uninstallation of the RHOAI operator by @jstourac in #1245
• fix: Verify successful pipeline via UI from Pipelines->Runs view by @FedeAlonso in #1303
• Enforce the client to use a valid certificate by @diegolovison in #1285
• fix: Add productBug tag to ODS-282 by @FedeAlonso in #1304
• Backport required changes from master to releases/2.8.0 by @jstourac in #1318

Enhancements in scripts and CI/CD

• fix rosa deployment by @kobihk in #1232

Other Changes

• Fix in ocm.py for interop pipeline by @mwaykole in #1233
• update the log error messages and execute of cmd and output by @kobihk in #1234
• Reenable Kueue tests by @jiripetrlik in #1236
• increase the delete cluster timeout by @kobihk in #1238
• use cluster_id instead of cluster_name with ocm command by @kobihk in #1237
• Reapply "Add support for kueue component" by @jstourac in #1246
• add support for latest rosa version by @kobihk in #1242
• Add deployment mode support for kserve in DSC by @tarukumar in #1248
• Raise the timeout for wait of the CatalogSource to be ready. by @jstourac in #1250
• Remove Trusty tests from Sanity and Tier1 by @nehachopra27 in #1255
• RHOAIENG-3768 - Define or implement Sanity tests for KubeRay by @jiripetrlik in #1251
• Add sanity test for kueue by @ChughShilpa in #1249
• fix: New xpath on model serving runtime selection dropdown by @FedeAlonso in #1257
• Revert "Fix for Multi-Attach error PVC" by @tarukumar in #1270
• Change tier1 tag for llm model by @tarukumar in #1269
• Add tag Tier2 to kueue e2e tests by @ChughShilpa in #1262
• add existing e2e test as a sanity test for codeflare by @abhijeet-dhumal in #1260
• Delete model downloader pod after model is downloaded by @tarukumar in #1271
• Add Kserverarwa support by @tarukumar in #1273
• Wait for Hive Provision status ProvisionFailed=False up to 15 minutes by @manosnoam in #1279
• adding model-info and tokenize to the TC RHOAIENG-3483 by @mwaykole in #1281
• remove Known Issues Tags by @asanzgom in #1288
• [RHOAIENG-3757] DW: Reduce time of setting up of e2e tests by @sutaakar in #1283
• Select only worker nodes by @ChughShilpa in #1284
• update the hive workaround to support the new hive by @kobihk in #1287
• RHOAIENG-4488 - Remove test-run-dw-tests.robot by @jiripetrlik in #1291
• RHOAIENG-3767 Implement Smoke tests for DW components by @jiripetrlik in #1290
• Store DSC CR in case waiting for component fails by @sutaakar in #1297
• Extend the timeout waiting for component to be enabled by @sutaakar in #1300
• [RHOAIENG-3757] DW: Reduce time of setting up of e2e tests by @sutaakar in #1293
• Modify the env name with actually parameter name by @tarukumar in #1299
• fix: add productbug tag to ODS-1969 by @FedeAlonso in #1298

New Contributors

• @abhijeet-dhumal made their first contribution in #1260
• @sutaakar made their first contribution in #1283

Full Changelog: 2.7.0...2.8.0

2.8.2

What's Changed

Enhancements

• Update the tgis runtime for rhoai_2_8_z by @tarukumar in #1417
• Backport some of the changes from master to 2.8 by @jstourac in #1419

Full Changelog: 2.8.1...2.8.2

2.9.0

What's Changed

New Tests

• RHOAIENG-3425 - Validate Trusted CA Bundle by @mattmahoneyrh in #1310
• RHOAIENG-2519 Service Mesh Test Case by @mattmahoneyrh in #1336
• RHOAIENG-2508 ODS-2600 Validate DSC creates all Serverless CRs by @asanzgom in #1259
• RHOAIENG-5092 - Validate Authorino Resources by @mattmahoneyrh in #1346
• Add check on containers list for KServe model deployments by @bdattoma in #1400
• RHOAIENG-4500 Model registry Operator Deployment by @nehachopra27 in #1295

New Tasks

• Add Provisioning ability for IBM Cloud Self-managed by @bdattoma in #1335

Enhancements

• Install Authorino Operator as a prerequisite for RHOAI 2.9+ by @jstourac in #1289
• Fix deletion confirmation message change in RHOAI 2.9.0 Dashboard by @jiridanek in #1301
• Adding link to ticket bugs in some tests by @bdattoma in #1296
• Fix Dashboard Tests for ODH and RHOAI 2.9 by @manosnoam in #1308
• [Fix] request body logged content by @jstourac in #1316
• [Fix] cleanup for the dashboard api tests by @jstourac in #1317
• [Fix] Notebook API test by @jstourac in #1306
• Migrate pipelines tests to DSPv2 (pipelines-api, pipelines-kfp) by @diegolovison in #1312
• Migrate to pipeline v2 by @diegolovison in #1322
• Reuse KW Wait For Dashboard Page Title in more tests by @manosnoam in #1321
• Use cluster id while adding machinepool by @tarukumar in #1324
• Fix linter errors in DataSciencePipelinesKfp.py and ray_integration.py by @jiridanek in #1325
• Migrate to pipeline v2 (DataSciencePipelinesKfp) by @diegolovison in #1328
• Add support to open also ODH via application list by @jstourac in #1319
• Fix linter errors in iris_pipeline.py by @jiridanek in #1332
• Exclude AI apps tests on ODH since these are irrelevant there by @jstourac in #1338
• Open Data Science Project Details Page also switch to a requested tab by @manosnoam in #1333
• Update new runtime image for tgis with snyk fixes by @tarukumar in #1340
• [RHOAIENG-5073] Add pod port fowarding for raw due to headless service by @tarukumar in #1343
• Update dashboard tests "415" by @manosnoam in #1344
• Update Keywords for the new UI: Test suite 420__model_serving.robot by @manosnoam in #1345
• Update Xpath data-testid for Jupyter Explorer Card by @manosnoam in #1350
• Fix "F811", # Redefinition of unused hide_values_in_op_json from line 565 by @jiridanek in #1353
• Fix "W605", # Invalid escape sequence: \d by @jiridanek in #1354
• Add common KW Open "Get Started" For App Name by @manosnoam in #1352
• Fix "RET503", # Missing explicit return at the end of function able to return non-None value by @jiridanek in #1357
• Revert "Fix "RET503", # Missing explicit return at the end of funct… by @jstourac in #1360
• Enhance Pipelines UI tests for DSPv2 and add some example pipelines by @jgarciao in #1358
• fix: Delete outdated skipped tests by @FedeAlonso in #1362
• fix: Delete AutomationBug tag from ODS-2379 by @FedeAlonso in #1361
• Speed-up execution of keyword "Is RHODS Self-Managed" in local by @jgarciao in #1366
• Add ibmcloud among supported platform for RHOAI install task by @bdattoma in #1364
• In RHOAI 2.9, the number of containers for envoy increased by @diegolovison in #1371
• Fix "RET503", # Missing explicit return at the end of function able… by @jiridanek in #1369
• "B007", # Loop control variable retry not used within loop body by @jiridanek in #1374
• Change IBM Watson Studio to IBM watsonx.ai title in 2.9+ by @jstourac in #1372
• Dashboard Sanity tests fixes for RHOAI 2.9 by @manosnoam in #1363
• Fix "PLR5501", # Use elif instead of else then if, to reduce indentation by @jiridanek in #1375
• Change IBM Watson Studio to IBM watsonx.ai references for 2.9+ by @jstourac in #1376
• Update Xpath for WORKBENCH_IMAGE by @manosnoam in #1382
• fix: ODS-1814 wrong xpath by @FedeAlonso in #1383
• Migrate pipelines tests to DSPv2 by @diegolovison in #1378
• fix: ODS-2054 issues by @FedeAlonso in #1384
• Adapt Trusted CA bundles tests to ODH by @asanzgom in #1380
• Verify That There Are No Sample Pipelines After Creating Pipeline Server in RHOAI by @Raghul-M in #1368
• Fix required xpaths for the selection of the model server template by @jstourac in #1387
• fix: ODS-2276 and ODS-2279 issues by @FedeAlonso in #1388
• Fix and exclude some tests in smoke for odh compatibility by @jgarciao in #1381
• Fix Canary rollout and non-admin test case in Caikit+TGIS suite (Sanity) by @bdattoma in #1390
• Fix expected version of Jupyterhub-git package for 2024.1 images by @jstourac in #1393
• Fix Quickstart tests in 412__ods_dashboard_resources.robot by @manosnoam in #1395
• Add self-signed CA bundle support for kserve grpc/http requests by @lugi0 in #1391
• Fixing Automation For Elyra Test in Dspv2 by @Raghul-M in #1394
• fix: DS Projects permission mgmt tests by @FedeAlonso in #1399
• Rhoaieng 6358 restore custom ca bundle by @mattmahoneyrh in #1398
• fix: ODS-2542 outdated xpaths by @FedeAlonso in #1403
• Update Serving Runtime images for API testing by @bdattoma in #1406
• Fix/420 model serving dashboard tests by @FedeAlonso in #1402
• Embed required data in iris-pipeline to avoid an external connection and improve compatibility with disconnected clusters by @diegolovison in #1408
• Remove workaround needed for self-signed S3 by @apodhrad in #1407
• Migrate the code to the latest changes in DW by @diegolovison in #1410
• Fix Verify Switcher to Masterhead test by @jstourac in #1404
• Fix: GPU related tests by @FedeAlonso in #1413

Enhancements in scripts and CI/CD

• Replace black and isort with ruff by @jiridanek in #1337
• Configure include and exclude paths for ruff linter by @jiridanek in #1359
• Add ruff to pre-commit by @jiridanek in #1341
• Refine execute_command function for printing aligned tabbed tables by @jiridanek in #1379

Misc

• Add DependencyLibrary to support test case/suite dependency by @manosnoam in #1323
• Add pyright typechecker...