v0.14.2

.github/ISSUE_TEMPLATE/bug_report.md

@@ -29,7 +29,7 @@ If applicable, add screenshots to help explain your problem.
 **Installation Setup (please complete the following information):**
 
  - OS: [e.g. iOS]
- - Python Version: [e.g. 3.11, 3.9]
+ - Python Version: [e.g. 3.10, 3.11, 3.12]
  - SDK Version: [e.g. 1.0]
 
 **Additional context**

.github/workflows/test.yml

@@ -26,23 +26,15 @@ jobs:
       fail-fast: false
       matrix:
         os: [ubuntu-latest]
-        python-version: ["3.9", "3.10", "3.11", "3.12"]
+        python-version: ["3.10", "3.11", "3.12"]
         pyspark: ["3.3.0", "3.3.1", "3.3.2", "3.4.0", "3.4.1", "3.5.0", "3.5.1"] # 3.5.2 does not work  with conda
         exclude:
-          - pyspark: "3.5.1"
-            python-version: "3.9"
           - pyspark: "3.5.1"
             python-version: "3.10"
-          - pyspark: "3.5.0"
-            python-version: "3.9"
           - pyspark: "3.5.0"
             python-version: "3.10"
-          - pyspark: "3.4.1"
-            python-version: "3.9"
           - pyspark: "3.4.1"
             python-version: "3.10"
-          - pyspark: "3.4.0"
-            python-version: "3.9"
           - pyspark: "3.4.0"
             python-version: "3.10"
           - pyspark: "3.3.2"

.vscode/settings.json

@@ -32,18 +32,15 @@
     "cSpell.words": [
         "ADLS",
         "Autoloader",
-        "chatopenai",
         "dagster",
         "dataframe",
         "DDTHH",
         "Eventhub",
         "JDBC",
         "Lakehouse",
-        "langchain",
         "Metastore",
         "NOSONAR",
         "odbc",
-        "openai",
         "Osisoft",
         "PCDM",
         "PYDOBC",
@@ -56,7 +53,6 @@
         "SSIP",
         "tagnames",
         "timeseries",
-        "toolkits",
         "Turbodbc",
         "TURBODBCSQL",
         "ZORDER"

docs/getting-started/installation.md

@@ -18,7 +18,7 @@ This article provides a guide on how to install the RTDIP SDK. Get started by en
 
 There are a few things to note before using the RTDIP SDK. The following prerequisites will need to be installed on your local machine.
 
-Python version 3.9 >= and < 3.12 should be installed. Check which python version you have with the following command:
+Python version 3.10 or higher (and < 3.13) should be installed. Check which python version you have with the following command:
 
     python --version
 

docs/sdk/queries/connectors.md

@@ -91,39 +91,4 @@ connection = SparkConnection(spark_remote=spark_remote)
 
 Replace the **access_token** with your own authentiction token.
 
-<!-- --8<-- [end:sparkconnector] -->
-
-## LLMs 
-
-### Chat Open AI Databricks Connector
-
-The Chat Open AI Databricks Connector enables querying of Databricks data using Chat GPT. 
-
-!!! Warning
-    This is experimental and you will likely experience variable responses to your questions depending on the complexity of the data you use in this setup. Start small, with only a 2 - 3 tables before scaling up.
-
-```python
-from rtdip_sdk.connectors import ChatOpenAIDatabricksConnection
-
-agent = ChatOpenAIDatabricksConnection(
-    catalog="<databricks catalog>", 
-    schema="<databricks schema>", 
-    server_hostname="<databricks host name>",                   
-    http_path="<databricks http path>",                         
-    access_token="<Azure AD token or databricks PAT token>",
-    openai_api_key="<Open AI API key>",
-    openai_model = "gpt-4",                                     
-    sample_rows_in_table_info = 5, 
-    verbose_logging = True
-)
-
-response = agent.run("What was the average actual power generated by Turbine 1 at ACME Wind Farm on 6 May?")
-print(response)
-```
-
-Some notes on the above:
-
-- `server_hostname` and `http_path` can be obtained from your [Databricks SQL Warehouse](../queries/databricks/sql-warehouses.md) or Databricks Cluster.
-- `access_token` can be either a Databricks PAT Token or Azure AD Token. To obtain an Azure AD token, please refer to this [documentation](../authentication/azure.md)
-- `open_ai_model` defaults to `gpt-4` but is not easily available at the time of writing. Alternatively, the `gpt-3.5-turbo-16k-0613` has worked well in our tests
-- `sample_rows_in_table_info` limits the number of rows queried in a table when the SQL Database Agent is looking context in the data. Be careful to not increase this too much as its then possible to exceed token limits on the gpt models
+<!-- --8<-- [end:sparkconnector] -->

docs/university/essentials/excel-connector/dashboard.md

@@ -14,7 +14,9 @@ For our final exercise, we will put everything together and create a simple dash
 3. Either with the taskpane `Advanced Parameters` or by editing your formula, set `refreshIntervalSeconds` to a number (min value `10`).
 4. Watch your chart update with live data.
 
-<center> ![Excel](assets/plot.gif){width=100%} </center>
+<figure markdown="span">
+  ![Excel](assets/plot.gif){ width="100%" }
+</figure>
 
 >
 Note: Currently, if you require excel to recognise dates on plots you will need to do `=VALUE(your_date_cell)`.

docs/university/essentials/excel-connector/getting-started.md

@@ -7,13 +7,18 @@
 
 To get started, open up Microsoft Excel and go to the `Home` tab. On the right you should see the RTDIP Taskpane like this (if not, you may need to click `Add-ins`):
 
-<center> ![Excel](assets/home-tab.png){width=200px} </center>
+<figure markdown="span">
+  ![Excel](assets/home-tab.png){ width="200" }
+</figure>
 
 
 Once opened, the set-up screen will show and will ask for your API URL. This will be the same URL as in the previous lessons in the format `https://YOUR_ORGANISATION_DOMAIN/api/v1`
 
 After this, you should see our friendly taskpane (you are now completely set-up and ready to make some queries!):
-<center> ![Excel](assets/taskpane.png){width=40%} </center>
+
+<figure markdown="span">
+  ![Excel](assets/taskpane.png){ width="40%" }
+</figure>
 
 Let's move onto the next section: