v0.0.15

LangKit release v0.0.15

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

• Fix aggregate reading level regression #130 [@richard-rogers]
• Add regex counter UDFs #129 [@richard-rogers]
• Allow custom embeddings encoder for input_output and themes #128 [@FelipeAdachi]
• Fix some config issues #126 [@richard-rogers]
• Add Makefile #123 [@richard-rogers]
• Bump version to 0.0.14 #124 [@jamie256]

v0.0.14

LangKit release v0.0.14

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

• remove pkg_resources reference #122 [@jamie256]
• Makes themes groups customizable #118 [@FelipeAdachi]
• fix CI tests to run tests on specified OS #121 [@jamie256]
• Make everything dataset UDFs #117 [@richard-rogers]
• bumpversion to 0.0.13 #116 [@jamie256]

v0.0.13

LangKit release v0.0.13

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

• Add helper method to configure metadata logging #115 [@jamie256]
• bumpversion 0.0.12 #114 [@FelipeAdachi]

v0.0.12

LangKit release v0.0.12

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

• Change injection to dataset UDF #111 [@richard-rogers]
• Simplify release workflow wheel publishing step #110 [@jamie256]
• fix open in colab link for hf example #106 [@sagecodes]

0.0.11

LangKit release v0.0.11

LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

• update dataset UDF to new signature #97 [@richard-rogers]
• Update version to 0.0.10 #108 [@jamie256]

v0.0.10

LangKit release v0.0.10

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

• Make LangChain metadata logging opt-in #105 [@jamie256]

v0.0.9

LangKit release v0.0.9

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

• Update langchain callback handler to capture metadata, correlated prompt/responses #104 [@jamie256]
• Update version to 0.0.8 #103 [@jamie256]

LangKit release v0.0.8

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs).📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀

This version includes:

• add nlp score metrics #87 [@andrewelizondo]
• Add release draft template #101 [@jamie256]
• doc updates - add modules table and fixes on gpt behavior example #99 [@FelipeAdachi]
• Add isolated regex pattern unit tests #94 [@jamie256]
• Add hugging face example #100 [@sagecodes]
• Add release automation workflows #96 [@jamie256]
• Add pre-commit to CI #95 [@jamie256]

LangKit release v0.0.7

Hi everyone! We’ve now released the first version of LangKit 0.0.7 🚀.

LangKit is an open-source text metrics toolkit for monitoring language models. It offers an array of methods for extracting relevant signals from the input and/or output text, which are compatible with the open-source data logging library whylogs.

💡 Want to experience LangKit? Go to this notebook!

Changes include:

• add encoding definition when loading themes json by @FelipeAdachi in #92
• LLM behavior monitoring example by @FelipeAdachi in #91
• Update whylogs dependency, update version to 0.0.7 by @jamie256 in #93

Read more about LangKit here

LangKit release v0.0.6

Hi everyone! We’ve now released the first version of LangKit 0.0.6 🚀.

LangKit is an open-source text metrics toolkit for monitoring language models. It offers an array of methods for extracting relevant signals from the input and/or output text, which are compatible with the open-source data logging library whylogs.

💡 Want to experience LangKit? Go to this notebook!

Changes include:

• Update whylogs dependency to 1.2.3 @jamie256 in #88
• Update intro notebook install command
• Update version info to 0.0.6

Read more about LangKit here