Skip to content

Commit 59123b4

Browse files
authored
fix: update quickstart notebook (#137)
1 parent 4f260c8 commit 59123b4

File tree

2 files changed

+13
-3
lines changed

2 files changed

+13
-3
lines changed

β€ŽREADME.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@
4141

4242
> Note: We're working with a few select organisations, leveraging what we learned building Ragas, to improve the reliability of their RAG systems in production. Due to our small team size we can only work with a few clients so do fill out [this form](https://forms.gle/tk9VZMaeybxQATU69) or write to us at [[email protected]](mailto:[email protected]) and we will get back πŸ™‚
4343
44-
ragas is a framework that helps you evaluate your Retrieval Augmented Generation (RAG) pipelines. RAG denotes a class of LLM applications that use external data to augment the LLM’s context. There are existing tools and frameworks that help you build these pipelines but evaluating it and quantifying your pipeline performance can be hard... This is where ragas (RAG Assessment) comes in
44+
ragas is a framework that helps you evaluate your Retrieval Augmented Generation (RAG) pipelines. RAG denotes a class of LLM applications that use external data to augment the LLM’s context. There are existing tools and frameworks that help you build these pipelines but evaluating it and quantifying your pipeline performance can be hard. This is where ragas (RAG Assessment) comes in.
4545

4646
ragas provides you with the tools based on the latest research for evaluating LLM-generated text to give you insights about your RAG pipeline. ragas can be integrated with your CI/CD to provide continuous checks to ensure performance.
4747

β€Ždocs/quickstart.ipynb

+12-2
Original file line numberDiff line numberDiff line change
@@ -187,7 +187,7 @@
187187
},
188188
{
189189
"cell_type": "code",
190-
"execution_count": null,
190+
"execution_count": 5,
191191
"id": "22eb6f97",
192192
"metadata": {},
193193
"outputs": [
@@ -258,8 +258,18 @@
258258
"name": "stderr",
259259
"output_type": "stream",
260260
"text": [
261-
" 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1/2 [00:46<00:46, 46.32s/it]"
261+
"100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [01:29<00:00, 44.72s/it]\n"
262262
]
263+
},
264+
{
265+
"data": {
266+
"text/plain": [
267+
"{'ragas_score': 0.6503, 'context_relevancy': 0.6225, 'faithfulness': 0.7745, 'answer_relevancy': 0.9257, 'context_recall': 0.4602, 'harmfulness': 0.0000}"
268+
]
269+
},
270+
"execution_count": 5,
271+
"metadata": {},
272+
"output_type": "execute_result"
263273
}
264274
],
265275
"source": [

0 commit comments

Comments
Β (0)