Skip to content

Commit

Permalink
Releases/rc trulens eval 0.17.0b (#541)
Browse files Browse the repository at this point in the history 
* bump version in init to 0.17.0a

* bump version, remove .py files from readme

* version bump quickstarts

* version bump readmes 17b

* version bump init to 17b

* version bump quickstarts 17b

* version bump into wider docs automation 17b
  • Loading branch information
@joshreini1
joshreini1 authored Nov 2, 2023
1 parent ef77c75 commit 5d4a3b1
Show file tree
Hide file tree
Showing 20 changed files with 346 additions and 277 deletions.
12 changes: 6 additions & 6 deletions docs/trulens_eval/gh_top_intro.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,15 +43,15 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

**Custom Text to Text Apps**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
12 changes: 6 additions & 6 deletions docs/trulens_eval/intro.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -46,18 +46,18 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

**Custom Text to Text Apps**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)

### 💡 Contributing

Expand Down
55 changes: 27 additions & 28 deletions trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "4d8bd621",
"id": "002ffae2",
"metadata": {},
"source": [
"# Langchain Quickstart\n",
Expand All @@ -30,17 +30,17 @@
{
"cell_type": "code",
"execution_count": null,
"id": "e32c8ad8",
"id": "f028b402",
"metadata": {},
"outputs": [],
"source": [
"# ! pip install trulens_eval==0.17.0a langchain>=0.0.263"
"# ! pip install trulens_eval==0.17.0b langchain>=0.0.263"
]
},
{
"attachments": {},
"cell_type": "markdown",
"id": "1b5822db",
"id": "9c313e70",
"metadata": {},
"source": [
"## Setup\n",
Expand All @@ -51,7 +51,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "6ff3805d",
"id": "e8dc32cc",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -63,7 +63,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "d4703d64",
"id": "ecd0e34e",
"metadata": {},
"source": [
"### Import from LangChain and TruLens"
Expand All @@ -72,7 +72,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "3accbb8e",
"id": "2159b8c3",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -95,7 +95,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "9f2043ff",
"id": "7faab30e",
"metadata": {},
"source": [
"### Create Simple LLM Application\n",
Expand All @@ -106,7 +106,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "67703ade",
"id": "e00c3ff8",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -128,7 +128,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "8e0a7c70",
"id": "b1ac78fe",
"metadata": {},
"source": [
"### Send your first request"
Expand All @@ -137,7 +137,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "005409f4",
"id": "8c6c3032",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -147,7 +147,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "93aafd5a",
"id": "d0ceda72",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -159,16 +159,15 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "6b87ddde",
"id": "5790ac98",
"metadata": {},
"source": [
"## Initialize Feedback Function(s)"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "11d1f315",
"id": "fcfce0cc",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -184,7 +183,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "2002422b",
"id": "0c23d029",
"metadata": {},
"source": [
"## Instrument chain for logging with TruLens"
Expand All @@ -193,7 +192,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "8b6dda74",
"id": "a07c1fb1",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -205,7 +204,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "faf179c3",
"id": "7a632846",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -217,7 +216,7 @@
},
{
"cell_type": "markdown",
"id": "a1e95335",
"id": "6bacc4fc",
"metadata": {},
"source": [
"## Retrieve records and feedback"
Expand All @@ -226,7 +225,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "37b0e597",
"id": "8856f6a0",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -241,7 +240,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "5c1f1720",
"id": "09d4ec4f",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -263,7 +262,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "8e9293ed",
"id": "d79a1fd0",
"metadata": {},
"source": [
"## Explore in a Dashboard"
Expand All @@ -272,7 +271,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "95e4dabd",
"id": "502832e1",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -284,7 +283,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "85a83b30",
"id": "43ba08ab",
"metadata": {},
"source": [
"Alternatively, you can run `trulens-eval` from a command line in the same folder to start the dashboard."
Expand All @@ -293,7 +292,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "867fbc1c",
"id": "2a22d99d",
"metadata": {},
"source": [
"### Chain Leaderboard\n",
Expand Down Expand Up @@ -326,7 +325,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "5d4329eb",
"id": "a8dff588",
"metadata": {},
"source": [
"Note: Feedback functions evaluated in the deferred manner can be seen in the \"Progress\" page of the TruLens dashboard."
Expand All @@ -335,7 +334,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "06bc5f81",
"id": "2790a01c",
"metadata": {},
"source": [
"## Or view results directly in your notebook"
Expand All @@ -344,7 +343,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "feb52898",
"id": "b2292133",
"metadata": {},
"outputs": [],
"source": [
Expand Down
Loading

0 comments on commit 5d4a3b1

Please sign in to comment.