Skip to content

Commit

Permalink
Releases/rc trulens eval 0.17.0 (#543)
Browse files Browse the repository at this point in the history 
* version bump init, readme, quickstarts 17

* version bump, automated wider docs 17
  • Loading branch information
@joshreini1
joshreini1 authored Nov 2, 2023
1 parent 3ff8878 commit dffa0ea
Show file tree
Hide file tree
Showing 22 changed files with 366 additions and 288 deletions.
12 changes: 6 additions & 6 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,18 +43,18 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

**Custom Text to Text Apps**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)

## TruLens-Explain

Expand Down
12 changes: 6 additions & 6 deletions docs/trulens_eval/gh_top_intro.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,15 +43,15 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

**Custom Text to Text Apps**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
12 changes: 6 additions & 6 deletions docs/trulens_eval/intro.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -46,18 +46,18 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

**Custom Text to Text Apps**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)

### 💡 Contributing

Expand Down
12 changes: 6 additions & 6 deletions trulens_eval/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -46,18 +46,18 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

**Custom Text to Text Apps**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0b/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)

### 💡 Contributing

Expand Down
54 changes: 27 additions & 27 deletions trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "631abb12",
"id": "69cd305d",
"metadata": {},
"source": [
"# Langchain Quickstart\n",
Expand All @@ -30,17 +30,17 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ed112ffc",
"id": "18aa8b82",
"metadata": {},
"outputs": [],
"source": [
"# ! pip install trulens_eval==0.17.0b langchain>=0.0.263"
"# ! pip install trulens_eval==0.17.0 langchain>=0.0.263"
]
},
{
"attachments": {},
"cell_type": "markdown",
"id": "9de40d54",
"id": "9c25bf51",
"metadata": {},
"source": [
"## Setup\n",
Expand All @@ -51,7 +51,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ac1dc02a",
"id": "c0b5cb5b",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -63,7 +63,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "314dd325",
"id": "6ed957f0",
"metadata": {},
"source": [
"### Import from LangChain and TruLens"
Expand All @@ -72,7 +72,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "12354219",
"id": "2549202e",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -95,7 +95,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "43a0c2a2",
"id": "b113590b",
"metadata": {},
"source": [
"### Create Simple LLM Application\n",
Expand All @@ -106,7 +106,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "36e94b09",
"id": "fd01f7c1",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -128,7 +128,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "5fd05b6b",
"id": "cbfcddb4",
"metadata": {},
"source": [
"### Send your first request"
Expand All @@ -137,7 +137,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "4207dd6f",
"id": "5308cbe0",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -147,7 +147,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "20dc1ac7",
"id": "ca5bd730",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -159,7 +159,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "75b91bcf",
"id": "1ed5cb4e",
"metadata": {},
"source": [
"## Initialize Feedback Function(s)"
Expand All @@ -168,7 +168,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "1722d1b7",
"id": "55e7565f",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -184,7 +184,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "0086d018",
"id": "300e0a6c",
"metadata": {},
"source": [
"## Instrument chain for logging with TruLens"
Expand All @@ -193,7 +193,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "9959db6e",
"id": "99e17fa0",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -205,7 +205,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "1957bccb",
"id": "58d6bbef",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -217,7 +217,7 @@
},
{
"cell_type": "markdown",
"id": "b23067d8",
"id": "18c70bde",
"metadata": {},
"source": [
"## Retrieve records and feedback"
Expand All @@ -226,7 +226,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "d8a5374a",
"id": "3fb7c6ee",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -241,7 +241,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "07bb2d75",
"id": "440dc503",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -263,7 +263,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "e13ec812",
"id": "89c043c4",
"metadata": {},
"source": [
"## Explore in a Dashboard"
Expand All @@ -272,7 +272,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "728c7e47",
"id": "2b5ff4d1",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -284,7 +284,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "2ddac721",
"id": "d0086c2d",
"metadata": {},
"source": [
"Alternatively, you can run `trulens-eval` from a command line in the same folder to start the dashboard."
Expand All @@ -293,7 +293,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "73f2420a",
"id": "2d7251e3",
"metadata": {},
"source": [
"### Chain Leaderboard\n",
Expand Down Expand Up @@ -326,7 +326,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "d30fc56a",
"id": "0a6785d9",
"metadata": {},
"source": [
"Note: Feedback functions evaluated in the deferred manner can be seen in the \"Progress\" page of the TruLens dashboard."
Expand All @@ -335,7 +335,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "ba44412c",
"id": "80f9eecc",
"metadata": {},
"source": [
"## Or view results directly in your notebook"
Expand All @@ -344,7 +344,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "f99aa8f3",
"id": "a69bcdec",
"metadata": {},
"outputs": [],
"source": [
Expand Down
Loading

0 comments on commit dffa0ea

Please sign in to comment.