Skip to content

Commit

Permalink
Automated File Generation from Docs Notebook Changes (#540)
Browse files Browse the repository at this point in the history 
Co-authored-by: joshreini1 <[email protected]>
  • Loading branch information
@github-actions @joshreini1
github-actions[bot] and joshreini1 authored Nov 2, 2023
1 parent 0befb8a commit ef77c75
Show file tree
Hide file tree
Showing 19 changed files with 162 additions and 161 deletions.
21 changes: 7 additions & 14 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,25 +43,18 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)

**No Framework**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)
**Custom Text to Text Apps**

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)

## TruLens-Explain

Expand Down
20 changes: 7 additions & 13 deletions trulens_eval/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -46,24 +46,18 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a

**Langchain**

[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)

**Llama-Index**

[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)

**No Framework**
[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)

[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
**Custom Text to Text Apps**

[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)
[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.17.0a/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)

### 💡 Contributing

Expand Down
54 changes: 27 additions & 27 deletions trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "9e4e988a",
"id": "4d8bd621",
"metadata": {},
"source": [
"# Langchain Quickstart\n",
Expand All @@ -30,17 +30,17 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ae2a62a7",
"id": "e32c8ad8",
"metadata": {},
"outputs": [],
"source": [
"# ! pip install trulens_eval==0.16.0 langchain>=0.0.263"
"# ! pip install trulens_eval==0.17.0a langchain>=0.0.263"
]
},
{
"attachments": {},
"cell_type": "markdown",
"id": "c3779d2d",
"id": "1b5822db",
"metadata": {},
"source": [
"## Setup\n",
Expand All @@ -51,7 +51,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "b587f1ee",
"id": "6ff3805d",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -63,7 +63,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "fc907ab5",
"id": "d4703d64",
"metadata": {},
"source": [
"### Import from LangChain and TruLens"
Expand All @@ -72,7 +72,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "8bce252d",
"id": "3accbb8e",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -95,7 +95,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "ff36b994",
"id": "9f2043ff",
"metadata": {},
"source": [
"### Create Simple LLM Application\n",
Expand All @@ -106,7 +106,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "3b5178cd",
"id": "67703ade",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -128,7 +128,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "f494403b",
"id": "8e0a7c70",
"metadata": {},
"source": [
"### Send your first request"
Expand All @@ -137,7 +137,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "60d2e86f",
"id": "005409f4",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -147,7 +147,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "4c155484",
"id": "93aafd5a",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -159,7 +159,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "9fe8dd3d",
"id": "6b87ddde",
"metadata": {},
"source": [
"## Initialize Feedback Function(s)"
Expand All @@ -168,7 +168,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "ab4f3123",
"id": "11d1f315",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -184,7 +184,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "7db53395",
"id": "2002422b",
"metadata": {},
"source": [
"## Instrument chain for logging with TruLens"
Expand All @@ -193,7 +193,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "bd89b425",
"id": "8b6dda74",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -205,7 +205,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "3a8ef1e0",
"id": "faf179c3",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -217,7 +217,7 @@
},
{
"cell_type": "markdown",
"id": "cc35e768",
"id": "a1e95335",
"metadata": {},
"source": [
"## Retrieve records and feedback"
Expand All @@ -226,7 +226,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "91566071",
"id": "37b0e597",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -241,7 +241,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "eaee8f99",
"id": "5c1f1720",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -263,7 +263,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "b0cda143",
"id": "8e9293ed",
"metadata": {},
"source": [
"## Explore in a Dashboard"
Expand All @@ -272,7 +272,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "2ff2f753",
"id": "95e4dabd",
"metadata": {},
"outputs": [],
"source": [
Expand All @@ -284,7 +284,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "16744b64",
"id": "85a83b30",
"metadata": {},
"source": [
"Alternatively, you can run `trulens-eval` from a command line in the same folder to start the dashboard."
Expand All @@ -293,7 +293,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "3b624b81",
"id": "867fbc1c",
"metadata": {},
"source": [
"### Chain Leaderboard\n",
Expand Down Expand Up @@ -326,7 +326,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "99247aa6",
"id": "5d4329eb",
"metadata": {},
"source": [
"Note: Feedback functions evaluated in the deferred manner can be seen in the \"Progress\" page of the TruLens dashboard."
Expand All @@ -335,7 +335,7 @@
{
"attachments": {},
"cell_type": "markdown",
"id": "539e4367",
"id": "06bc5f81",
"metadata": {},
"source": [
"## Or view results directly in your notebook"
Expand All @@ -344,7 +344,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "4437d3e8",
"id": "feb52898",
"metadata": {},
"outputs": [],
"source": [
Expand Down
Loading

0 comments on commit ef77c75

Please sign in to comment.