Skip to content

Commit

Permalink
Deployed 9b6708d with MkDocs version: 1.4.2
Browse files Browse the repository at this point in the history
  • Loading branch information
piotrm0 committed Oct 25, 2023
1 parent 420aa68 commit 080ec4a
Show file tree
Hide file tree
Showing 69 changed files with 27 additions and 27 deletions.
File renamed without changes.
File renamed without changes.
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes.
File renamed without changes
File renamed without changes
File renamed without changes.
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes.
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
38 changes: 19 additions & 19 deletions conf/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -2689,7 +2689,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>
init_mathjax();
</script>
<!-- End of mathjax configuration --><div class="jupyter-wrapper">
<div id="cell-id=6978b1a5" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div id="cell-id=6ab5efb2" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand All @@ -2704,7 +2704,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>
</div>
</div>
</div>
<div id="cell-id=ac026d43" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div id="cell-id=a4bd7e66" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand All @@ -2716,7 +2716,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>
</div>
</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=f89242c2" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=b66bc479" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -2758,7 +2758,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=7f6e029d" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=ac945288" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -2794,7 +2794,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div>
<div id="cell-id=32e56bd1" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div id="cell-id=c8843536" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand All @@ -2806,7 +2806,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>
</div>
</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=001a6dd4" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=caf5c7db" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -2842,7 +2842,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div>
<div id="cell-id=f367c706" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div id="cell-id=32535f9b" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand All @@ -2854,7 +2854,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>
</div>
</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=fcd5c591" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=86790088" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -2902,7 +2902,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div>
<div id="cell-id=b1b2107a" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div id="cell-id=e60bfc81" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand All @@ -2916,7 +2916,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>
</div>
</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=eb1bfa12" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=a0fc98b6" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -2954,7 +2954,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=83ff62cc" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=7d2eb066" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -2988,7 +2988,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=b869a8c1" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=a7f3247a" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -3022,7 +3022,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=5f4cc6ef" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=3b9ae854" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -3060,7 +3060,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div>
<div id="cell-id=f896ae1f" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div id="cell-id=7c820462" class="jp-Cell jp-MarkdownCell jp-Notebook-cell">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand All @@ -3072,7 +3072,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>
</div>
</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=648fcf0c" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=12929626" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -3110,7 +3110,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=17912bda" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=0eb3446c" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -3148,7 +3148,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=02b4940e" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=2fe8d170" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -3180,7 +3180,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=4f65fe37" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=02517a6c" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down Expand Up @@ -3212,7 +3212,7 @@ <h1>Configuration file for the Sphinx documentation builder.</h1>

</div>
</div><div class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=4c8faa43" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div id="cell-id=6ec4dd43" class="jp-Cell jp-CodeCell jp-Notebook-cell jp-mod-noOutputs ">
<div class="jp-Cell-inputWrapper">
<div class="jp-Collapser jp-InputCollapser jp-Cell-inputCollapser">
</div>
Expand Down
Binary file modified sitemap.xml.gz
Binary file not shown.
2 changes: 1 addition & 1 deletion trulens_eval/gh_top_intro/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -1725,7 +1725,7 @@ <h2 id="trulens-eval">TruLens-Eval<a class="headerlink" href="#trulens-eval" tit
</li>
</ol>
<p>The process for building your evaluated and tracked LLM application with TruLens is shown below 👇
<img alt="Architecture Diagram" src="https://www.trulens.org/Assets/image/TruLens_Architecture.png" /></p>
<img alt="Architecture Diagram" src="https://www.trulens.org/assets/images/TruLens_Architecture.png" /></p>
<h3 id="installation-and-setup">Installation and setup<a class="headerlink" href="#installation-and-setup" title="Permanent link">&para;</a></h3>
<p>Install trulens-eval from PyPI.</p>
<div class="highlight"><pre><span></span><code>pip<span class="w"> </span>install<span class="w"> </span>trulens-eval
Expand Down
4 changes: 2 additions & 2 deletions trulens_eval/intro/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -1713,7 +1713,7 @@


<h1 id="welcome-to-trulens-eval">Welcome to TruLens-Eval!<a class="headerlink" href="#welcome-to-trulens-eval" title="Permanent link">&para;</a></h1>
<p><img alt="TruLens" src="https://www.trulens.org/Assets/image/Neural_Network_Explainability.png" /></p>
<p><img alt="TruLens" src="https://www.trulens.org/assets/images/Neural_Network_Explainability.png" /></p>
<p>Evaluate and track your LLM experiments with TruLens. As you work on your models and prompts TruLens-Eval supports the iterative development and of a wide range of LLM applications by wrapping your application to log key metadata across the entire chain (or off chain if your project does not use chains) on your local machine.</p>
<p>Using feedback functions, you can objectively evaluate the quality of the responses provided by an LLM to your requests. This is completed with minimal latency, as this is achieved in a sequential call for your application, and evaluations are logged to your local machine. Finally, we provide an easy to use Streamlit dashboard run locally on your machine for you to better understand your LLM’s performance.</p>
<h2 id="value-propositions">Value Propositions<a class="headerlink" href="#value-propositions" title="Permanent link">&para;</a></h2>
Expand All @@ -1732,7 +1732,7 @@ <h2 id="value-propositions">Value Propositions<a class="headerlink" href="#value
</li>
</ol>
<p>The process for building your evaluated and tracked LLM application with TruLens is below 👇</p>
<p><img alt="Architecture Diagram" src="https://www.trulens.org/Assets/image/TruLens_Architecture.png" /></p>
<p><img alt="Architecture Diagram" src="https://www.trulens.org/assets/images/TruLens_Architecture.png" /></p>
<h2 id="installation-and-setup">Installation and Setup<a class="headerlink" href="#installation-and-setup" title="Permanent link">&para;</a></h2>
<p>Install the trulens-eval pip package from PyPI.</p>
<div class="highlight"><pre><span></span><code><span class="w"> </span>pip<span class="w"> </span>install<span class="w"> </span>trulens-eval
Expand Down
6 changes: 3 additions & 3 deletions trulens_eval/langchain_quickstart/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -3580,13 +3580,13 @@ <h2 id="explore-in-a-dashboard">Explore in a Dashboard<a class="anchor-link" hre
</div><div class="jp-RenderedHTMLCommon jp-RenderedMarkdown jp-MarkdownOutput " data-mime-type="text/markdown">
<h3 id="chain-leaderboard">Chain Leaderboard<a class="anchor-link" href="#chain-leaderboard">&#182;</a></h3><p>Understand how your LLM application is performing at a glance. Once you've set up logging and evaluation in your application, you can view key performance statistics including cost and average feedback value across all of your LLM apps using the chain leaderboard. As you iterate new versions of your LLM application, you can compare their performance across all of the different quality metrics you've set up.</p>
<p>Note: Average feedback values are returned and displayed in a range from 0 (worst) to 1 (best).</p>
<p><img src="https://www.trulens.org/Assets/image/Leaderboard.png" alt="Chain Leaderboard" /></p>
<p><img src="https://www.trulens.org/assets/images/Leaderboard.png" alt="Chain Leaderboard" /></p>
<p>To dive deeper on a particular chain, click &quot;Select Chain&quot;.</p>
<h3 id="understand-chain-performance-with-evaluations">Understand chain performance with Evaluations<a class="anchor-link" href="#understand-chain-performance-with-evaluations">&#182;</a></h3><p>To learn more about the performance of a particular chain or LLM model, we can select it to view its evaluations at the record level. LLM quality is assessed through the use of feedback functions. Feedback functions are extensible methods for determining the quality of LLM responses and can be applied to any downstream LLM task. Out of the box we provide a number of feedback functions for assessing model agreement, sentiment, relevance and more.</p>
<p>The evaluations tab provides record-level metadata and feedback on the quality of your LLM application.</p>
<p><img src="https://www.trulens.org/Assets/image/Leaderboard.png" alt="Evaluations" /></p>
<p><img src="https://www.trulens.org/assets/images/Leaderboard.png" alt="Evaluations" /></p>
<h3 id="deep-dive-into-full-chain-metadata">Deep dive into full chain metadata<a class="anchor-link" href="#deep-dive-into-full-chain-metadata">&#182;</a></h3><p>Click on a record to dive deep into all of the details of your chain stack and underlying LLM, captured by tru_chain_recorder.</p>
<p><img src="https://www.trulens.org/Assets/image/Chain_Explore.png" alt="Explore a Chain" /></p>
<p><img src="https://www.trulens.org/assets/images/Chain_Explore.png" alt="Explore a Chain" /></p>
<p>If you prefer the raw format, you can quickly get it using the &quot;Display full chain json&quot; or &quot;Display full record json&quot; buttons at the bottom of the page.</p>

</div>
Expand Down
2 changes: 1 addition & 1 deletion welcome/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -1850,7 +1850,7 @@ <h2 id="trulens-eval">TruLens-Eval<a class="headerlink" href="#trulens-eval" tit
</li>
</ol>
<p>The process for building your evaluated and tracked LLM application with TruLens is shown below 👇
<img alt="Architecture Diagram" src="https://www.trulens.org/Assets/image/TruLens_Architecture.png" /></p>
<img alt="Architecture Diagram" src="https://www.trulens.org/assets/images/TruLens_Architecture.png" /></p>
<h3 id="installation-and-setup">Installation and setup<a class="headerlink" href="#installation-and-setup" title="Permanent link">&para;</a></h3>
<p>Install trulens-eval from PyPI.</p>
<div class="highlight"><pre><span></span><code>pip<span class="w"> </span>install<span class="w"> </span>trulens-eval
Expand Down
2 changes: 1 addition & 1 deletion welcome2/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -1752,7 +1752,7 @@ <h2 id="trulens-eval">TruLens-Eval<a class="headerlink" href="#trulens-eval" tit
</li>
</ol>
<p>The process for building your evaluated and tracked LLM application with TruLens is shown below 👇
<img alt="Architecture Diagram" src="https://www.trulens.org/Assets/image/TruLens_Architecture.png" /></p>
<img alt="Architecture Diagram" src="https://www.trulens.org/assets/images/TruLens_Architecture.png" /></p>
<h3 id="installation-and-setup">Installation and setup<a class="headerlink" href="#installation-and-setup" title="Permanent link">&para;</a></h3>
<p>Install trulens-eval from PyPI.</p>
<div class="highlight"><pre><span></span><code>pip<span class="w"> </span>install<span class="w"> </span>trulens-eval
Expand Down

0 comments on commit 080ec4a

Please sign in to comment.