Release branch 0.16.0 (#514)

* version bump to 0.16.0

* combine nb to docs

README.md

@@ -43,24 +43,24 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a
 
 **Langchain**
 
-[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
+[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
 
-[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
+[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
 
 **Llama-Index**
 
-[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
+[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
 
-[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)
+[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)
 
 **No Framework**
 
-[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
+[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
 
-[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)
+[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)
 
 
 ## TruLens-Explain

docs/trulens_eval/gh_top_intro.md

@@ -43,21 +43,21 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a
 
 **Langchain**
 
-[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
+[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
 
-[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
+[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
 
 **Llama-Index**
 
-[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
+[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
 
-[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)
+[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)
 
 **No Framework**
 
-[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
+[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
 
-[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)
+[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)

docs/trulens_eval/intro.md

@@ -46,24 +46,24 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a
 
 **Langchain**
 
-[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
+[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
 
-[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
+[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
 
 **Llama-Index**
 
-[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
+[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
 
-[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)
+[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)
 
 **No Framework**
 
-[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
+[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
 
-[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)
+[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)
 
 ### 💡 Contributing
 

trulens_eval/README.md

@@ -46,24 +46,24 @@ TruLens supports the evaluation of tracking for any LLM app framework. Choose a
 
 **Langchain**
 
-[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
+[langchain_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/langchain_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb)
 
-[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
+[langchain_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/langchain_quickstart.py).
 
 **Llama-Index**
 
-[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
+[llama_index_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/llama_index_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/llama_index_quickstart_colab.ipynb)
 
-[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)
+[llama_index_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/llama_index_quickstart.py)
 
 **No Framework**
 
-[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
+[text2text_quickstart.ipynb](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/text2text_quickstart.ipynb).
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/colab/text2text_quickstart_colab.ipynb)
 
-[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.15.3/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)
+[text2text_quickstart.py](https://github.com/truera/trulens/blob/releases/rc-trulens-eval-0.16.0/trulens_eval/examples/quickstart/py_script_quickstarts/text2text_quickstart.py)
 
 ### 💡 Contributing
 

trulens_eval/examples/expositional/vector-dbs/pinecone/pinecone_evals_build_better_rags.ipynb

@@ -41,7 +41,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "!pip install -qU trulens-eval==0.15.3 langchain==0.0.315 openai==0.28.1 tiktoken==0.5.1 \"pinecone-client[grpc]==2.2.4\" pinecone-datasets==0.5.1 datasets==2.14.5"
+    "!pip install -qU trulens-eval==0.16.0 langchain==0.0.315 openai==0.28.1 tiktoken==0.5.1 \"pinecone-client[grpc]==2.2.4\" pinecone-datasets==0.5.1 datasets==2.14.5"
    ]
   },
   {

trulens_eval/examples/quickstart/colab/langchain_quickstart_colab.ipynb

@@ -17,7 +17,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "9006f7e5",
+   "id": "43c40f8c",
    "metadata": {},
    "source": [
     "# Langchain Quickstart\n",
@@ -30,17 +30,17 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "e7a4cb73",
+   "id": "7252cea6",
    "metadata": {},
    "outputs": [],
    "source": [
-    "# ! pip install trulens_eval==0.15.3 langchain>=0.0.263"
+    "# ! pip install trulens_eval==0.16.0 langchain>=0.0.263"
    ]
   },
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "4ab38498",
+   "id": "c9cad9a4",
    "metadata": {},
    "source": [
     "## Setup\n",
@@ -51,7 +51,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "568b10ef",
+   "id": "7f1ac901",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -63,7 +63,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "530f1fb0",
+   "id": "e32c71ae",
    "metadata": {},
    "source": [
     "### Import from LangChain and TruLens"
@@ -72,7 +72,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "7171031d",
+   "id": "837c1cbd",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -95,7 +95,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "89cc5a91",
+   "id": "29e890d1",
    "metadata": {},
    "source": [
     "### Create Simple LLM Application\n",
@@ -106,7 +106,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "45e6a3db",
+   "id": "0841bc6a",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -128,7 +128,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "ba6384b0",
+   "id": "03d83080",
    "metadata": {},
    "source": [
     "### Send your first request"
@@ -137,7 +137,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "c78eba16",
+   "id": "0b0164c8",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -147,7 +147,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "b644712a",
+   "id": "e35d82cc",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -159,7 +159,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "c1fd9e81",
+   "id": "91eb2148",
    "metadata": {},
    "source": [
     "## Initialize Feedback Function(s)"
@@ -168,7 +168,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "31cef648",
+   "id": "75262341",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -184,7 +184,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "1741be4e",
+   "id": "f41ccf78",
    "metadata": {},
    "source": [
     "## Instrument chain for logging with TruLens"
@@ -193,7 +193,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "7c6acdf0",
+   "id": "16aa7a47",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -205,7 +205,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "f44c9977",
+   "id": "56ab4066",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -217,7 +217,7 @@
   },
   {
    "cell_type": "markdown",
-   "id": "81d7e1c6",
+   "id": "ac14bb88",
    "metadata": {},
    "source": [
     "## Retrieve records and feedback"
@@ -226,7 +226,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "e71c86ef",
+   "id": "6b227bd2",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -241,7 +241,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "c68972e3",
+   "id": "9bd6dc55",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -263,7 +263,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "5e92c52f",
+   "id": "a271adc2",
    "metadata": {},
    "source": [
     "## Explore in a Dashboard"
@@ -272,7 +272,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "427b551a",
+   "id": "b0f2a3b1",
    "metadata": {},
    "outputs": [],
    "source": [
@@ -284,7 +284,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "4eb451d6",
+   "id": "d59c64a2",
    "metadata": {},
    "source": [
     "Alternatively, you can run `trulens-eval` from a command line in the same folder to start the dashboard."
@@ -293,7 +293,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "2d79a878",
+   "id": "6249580d",
    "metadata": {},
    "source": [
     "### Chain Leaderboard\n",
@@ -326,7 +326,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "2cc19084",
+   "id": "e6d8282a",
    "metadata": {},
    "source": [
     "Note: Feedback functions evaluated in the deferred manner can be seen in the \"Progress\" page of the TruLens dashboard."
@@ -335,7 +335,7 @@
   {
    "attachments": {},
    "cell_type": "markdown",
-   "id": "1c499778",
+   "id": "def6bf2c",
    "metadata": {},
    "source": [
     "## Or view results directly in your notebook"
@@ -344,7 +344,7 @@
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "004879bf",
+   "id": "8ea1b983",
    "metadata": {},
    "outputs": [],
    "source": [