Skip to main content

Label Studio

Label Studio is an open-source data labeling platform that provides LangChain with flexibility when it comes to labeling data for fine-tuning large language models (LLMs). It also enables the preparation of custom training data and the collection and evaluation of responses through human feedback.

Installation and Setup​

See the Label Studio installation guide for installation options.

We need to install the label-studio and label-studio-sdk-python Python packages:

pip install label-studio label-studio-sdk

Callbacks​

See a usage example.

from langchain.callbacks import LabelStudioCallbackHandler