Every AI tool you need, in one place.

TruLens is an open-source framework for evaluating and tracking LLM applications. Feedback functions assess truthfulness, harmlessness, and helpfulness…

Phoenix by Arize is an open-source AI observability library for ML engineers. Traces LLM and embedding applications, visualizes…

Braintrust is an enterprise AI evaluation platform for measuring, improving, and shipping AI applications. Logging, evaluation datasets, prompt…

Helicone provides one-line LLM observability — add a single line to your OpenAI calls and get full logging,…

Opik by Comet is an open-source LLM evaluation framework for testing AI application quality at scale. Automated evaluation…

Langfuse is an open-source LLM engineering platform for observability, testing, and prompt management. Debug production AI issues, evaluate…

PromptLayer is a platform for tracking, managing, and evaluating LLM prompts in production. Log every prompt and completion,…

Guardrails AI adds input/output validation to LLM applications. Define rules for what the LLM can and cannot say,…

LiteLLM provides a unified API for 100+ LLM providers using the OpenAI format. Switch between GPT-4, Claude, Gemini,…

Instructor makes it easy to get structured outputs from LLMs using Python type hints. Define a Pydantic model…