Helicone provides one-line LLM observability — add a single line to your OpenAI calls…

Opik by Comet is an open-source LLM evaluation framework for testing AI application quality…

Langfuse is an open-source LLM engineering platform for observability, testing, and prompt management. Debug…

PromptLayer is a platform for tracking, managing, and evaluating LLM prompts in production. Log…

Guardrails AI adds input/output validation to LLM applications. Define rules for what the LLM…

LiteLLM provides a unified API for 100+ LLM providers using the OpenAI format. Switch…

Instructor makes it easy to get structured outputs from LLMs using Python type hints.…

LlamaIndex is a data framework for building LLM-powered applications over your data. Simple connectors…

DSPy is a framework for algorithmically optimizing LLM prompts and weights. Instead of manually…

Milvus is a cloud-native vector database built for billion-scale AI applications. Handles trillion-dimensional vectors…