tensorzero

TensorZero is an open-source stack for industrial-grade LLM applications

TensorZero is an open-source stack for industrial-grade LLM applications. Gateway: access every LLM provider through a unified API low latency Observability: monitor your LLM systems, programmatically or with a UI Optimization: optimize your prompts, models, and inference strategies Evaluations: benchmark individual inferences or end-to-end workflows Experimentation: deploy with built-in A/B testing, fallbacks, etc.

homepage ↗ github: tensorzero/tensorzero