TensorZero

Open-source LLM infrastructure

TensorZero is an open-source platform designed to streamline the deployment and management of large language models (LLMs). It supports integration with various SDKs including Python and OpenAI, and offers a robust HTTP API. Users can quickly set up LLM applications with features like observability and fine-tuning. A notable use case includes automating code changelogs for large banks, demonstrating its industrial-grade capability.