A pluggable LLMOps toolkit for TypeScript applications.
Learn more »
Discord
·
Issues
LLMOps is an open-source, pluggable toolkit designed for TypeScript teams to streamline LLM operations with a focus on developer experience. It provides a comprehensive solution for integrating, managing, and monitoring Large Language Model providers in your applications.
- Unified Provider Interface: Support for 70+ LLM providers including OpenAI, Anthropic, Azure, Bedrock, Mistral, and more
- OpenAI SDK Compatible: Drop-in replacement API that works with any OpenAI SDK client - just change the base URL
- Prompt Management: Version, organize, and deploy prompts with a centralized prompt registry
- Observability: Full request/response logging, cost tracking, and performance monitoring
- TypeScript-First: Built with TypeScript for excellent type safety and developer experience
Visit our documentation for detailed setup instructions and examples.
We welcome contributions! Please see our Contributing Guide for details on how to get started.
Whether you're fixing bugs, improving documentation, or proposing new features, we appreciate your help in making LLMOps better.