Web app
ManagePrompt
ManagePrompt is a local LLM call debugger that captures every API call during development. It provides request/response details, token usage, cost estimation, and latency in a local web UI.
- Platform
- Web app
- Categories
- AI Analytics Assistant
- Indexed
- 2024-03-19
About ManagePrompt
What is ManagePrompt
ManagePrompt is an open-source local LLM call debugger designed for developers. It captures every LLM API call made during development, providing full request and response bodies, token usage, cost estimation, and latency. The tool runs a local web UI that displays this information in real-time, helping developers debug and optimize their LLM integrations.
Key features
ManagePrompt offers full capture of request and response bodies with visual flow visualization. It tracks input, output, cache read, and write tokens for every call. Real-time cost estimation is calculated using models.dev pricing data. It captures both streaming and non-streaming calls automatically. The UI is powered by WebSocket for live updates. Each project directory has its own SQLite database, requiring zero configuration.
Use cases
ManagePrompt is used during development to debug LLM API calls. It helps developers inspect the exact data sent and received, monitor token usage to manage costs, and analyze latency. It works with any LLM API, including OpenAI, Anthropic, Google, Mistral, and more. Integration is simple with two lines of code using the AI SDK middleware or the capture() function.
Pricing
ManagePrompt is open source and free to use. It can be installed via Homebrew, Go, or npm. The npm package is used to capture LLM calls from your app, while the server runs the local web UI.
Questions
ManagePrompt FAQ
- What is ManagePrompt?
- ManagePrompt is an AI tool available as a web app in the AI Analytics Assistant category. ManagePrompt is a local LLM call debugger that captures every API call during development. It provides request/response details, token usage, cost estimation, and latency in a local web UI.
- What is ManagePrompt used for?
- ManagePrompt is filed under AI Analytics Assistant in the AITOOLIST index. ManagePrompt is a local LLM call debugger that captures every API call during development. It provides request/response details, token usage, cost estimation, and latency in a local web UI.
- Is ManagePrompt a web app, an extension or a native app?
- ManagePrompt is a web app.
Listed in the AITOOLIST index since 2024-03-19.