PlugMyPlugin
← Browse

llmprobe

Jwrede ★ 6

llmprobe is a CLI tool for synthetic monitoring of LLM inference endpoints that measures TTFT, latency, throughput, and error rates across OpenAI, Anthropic, Google, Azure OpenAI, AWS Bedrock, and OpenAI-compatible servers. It runs as a single binary with zero external SDKs and can be deployed as a one-off health check, continuous monitor, or CI gate using the included MCP server.

Install

> /plugin marketplace add Jwrede/llmprobe
> /plugin install llmprobe

Source: https://github.com/Jwrede/llmprobe

What it's made of

1 MCP server

Commands
0
Agents
0
Skills
0
MCP servers
1
Hooks
0

What it needs & plugs into

API keys
none
Paid services
none detected
External tools
llmprobe
Talks to
nothing external detected

Facts extracted from the plugin's files. Prose generated by claude-haiku-4-5-20251001.

Is this your plugin?

Claim it to keep the card accurate and enter the weekly contest. Requires signing in as the GitHub owner (Jwrede).