model-evaluation
This plugin provides comprehensive model evaluation beyond accuracy, including sklearn classification metrics with bootstrap confidence intervals, probability calibration analysis, sliced evaluation by subgroup, fairness metrics (demographic parity, equalized odds), and LLM output quality assessment using BERTScore and RAGAS. It includes an agent expert in evaluation patterns, reusable code skills for calibration and statistical testing, and a command-line workflow for generating full evaluation reports, fairness analysis, and model comparisons.
Install
Source: https://github.com/Ormus-Solutions/LibreMLOps-Claude-Code/tree/HEAD/plugins/model-evaluation
What it's made of
1 command · 1 agent · 1 skill
- Commands
- 1
- Agents
- 1
- Skills
- 1
- MCP servers
- 0
- Hooks
- 0
What it needs & plugs into
- API keys
- none
- Paid services
- none detected
- External tools
- none
- Talks to
- nothing external detected
Analyzed . Facts extracted from the plugin's files. Prose generated by claude-haiku-4-5-20251001.
Is this your plugin?
Claim it to keep the card accurate and enter the weekly contest. Requires signing in as the GitHub owner (Ormus-Solutions).