machine-learning-ops plugin
ML pipeline design, experiment tracking, model evaluation, training debugging, and reproducibility.
How to install the machine-learning-ops plugin
Run both commands inside Claude Code. The first adds the marketplace once; the second installs the plugin.
/plugin marketplace add yeaight7/agent-powerups
/plugin install machine-learning-ops@agent-powerupsWhat's inside machine-learning-ops
15 parts read from the plugin's own files.
Commands 4
Run as /machine-learning-ops:name- /machine-learning-ops:evaluation-report<model_metrics_json_or_evaluation_log>
Generate a comprehensive evaluation report for a trained model, highlighting performance, baselines, and subgroup metrics.
- /machine-learning-ops:experiment-preflight<training_script_path>
Audit an ML training script or pipeline for reproducibility, tracking, and basic hygiene before a long run.
- /machine-learning-ops:leakage-check<preprocessing_script_path>
Audit data preprocessing and splitting logic for target leakage.
- /machine-learning-ops:ml-run-review
No description in the file.
Agents 4
Call as @agent-machine-learning-ops:name- @agent-machine-learning-ops:leakage-auditorinherit
Specialized agent for detecting data leakage, train-test contamination, and temporal leakage in ML pipelines.
- @agent-machine-learning-ops:ml-experiment-reviewerinherit
Evaluates ML experiment setups for rigorous baseline comparisons, proper metric tracking, and reproducibility.
- @agent-machine-learning-ops:model-evaluation-analystsonnet
Audits evaluation code to ensure test sets are clean, metrics are appropriate for the problem, and confidence intervals are computed.
- @agent-machine-learning-ops:training-pipeline-debuggerinherit
Diagnoses and resolves training loop bottlenecks, memory leaks, vanishing gradients, and hardware underutilization.
Skills 7
Claude loads it when the task matches- baseline-comparison-review
No description in the file.
- dataset-split-review
No description in the file.
- experiment-tracking-review
No description in the file.
- ml-leakage-check
No description in the file.
- model-evaluation-reporting
No description in the file.
- reproducible-training-runs
No description in the file.
- training-pipeline-debugging
No description in the file.
Using machine-learning-ops in Claude Code
Type a command in a Claude Code session:
/machine-learning-ops:evaluation-report <model_metrics_json_or_evaluation_log>
/machine-learning-ops:experiment-preflight <training_script_path>
/machine-learning-ops:leakage-check <preprocessing_script_path>Ask for an agent by name:
@agent-machine-learning-ops:leakage-auditor
@agent-machine-learning-ops:ml-experiment-reviewerSkills need no command. Claude reads them when your request matches what they describe.
Update, turn off or remove
- Update the plugin (shell)
- claude plugin update machine-learning-ops@agent-powerups
- Refresh the marketplace
- /plugin marketplace update agent-powerups
- Turn it off for now
- /plugin disable machine-learning-ops@agent-powerups
- Remove it
- /plugin uninstall machine-learning-ops@agent-powerups
machine-learning-ops plugin questions
How do I install the machine-learning-ops plugin?
In Claude Code run /plugin marketplace add yeaight7/agent-powerups, then /plugin install machine-learning-ops@agent-powerups.
What does the machine-learning-ops plugin include?
machine-learning-ops bundles 4 commands, 4 agents, 7 skills.
What commands does the machine-learning-ops plugin add?
It adds /machine-learning-ops:evaluation-report, /machine-learning-ops:experiment-preflight, /machine-learning-ops:leakage-check, /machine-learning-ops:ml-run-review. Run them in Claude Code with the plugin prefix, for example /machine-learning-ops:evaluation-report.
Which agents come with machine-learning-ops?
leakage-auditor, ml-experiment-reviewer, model-evaluation-analyst, training-pipeline-debugger. Call one with @agent-machine-learning-ops:leakage-auditor.
How do I update or remove the machine-learning-ops plugin?
Update it with claude plugin update machine-learning-ops@agent-powerups in your shell, or from the Installed tab of /plugin. Remove it with /plugin uninstall machine-learning-ops@agent-powerups.
What license is the machine-learning-ops plugin under?
Apache-2.0, as stated in the plugin's manifest.