qa-feature-flags plugin
Feature-flag and experimentation testing: LaunchDarkly and OpenFeature SDK tests, flag test matrices, A/B test validity, and experiment result analysis. Covers Unleash, Flagsmith and GrowthBook through OpenFeature, and hermetic harnesses for Statsig, Optimizely, Split.io, Amplitude Experiment and VWO. Agents (flag-coverage-gap-detector, stale-flag-detector, sample-ratio-mismatch-detector) find untested flag branches, stale flags, and sample ratio mismatch. Distinct from qa-test-environment/feature-flag-test-harness and qa-shift-right/feature-flag-experiment-validator.
How to install the qa-feature-flags plugin
Run both commands inside Claude Code. The first adds the marketplace once; the second installs the plugin.
/plugin marketplace add testland/qa
/plugin install qa-feature-flags@testland-qaWhat's inside qa-feature-flags
8 parts read from the plugin's own files.
Agents 3
Call as @agent-qa-feature-flags:name- @agent-qa-feature-flags:flag-coverage-gap-detectorsonnet
Use proactively after a feature flag is added or changed. Finds flag evaluation call sites whose off path, fallthrough path or non-default variants no test exercises, and ranks the untested branches. Finding flags to remove is stale-flag-detector.
- @agent-qa-feature-flags:sample-ratio-mismatch-detectorsonnet
Use proactively at the end of an A/B test before any ship decision, or when results look surprising. Runs a chi-square test on observed vs expected allocation and, when there is a sample ratio mismatch, lists the likely causes such as logging bugs, bot filtering, redirects or randomization bugs.
- @agent-qa-feature-flags:stale-flag-detectorsonnet
Use proactively for a monthly or quarterly feature-flag debt audit, or before a major refactor. Finds flags at 100% rollout, untouched kill switches, shipped experiments and orphan flags, ranks them for removal and gives a safe removal runbook for each.
Skills 5
Claude loads it when the task matches- ab-test-validity-checklist
Generates pre-flight and post-flight checklists to audit A/B test design, randomization, sample ratio mismatch, and statistical validity.
- experiment-results-interpreter
No description in the file.
- experiment-sdk-testing
No description in the file.
- launchdarkly-testing
No description in the file.
- openfeature-sdk-testing
No description in the file.
Using qa-feature-flags in Claude Code
Ask for an agent by name:
@agent-qa-feature-flags:flag-coverage-gap-detector
@agent-qa-feature-flags:sample-ratio-mismatch-detectorSkills need no command. Claude reads them when your request matches what they describe.
Update, turn off or remove
- Update the plugin (shell)
- claude plugin update qa-feature-flags@testland-qa
- Refresh the marketplace
- /plugin marketplace update testland-qa
- Turn it off for now
- /plugin disable qa-feature-flags@testland-qa
- Remove it
- /plugin uninstall qa-feature-flags@testland-qa
Skills in qa-feature-flags
- ab-test-validity-checklisttestland/qa
Generates pre-flight and post-flight checklists to audit A/B test design, randomization, sample ratio mismatch, and statistical validity.
3 files13stars
qa-feature-flags plugin questions
How do I install the qa-feature-flags plugin?
In Claude Code run /plugin marketplace add testland/qa, then /plugin install qa-feature-flags@testland-qa.
What does the qa-feature-flags plugin include?
qa-feature-flags bundles 3 agents, 5 skills.
Which agents come with qa-feature-flags?
flag-coverage-gap-detector, sample-ratio-mismatch-detector, stale-flag-detector. Call one with @agent-qa-feature-flags:flag-coverage-gap-detector.
How do I update or remove the qa-feature-flags plugin?
Update it with claude plugin update qa-feature-flags@testland-qa in your shell, or from the Installed tab of /plugin. Remove it with /plugin uninstall qa-feature-flags@testland-qa.
What license is the qa-feature-flags plugin under?
MIT, as stated in the plugin's manifest.