sglang plugin
SGLang operator reference suite — HiCache (three-tier hierarchical prefix cache: GPU HBM → host DRAM → distributed L3 via Mooncake/3FS/NIXL/AIBrix/EIC/SiMM/file/LMCache) and the SGLang Model Gateway (`sgl-model-gateway`, formerly `sgl-router`) — Rust router fronting vLLM/SGLang inference workers on Kubernetes with cache-aware/prefix-hash/consistent-hash routing, K8s label-selector service discovery, PD-disaggregation, and `--enable-mesh` CRDT sync between gateway replicas. Pairs with the `vllm` suite for vLLM-side reference and `inference-cache` for engine-agnostic KV-cache transport.
How to install the sglang plugin
Run both commands inside Claude Code. The first adds the marketplace once; the second installs the plugin.
/plugin marketplace add air-gapped/skills
/plugin install sglang@air-gapped-marketplaceWhat's inside sglang
2 parts read from the plugin's own files.
Skills 2
Claude loads it when the task matches- sglang-hicache
Manages a three-tier hierarchical KV cache across GPU HBM, host DRAM, and distributed storage to accelerate long-context inference.
- sglang-model-gateway
A Rust-based router that provides cache-aware load balancing for vLLM and SGLang inference workers on Kubernetes.
Using sglang in Claude Code
Skills need no command. Claude reads them when your request matches what they describe.
Update, turn off or remove
- Update the plugin (shell)
- claude plugin update sglang@air-gapped-marketplace
- Refresh the marketplace
- /plugin marketplace update air-gapped-marketplace
- Turn it off for now
- /plugin disable sglang@air-gapped-marketplace
- Remove it
- /plugin uninstall sglang@air-gapped-marketplace
Skills in sglang
- sglang-hicacheair-gapped/skills
Manages a three-tier hierarchical KV cache across GPU HBM, host DRAM, and distributed storage to accelerate long-context inference.
14 files6stars - sglang-model-gatewayair-gapped/skills
A Rust-based router that provides cache-aware load balancing for vLLM and SGLang inference workers on Kubernetes.
15 files6stars
sglang plugin questions
How do I install the sglang plugin?
In Claude Code run /plugin marketplace add air-gapped/skills, then /plugin install sglang@air-gapped-marketplace.
What does the sglang plugin include?
sglang bundles 2 skills.
How do I update or remove the sglang plugin?
Update it with claude plugin update sglang@air-gapped-marketplace in your shell, or from the Installed tab of /plugin. Remove it with /plugin uninstall sglang@air-gapped-marketplace.
What license is the sglang plugin under?
MIT, as stated in the plugin's manifest.