Plugin inference-cache
Inference KV-cache and transport suite — LMCache multiprocess (MP) standalone-server mode (DaemonSet + Deployment K8s pattern, ZMQ connector, L1 + L2 NIXL/POSIX/GDS/HF3FS/fs/s3/mooncake adapters) and NVIDIA NIXL transfer library (UCX/GDS/Mooncake/libfabric/HF3FS/S3 plugins, agent API, telemetry) used by Dynamo/vLLM/SGLang. Pairs with the vllm-caching skill in the `vllm` suite and sglang-hicache in the `sglang` suite.
Cara install plugin inference-cache
Jalankan kedua perintah di dalam Claude Code. Perintah pertama menambahkan marketplace sekali; perintah kedua meng-install plugin.
/plugin marketplace add air-gapped/skills
/plugin install inference-cache@air-gapped-marketplaceApa yang ada di dalam inference-cache
2 bagian dibaca dari file asli plugin tersebut.
Skills 2
Claude memuatnya saat tugas sesuai- lmcache-mp
Enables a standalone LMCache server in a separate process or pod that vLLM connects to via ZMQ for shared KV-cache and process isolation.
- nvidia-nixl
Provides a transport abstraction for point-to-point KV-cache and tensor transfers in distributed inference environments.
Menggunakan inference-cache di Claude Code
SKILL tidak memerlukan command. Claude membacanya saat permintaan Anda sesuai dengan deskripsinya.
Update, matikan, atau hapus
- Update plugin (shell)
- claude plugin update inference-cache@air-gapped-marketplace
- Refresh marketplace
- /plugin marketplace update air-gapped-marketplace
- Matikan untuk sementara
- /plugin disable inference-cache@air-gapped-marketplace
- Hapus
- /plugin uninstall inference-cache@air-gapped-marketplace
Skill dalam inference-cache
- lmcache-mpair-gapped/skills
Enables a standalone LMCache server in a separate process or pod that vLLM connects to via ZMQ for shared KV-cache and process isolation.
8 file6bintang - nvidia-nixlair-gapped/skills
Provides a transport abstraction for point-to-point KV-cache and tensor transfers in distributed inference environments.
12 file6bintang
Pertanyaan tentang plugin inference-cache
Bagaimana cara install plugin inference-cache?
Di Claude Code, jalankan /plugin marketplace add air-gapped/skills, lalu /plugin install inference-cache@air-gapped-marketplace.
Apa saja yang disertakan plugin inference-cache?
inference-cache membundel 2 skill.
Bagaimana cara update atau menghapus plugin inference-cache?
Update dengan claude plugin update inference-cache@air-gapped-marketplace di shell Anda, atau dari tab Installed di /plugin. Hapus dengan /plugin uninstall inference-cache@air-gapped-marketplace.
Apa lisensi untuk plugin inference-cache?
MIT, sebagaimana dinyatakan dalam manifest plugin.