Plugin vllm
vLLM operator reference suite — deployment, configuration, quantization, caching, KV, tool parsers, reasoning parsers, chat templates, benchmarking, performance tuning, observability, omni, input modalities, speculative decoding, NVIDIA hardware, and a Gemma 4 31B operating-point serve recipe.
Cara install plugin vllm
Jalankan kedua perintah di dalam Claude Code. Perintah pertama menambahkan marketplace sekali; perintah kedua meng-install plugin.
/plugin marketplace add air-gapped/skills
/plugin install vllm@air-gapped-marketplaceApa yang ada di dalam vllm
15 bagian dibaca dari file asli plugin tersebut.
Skills 15
Claude memuatnya saat tugas sesuai- vllm-benchmarking
Run production-grade benchmarks for vLLM to measure latency, throughput, and SLO compliance using various subcommands and methodologies.
- vllm-caching
Configures tiered KV cache offloading for vLLM production clusters using CPU, NVMe, and RDMA backends.
- vllm-chat-templates
Provides a reference for managing Jinja-based chat templates, resolution precedence, and troubleshooting prompt-rendering issues in vLLM deployments.
- vllm-configuration
Configure vLLM deployment settings via YAML, CLI arguments, and environment variables, including specialized setups for air-gapped environments.
- vllm-deployment
Helps agents author, review, and fix vLLM deployment manifests for Kubernetes, Docker, and OpenShift, including multi-node and MoE configurations.
- vllm-gemma-4-31b
Provides optimized deployment configurations and performance benchmarks for serving Gemma 4 31B on vLLM hardware.
- vllm-input-modalities
Configure and deploy non-chat inference endpoints for text embeddings, reranking, speech-to-text, and document OCR using vLLM.
- vllm-nvidia-hardware
Provides technical specifications and deployment guidance for NVIDIA AI hardware ranging from Hopper to Vera Rubin architectures for vLLM workloads.
- vllm-observability
Monitor and troubleshoot production vLLM deployments using Prometheus metrics, Grafana dashboards, and OTLP tracing.
- vllm-omni
Extends vLLM to support multimodal generation for images, video, audio, and any-to-any omni models via a plugin layer.
- vllm-performance-tuning
Optimizes vLLM performance through MoE kernel autotuning, parallelism configuration, scheduler knob adjustment, and distributed system tuning.
- vllm-quantization
Configures and troubleshoots GPU quantization formats and KV-cache dtypes for high-performance LLM serving on NVIDIA and AMD hardware.
- vllm-reasoning-parsers
Enables agents to split model output into distinct reasoning and content fields using specialized parsers for thinking models.
- vllm-speculative-decoding
Configure, tune, and monitor speculative decoding methods in vLLM production environments to improve inference throughput.
- vllm-tool-parsers
Provides a navigation map for selecting, configuring, and debugging tool-calling parsers within vLLM deployments.
Menggunakan vllm di Claude Code
SKILL tidak memerlukan command. Claude membacanya saat permintaan Anda sesuai dengan deskripsinya.
Update, matikan, atau hapus
- Update plugin (shell)
- claude plugin update vllm@air-gapped-marketplace
- Refresh marketplace
- /plugin marketplace update air-gapped-marketplace
- Matikan untuk sementara
- /plugin disable vllm@air-gapped-marketplace
- Hapus
- /plugin uninstall vllm@air-gapped-marketplace
Skill dalam vllm
- vllm-benchmarkingair-gapped/skills
Run production-grade benchmarks for vLLM to measure latency, throughput, and SLO compliance using various subcommands and methodologies.
11 file6bintang - vllm-configurationair-gapped/skills
Configure vLLM deployment settings via YAML, CLI arguments, and environment variables, including specialized setups for air-gapped environments.
12 file6bintang - vllm-deploymentair-gapped/skills
Helps agents author, review, and fix vLLM deployment manifests for Kubernetes, Docker, and OpenShift, including multi-node and MoE configurations.
18 file6bintang - vllm-gemma-4-31bair-gapped/skills
Provides optimized deployment configurations and performance benchmarks for serving Gemma 4 31B on vLLM hardware.
8 file6bintang - vllm-observabilityair-gapped/skills
Monitor and troubleshoot production vLLM deployments using Prometheus metrics, Grafana dashboards, and OTLP tracing.
9 file6bintang - vllm-quantizationair-gapped/skills
Configures and troubleshoots GPU quantization formats and KV-cache dtypes for high-performance LLM serving on NVIDIA and AMD hardware.
13 file6bintang - vllm-speculative-decodingair-gapped/skills
Configure, tune, and monitor speculative decoding methods in vLLM production environments to improve inference throughput.
15 file6bintang - vllm-cachingair-gapped/skills
Configures tiered KV cache offloading for vLLM production clusters using CPU, NVMe, and RDMA backends.
8 file6bintang - vllm-chat-templatesair-gapped/skills
Provides a reference for managing Jinja-based chat templates, resolution precedence, and troubleshooting prompt-rendering issues in vLLM deployments.
10 file6bintang - vllm-input-modalitiesair-gapped/skills
Configure and deploy non-chat inference endpoints for text embeddings, reranking, speech-to-text, and document OCR using vLLM.
11 file6bintang - vllm-nvidia-hardwareair-gapped/skills
Provides technical specifications and deployment guidance for NVIDIA AI hardware ranging from Hopper to Vera Rubin architectures for vLLM workloads.
12 file6bintang - vllm-omniair-gapped/skills
Extends vLLM to support multimodal generation for images, video, audio, and any-to-any omni models via a plugin layer.
9 file6bintang - vllm-performance-tuningair-gapped/skills
Optimizes vLLM performance through MoE kernel autotuning, parallelism configuration, scheduler knob adjustment, and distributed system tuning.
8 file6bintang - vllm-reasoning-parsersair-gapped/skills
Enables agents to split model output into distinct reasoning and content fields using specialized parsers for thinking models.
10 file6bintang - vllm-tool-parsersair-gapped/skills
Provides a navigation map for selecting, configuring, and debugging tool-calling parsers within vLLM deployments.
9 file6bintang
Pertanyaan tentang plugin vllm
Bagaimana cara install plugin vllm?
Di Claude Code, jalankan /plugin marketplace add air-gapped/skills, lalu /plugin install vllm@air-gapped-marketplace.
Apa saja yang disertakan plugin vllm?
vllm membundel 15 skill.
Bagaimana cara update atau menghapus plugin vllm?
Update dengan claude plugin update vllm@air-gapped-marketplace di shell Anda, atau dari tab Installed di /plugin. Hapus dengan /plugin uninstall vllm@air-gapped-marketplace.
Apa lisensi untuk plugin vllm?
MIT, sebagaimana dinyatakan dalam manifest plugin.