Permet à un agent IA de piloter et de tester des applications mobiles, web et desktop via des actions E2E en langage naturel.
Aussi connu sous ai-dashboad/flutter-skill
- Étoiles
- 407
- Outils
- —
- Téléchargements, 30 jours
- —
- Dernière version
- 0.9.36
- Dernier commit
- 1 sept. 2026
- Licence
- MIT
Qu'est-ce que flutter-skill MCP ?
Permet à un agent IA de piloter et de tester des applications mobiles, web et desktop via des actions E2E en langage naturel.
Résumé généré à partir du README du projet
À propos du MCP server flutter-skill
Les développeurs qui conçoivent des applications mobiles, web et desktop peuvent utiliser flutter-skill pour donner aux agents IA la capacité d'interagir avec des logiciels en cours d'exécution via le langage naturel. En connectant ce MCP server à des clients compatibles comme Claude Desktop, Cursor ou Windsurf, un agent peut visualiser un écran et effectuer des actions telles que cliquer sur des boutons, saisir du texte ou faire défiler la page. Cette configuration élimine le besoin d'écrire du code de test manuel, des Page Objects ou des XPaths fragiles.
Le serveur fonctionne selon deux modes principaux : un mode MCP stdio pour une intégration directe dans l'IDE et un mode HTTP serve pour l'automatisation via CLI et les pipelines CI/CD. Il prend en charge dix plateformes différentes, dont Flutter, React Native, Electron, Android et iOS. Au lieu de s'appuyer sur des captures d'écran coûteuses, il utilise un arbre d'accessibilité pour fournir un résumé sémantique de l'interface, ce qui réduit considérablement la consommation de tokens. Cela permet une exploration et des tests autonomes plus rapides et plus efficaces des flux d'applications complexes.
Ce que vous pouvez faire avec
- 1Tests de bout en bout autonomesDemandez à un agent IA de naviguer dans un flux utilisateur spécifique et de vérifier les résultats sans écrire de scripts.
- 2Détection automatisée de bugsDirigez une IA pour explorer l'intégralité d'une application afin de trouver et de signaler des erreurs fonctionnelles.
- 3Fuzz testing pour la stabilitéExécutez des actions aléatoires sur une application pour détecter d'éventuels crashs ou cas limites.
- 4Interaction UI efficaceUtilisez l'arbre d'accessibilité pour effectuer des interactions à haute vitesse comme des clics ou de la saisie de texte.
Extrait du README du projet. Chaque cas d'utilisation est vérifié par rapport à une citation du document.
Comment installer flutter-skill MCP
Formats vérifiés le 10 nov. 2026Ajouter à CursorAjouter à GooseInstaller flutter-skill MCP dans Claude Code
$ claude mcp add flutter-skill -- npx -y flutter-skillInstaller flutter-skill MCP dans Cursor
~/.cursor/mcp.json
{
"mcpServers": {
"flutter-skill": {
"command": "npx",
"args": [
"-y",
"flutter-skill"
]
}
}
}Installer flutter-skill MCP dans VS Code
.vscode/mcp.json
{
"servers": {
"flutter-skill": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"flutter-skill"
]
}
}
}Installer flutter-skill MCP dans VS Code CLI
$ code --add-mcp '{"name":"flutter-skill","type":"stdio","command":"npx","args":["-y","flutter-skill"]}'Installer flutter-skill MCP dans Claude Desktop
claude_desktop_config.json
{
"mcpServers": {
"flutter-skill": {
"command": "npx",
"args": [
"-y",
"flutter-skill"
]
}
}
}Installer flutter-skill MCP dans Codex
$ codex mcp add flutter-skill -- npx -y flutter-skillInstaller flutter-skill MCP dans Codex config.toml
~/.codex/config.toml
[mcp_servers.flutter-skill] command = "npx" args = ["-y", "flutter-skill"]
Installer flutter-skill MCP dans Gemini CLI
$ gemini mcp add -s user flutter-skill npx -- -y flutter-skillInstaller flutter-skill MCP dans Gemini settings.json
~/.gemini/settings.json
{
"mcpServers": {
"flutter-skill": {
"command": "npx",
"args": [
"-y",
"flutter-skill"
]
}
}
}Vérifications automatisées
Exécuté le 14 nov. 2026Rapport complet →A passé nos vérifications automatisées. Il ne s'agit pas d'un audit de sécurité : lisez le code et donnez au serveur l'accès le plus restreint dont il a besoin. Fonctionnement des vérifications
- Dépôt source lié et accessibleai-dashboad/flutter-skill is public and reachablegithub.com/ai-dashboad/flutter-skill ↗Réussi
- Le nom du package correspond au dépôt sourceflutter-skill names ai-dashboad/flutter-skill as sourcenpmjs.com/package/flutter-skill ↗Réussi
- Provenance du build (attestation Sigstore)No build attestation published for this releaseNon vérifié
- Licence open source (OSI)MITspdx.org/licenses/MIT.html ↗Réussi
- Commit ou version publiée au cours de l'année écouléeLast commit or release 2026-09-01github.com/ai-dashboad/flutter-skill ↗Réussi
- OpenSSF ScorecardNon vérifié
- Nom du package non proche d'un package populaireNo popular package one edit away from flutter-skillRéussi
- Aucun avis critique dans le package ou ses dépendancesthe package checked; no critical advisoryosv.dev ↗Réussi
- Aucune instruction cachée destinée au modèle0 tool descriptions and the README read; no override phrases, credential paths or hidden charactersRéussi
- Les outils destructifs sont étiquetésNon vérifié
- Le point de terminaison distant répond à la poignée de main MCPNon vérifié
README
Voir sur GitHub30-Second Demo
https://github.com/user-attachments/assets/d4617c73-043f-424c-9a9a-1a61d4c2d3c6
One prompt. 28 AI-driven actions. Zero test code. The AI explores a TikTok clone, navigates tabs, scrolls feeds, tests search, fills forms — all autonomously.
Why This Exists
Writing E2E tests is painful. Maintaining them is worse. flutter-skill takes a different approach:
- 🔌 Connects any AI agent (Claude, Cursor, Windsurf, Copilot, OpenClaw) directly to your running app via MCP
- 👀 The agent sees your screen — taps buttons, types text, scrolls, navigates — like a human tester who never sleeps
- ✅ Zero test code — no Page Objects, no XPath, no brittle selectors. Just plain English
- ⚡ Zero config — 2 lines of code, works on all 10 platforms
You: "Test the checkout flow with an empty cart, then add 3 items and complete purchase"
Your AI agent handles the rest — screenshots, taps, text entry, assertions, navigation.
No Page Objects. No XPath. No brittle selectors. Just plain English.
Quick Start
1. Install (30 seconds)
npm install -g flutter-skill
2. Add to your AI (copy-paste into MCP config)
{
"mcpServers": {
"flutter-skill": {
"command": "flutter-skill",
"args": ["server"]
}
}
}
Works with Claude Desktop, Cursor, Windsurf, Copilot, Cline, OpenClaw — any MCP-compatible agent.
3. Add to your app (2 lines for Flutter)
import 'package:flutter_skill/flutter_skill.dart';
void main() {
if (kDebugMode) FlutterSkillBinding.ensureInitialized();
runApp(MyApp());
}
4. Test — just talk to your AI:
"Launch my app, explore every screen, and report any bugs"
That's it. Zero configuration. Zero test code. Works in under 60 seconds.
| Method | Command |
|---|---|
| npm | npm install -g flutter-skill |
| Homebrew | brew install ai-dashboad/flutter-skill/flutter-skill |
| Scoop | scoop install flutter-skill |
| Docker | docker pull ghcr.io/ai-dashboad/flutter-skill |
| pub.dev | dart pub global activate flutter_skill |
| VSCode | Extensions → "Flutter Skill" |
| JetBrains | Plugins → "Flutter Skill" |
| Agent Skill | npx skills add ai-dashboad/flutter-skill |
| Zero-config | flutter-skill init (auto-detects & patches your app) |
Use with AI Platforms
MCP Server Mode (IDE Integration)
Works with any MCP-compatible AI tool. One config line:
{
"mcpServers": {
"flutter-skill": {
"command": "flutter-skill",
"args": ["server"]
}
}
}
| Platform | Config File | Status |
|---|---|---|
| Cursor | .cursor/mcp.json |
✅ |
| Claude Desktop | claude_desktop_config.json |
✅ |
| Windsurf | ~/.codeium/windsurf/mcp_config.json |
✅ |
| VSCode Copilot | .vscode/mcp.json |
✅ |
| Cline | VSCode Settings → Cline → MCP | ✅ |
| OpenClaw | Skill or MCP config | ✅ |
| Continue.dev | .continue/config.json |
✅ |
HTTP Serve Mode (CLI & Automation)
For standalone browser automation, CI/CD pipelines, or remote access:
# Start server
flutter-skill serve https://your-app.com
# Use CLI client commands
flutter-skill nav https://google.com
flutter-skill snap # Accessibility tree (99% fewer tokens)
flutter-skill screenshot /tmp/ss.jpg
flutter-skill tap "Login"
flutter-skill type "hello@example.com"
flutter-skill eval "document.title"
flutter-skill tools # List all available tools
| Command | Description |
|---|---|
nav <url> |
Navigate to URL |
snap |
Accessibility tree snapshot |
screenshot [path] |
Take screenshot |
tap <text|ref|x y> |
Tap element |
type <text> |
Type via keyboard |
key <key> [mod] |
Press key |
eval <js> |
Execute JavaScript |
title |
Get page title |
text |
Get visible text |
hover <text> |
Hover element |
upload <sel> <file> |
Upload file |
tools |
List tools |
call <tool> [json] |
Call any tool |
Supports --port=N, --host=H flags and FS_PORT/FS_HOST env vars.
Two Modes Compared
server (MCP stdio) |
serve (HTTP) |
|
|---|---|---|
| Use case | IDE / AI agent integration | CLI / automation / CI/CD |
| Protocol | MCP (JSON-RPC over stdio) | HTTP REST |
| Tools | 253 (dynamic per page) | 246 (generic) |
| Browser | Auto-launches Chrome | Connects to existing Chrome |
| Best for | Cursor, Claude, VSCode | OpenClaw, scripts, pipelines |
Full CLI client reference: docs/CLI_CLIENT.md
10 Platforms, One Tool
Most testing tools work on 1-2 platforms. flutter-skill works on 10.
| Platform | SDK | Test Score |
|---|---|---|
| Flutter (iOS/Android/Web) | flutter_skill |
✅ 188/195 |
| React Native | sdks/react-native |
✅ 75/75 |
| Electron | sdks/electron |
✅ 75/75 |
| Tauri (Rust) | sdks/tauri |
✅ 75/75 |
| Android (Kotlin) | sdks/android |
✅ 74/75 |
| KMP Desktop | sdks/kmp |
✅ 75/75 |
| .NET MAUI | sdks/dotnet-maui |
✅ 75/75 |
| iOS (Swift/UIKit) | sdks/ios |
✅ 19/19 |
| Web (any website) | sdks/web |
✅ |
| Web CDP (zero-config) | No SDK needed | ✅ 141/156 |
Total: 656/664 tests passing (98.8%) — each platform tested against a complex social media app with 50+ elements.
⚡ Performance
Real benchmarks from automated test runs against a complex social media app:
| Operation | Web (CDP) | Electron | Android |
|---|---|---|---|
connect |
93 ms | 55 ms | 103 ms |
tap |
1 ms | 1 ms | 2 ms |
enter_text |
1 ms | 1 ms | 2 ms |
inspect |
3 ms | 12 ms | 10 ms |
snapshot |
2 ms | 8 ms | 29 ms |
screenshot |
31 ms | 80 ms | 88 ms |
eval |
1 ms | — | — |
Token efficiency: snapshot() returns a structured element tree instead of an image — 87–99% fewer tokens than sending screenshots to your AI agent.
How fast is that? A tap takes 1–2 ms end-to-end. Browser automation tools like Playwright and Selenium typically take 50–100 ms for the same operation. That's 50–100× faster, because flutter-skill talks directly to the app runtime instead of going through WebDriver or CDP indirection.
Heavy DOM Sites (Real-World)
Tested 15 MCP tools against production websites — 75/75 passed, zero timeouts:
| Site | Tools | Total Time | snapshot |
screenshot |
count_elements |
|---|---|---|---|---|---|
| YouTube | 15/15 ✅ | 6.9s | 43 ms | 30 ms | 4 ms |
| Amazon | 15/15 ✅ | 14.2s | 1 ms | 5 ms | 2 ms |
| 15/15 ✅ | 17.9s | 6 ms | 32 ms | 51 ms | |
| Hacker News | 15/15 ✅ | 4.8s | 53 ms | 188 ms | 1 ms |
| Wikipedia | 15/15 ✅ | 7.8s | 15 ms | 336 ms | 1 ms |
Total time includes page load. Tool execution is consistently sub-100ms even on heavy DOM sites.
Why Not Playwright / Appium / Detox?
| flutter-skill | Playwright MCP | Appium | Detox | |
|---|---|---|---|---|
| MCP tools | 253 | ~33 | ❌ | ❌ |
| Platforms | 10 | 1 (web) | Mobile | React Native |
| Setup time | 30 sec | Minutes | Hours | Hours |
| Test code needed | ❌ None | ✅ Yes | ✅ Yes | ✅ Yes |
| AI-native (MCP) | ✅ | ✅ | ❌ | ❌ |
| Self-healing tests | ✅ | ❌ | ❌ | ❌ |
| Monkey/fuzz testing | ✅ | ❌ | ❌ | ❌ |
| Visual regression | ✅ | ❌ | ❌ | ❌ |
| Network mock/replay | ✅ | ❌ | ❌ | ❌ |
| API + UI testing | ✅ | ❌ | ❌ | ❌ |
| Multi-device sync | ✅ | ❌ | Partial | ❌ |
| Accessibility audit | ✅ | ❌ | ❌ | ❌ |
| i18n testing | ✅ | ❌ | ❌ | ❌ |
| Performance monitoring | ✅ | ❌ | ❌ | ❌ |
| Natural language | ✅ | ❌ | ❌ | ❌ |
| Flutter support | ✅ Native | Partial | Partial | ❌ |
| Desktop apps | ✅ | ✅ | ❌ | ❌ |
| AI page understanding | ✅ AX Tree | ❌ Screenshots | ❌ | ❌ | | Boundary/security test | ✅ 13 payloads | ❌ | ❌ | ❌ | | Batch actions | ✅ 5+/call | 1/call | 1/call | 1/call |
flutter-skill is the only AI-native E2E testing tool that works across mobile, web, and desktop — with 7× more tools than the nearest competitor.
CLI Commands
# 🤖 AI autonomous exploration — finds bugs automatically
flutter-skill explore https://my-app.com --depth=3
# 🐒 Monkey/fuzz testing — random actions, crash detection
flutter-skill monkey https://my-app.com --actions=100 --seed=42
# 🚀 Parallel multi-platform testing
flutter-skill test --url https://my-app.com --platforms web,electron,android
# 🌐 Zero-config WebMCP server — any website becomes testable
flutter-skill serve https://my-app.com
🧠 AI-Native: 95% Fewer Tokens
Most AI testing tools send screenshots to the LLM — each one costs ~4,000 tokens.
flutter-skill uses Chrome's Accessibility Tree to give your AI a compact semantic summary of any page:
// page_summary → ~200 tokens (vs ~4,000 for a screenshot)
{
"title": "Shopping Cart",
"nav": ["Home", "Products", "Cart", "Account"],
"forms": [{"input:Coupon Code": "text"}],
"buttons": ["Apply", "Checkout", "Continue Shopping"],
"features": {"search": true, "pagination": true},
"links": 47, "inputs": 3
}
Then batch multiple actions in one call:
// explore_actions → 5 actions per call (vs 5 separate tool calls)
{"actions": [
{"type": "fill", "target": "input:Coupon Code", "value": "SAVE20"},
{"type": "tap", "target": "button:Apply"},
{"type": "tap", "target": "button:Checkout"},
{"type": "fill", "target": "input:Email", "value": "test@example.com"},
{"type": "tap", "target": "button:Continue"}
]}
Result: Your AI agent tests faster, costs less, and understands pages better than screenshot-based tools.
| flutter-skill | Screenshot-based tools | |
|---|---|---|
| Tokens per page | ~200 | ~4,000 |
| Actions per call | 5+ | 1 |
| Understands semantics | ✅ roles, names, state | ❌ pixels only |
| Works with Shadow DOM | ✅ | ❌ |
What It Can Do
👀 See
screenshot— capture the screeninspect_interactive— all tappable/typeable elements with semantic refsfind_element/wait_for_elementget_elements— full element tree
👆 Interact
tap/long_press/swipe/dragenter_text/set_text/clear_textscroll— all directionsgo_back/press_key
🔍 Inspect (v0.8.0)
- Semantic refs:
button:Login,input:Email - Stable across UI changes
tap(ref: "button:Submit")- 7 roles: button, input, toggle, slider, select, link, item
🚀 Control
launch_app— launch with flavorshot_reload/hot_restartget_logs/get_errorsscan_and_connect— auto-find apps
AI Explore: page_summary, explore_actions, boundary_test, explore_report
Launch & Connect: launch_app, scan_and_connect, connect_cdp, hot_reload, hot_restart, list_sessions, switch_session, close_session, disconnect, stop_app
Screen: screenshot, screenshot_region, screenshot_element, native_screenshot, inspect, inspect_interactive, snapshot, get_widget_tree, find_by_type, get_text_content, get_visible_text
Interaction: tap, double_tap, long_press, enter_text, set_text, clear_text, swipe, scroll_to, drag, go_back, press_key, type_text, hover, fill, select_option, set_checkbox, focus, blur, native_tap, native_input_text, native_swipe
Smart Testing: smart_tap, smart_enter_text, smart_assert (self-healing with fuzzy match)
Assertions: assert_text, assert_visible, assert_not_visible, assert_element_count, assert_batch, wait_for_element, wait_for_gone, wait_for_idle, wait_for_stable, wait_for_url, wait_for_text, wait_for_element_count
Visual Regression: visual_baseline_save, visual_baseline_compare, visual_baseline_update, visual_regression_report, visual_verify, visual_diff, compare_screenshot
Network Mock: mock_api, mock_clear, record_network, replay_network, intercept_requests, clear_interceptions, block_urls, http_request
API Testing: api_request, api_assert
Coverage & Reliability: coverage_start, coverage_stop, coverage_report, coverage_gaps, retry_on_fail, stability_check
Data-Driven: test_with_data, generate_test_data
Multi-Device: multi_connect, multi_action, multi_compare, multi_disconnect, parallel_snapshot, parallel_tap
Accessibility: accessibility_audit, a11y_full_audit, a11y_tab_order, a11y_color_contrast, a11y_screen_reader
i18n: set_locale, verify_translations, i18n_snapshot
Performance: perf_start, perf_stop, perf_report, get_performance, get_frame_stats, get_memory_stats
Session: save_session, restore_session, session_diff
Recording & Export: record_start, record_stop, record_export (Playwright, Cypress, XCUITest, Espresso, Detox, Maestro, +5 more), video_start, video_stop
Auth: auth_inject_session, auth_biometric, auth_otp, auth_deeplink
CDP Browser: navigate, reload, go_forward, get_title, get_page_source, eval, get_tabs, new_tab, switch_tab, close_tab, get_cookies, set_cookie, clear_cookies, get_local_storage, set_local_storage, clear_local_storage, generate_pdf, set_viewport, emulate_device, throttle_network, go_offline, set_geolocation, set_timezone, set_color_scheme
Debug: get_logs, get_errors, get_console_messages, get_network_requests, diagnose, diagnose_project, reset_app
Platform Setup
dependencies:
flutter_skill: ^0.9.37
import 'package:flutter_skill/flutter_skill.dart';
void main() {
if (kDebugMode) FlutterSkillBinding.ensureInitialized();
runApp(MyApp());
}
npm install flutter-skill-react-native
import FlutterSkill from 'flutter-skill-react-native';
FlutterSkill.start();
npm install flutter-skill-electron
const { FlutterSkillBridge } = require('flutter-skill-electron');
FlutterSkillBridge.start(mainWindow);
// Swift Package Manager: FlutterSkillSDK
import FlutterSkill
FlutterSkillBridge.shared.start()
Text("Hello").flutterSkillId("greeting")
implementation("com.flutterskill:flutter-skill:0.8.0")
FlutterSkillBridge.start(this)
[dependencies]
flutter-skill-tauri = "0.8.0"
Add Gradle dependency — see sdks/kmp for details.
Add NuGet package — see sdks/dotnet-maui for details.
Example Prompts
Just tell your AI what to test:
| Prompt | What happens |
|---|---|
| "Test login with wrong password" | Screenshots → enters creds → taps login → verifies error |
| "Explore every screen and report bugs" | Systematically navigates all screens, tests all elements |
| "Fill registration with edge cases" | Tests emoji 🌍, long strings, empty fields, special chars |
| "Compare checkout flow on iOS and Android" | Runs same test on both platforms, compares screenshots |
| "Take screenshots of all 5 tabs" | Taps each tab, captures state |
Contributing
See CONTRIBUTING.md for guidelines.
git clone https://github.com/ai-dashboad/flutter-skill
cd flutter-skill
dart pub get
dart run bin/flutter_skill.dart server # Start MCP server
Links
| 📦 pub.dev | 🧩 VSCode |
| 📦 npm | 🧩 JetBrains |
| 🍺 Homebrew | 📖 Docs |
| 🤖 Agent Skill | 📋 Changelog |
Questions sur flutter-skill MCP
Comment ajouter flutter-skill MCP à Claude Code ?
Exécutez claude mcp add flutter-skill -- npx -y flutter-skill dans votre terminal. Ajoutez --scope user pour le rendre disponible dans tous les projets.
Comment ajouter flutter-skill MCP à Cursor ?
Ouvrez ~/.cursor/mcp.json et ajoutez le serveur sous mcpServers, avec la configuration Cursor indiquée dans la section d'installation ci-dessus.
Comment installer flutter-skill ?
Installez-le globalement avec npm (ou via Homebrew, Scoop, Docker ou pub.dev), puis ajoutez-le à votre configuration MCP et enregistrez le binding dans votre application.
Quelles plateformes flutter-skill peut-il tester ?
Il prend en charge dix plateformes, notamment Flutter, React Native, Electron, Tauri, Android, KMP Desktop, .NET MAUI, iOS et n'importe quel site web.
Est-ce que flutter-skill fonctionne avec Claude, Cursor ou Copilot ?
Oui, il fonctionne comme un MCP server et est compatible avec n'importe quel agent supportant le Model Context Protocol tel que Claude Desktop, Cursor, Windsurf et VSCode Copilot.
Dois-je écrire du code de test avec flutter-skill ?
Non, vous décrivez vos tests en langage naturel et l'agent IA se charge de prendre des captures d'écran, de cliquer, de saisir du texte et de naviguer pour vous.
Quelle est l'efficacité de flutter-skill en termes de tokens par rapport aux outils basés sur des captures d'écran ?
Il envoie un instantané structuré de l'arbre d'accessibilité au lieu d'images, ce qui utilise beaucoup moins de tokens par page.