zo-swarm-orchestrator

分类: 工具与效率 | 上传者: marlandoj | 下载: 0 | 版本: v1.0（最新）

Local-only multi-agent orchestrator with token optimization, 6-signal composite routing, and persistent memory. Routes all tasks through local executor bridges (Claude Code, Hermes, Gemini, Codex) with DAG dependencies, auto-episode creation, and cognitive profiles.

更新日志: Source: GitHub https://github.com/marlandoj/zo-swarm-orchestrator

目录结构

当前层级: 根目录

📁 assets/
- 📄 persona-registry.json 3.8 KB
- 📄 swarm-patterns.json 3.3 KB
📁 campaigns/
- 📄 ffb-p0-resolution.json 15.2 KB
- 📄 ffb-sprint2-deferred.json 7.9 KB
- 📄 ffb-sprint2-remaining.json 14.8 KB
- 📄 ffb-sprint3-overnight.json 25.0 KB
- 📄 ffb-sprint3-retry.json 19.6 KB
- 📄 ffb-webp-conversion.json 12.2 KB
📁 examples/
- 📄 ffb-marketing-campaign.json 10.4 KB
- 📄 ffb-quick-wins.json 8.0 KB
- 📄 foreign-markets-analysis.json 1.8 KB
- 📄 foreign-markets-financial-focus.json 2.3 KB
- 📄 sample-tasks.json 410 B
- 📄 security-engineer-update-tasks.json 7.6 KB
- 📄 test-10-agents-stress.json 3.7 KB
- 📄 test-20-agents-stress.json 5.4 KB
- 📄 test-5-agents-stress.json 2.2 KB
- 📄 test-composite-router.json 1.9 KB
- 📄 test-v4-simple.json 806 B
- 📄 v3-follow-up-tasks.json 1.2 KB
- 📄 v3-memory-tasks.json 2.1 KB
- 📄 v3-persona-memory-bridge.json 458 B
- 📄 website-review-auto.json 3.6 KB
- 📄 website-review-hermes.json 5.4 KB
- 📄 website-review-jhf.json 7.3 KB
- 📄 website-review-zo-api.json 5.5 KB
- 📄 website-review.json 5.5 KB
📁 scripts/
- 📄 benchmark.ts 11.8 KB
- 📄 claude-code-bridge.sh 2.0 KB
- 📄 export-pdf.sh 2.8 KB
- 📄 inter-agent-comms.ts 13.4 KB
- 📄 orchestrate-v4.ts 112.8 KB
- 📄 performance-test.ts 22.0 KB
- 📄 swarm 1.2 KB
- 📄 swarm-config.ts 6.7 KB
- 📄 swarm-memory.ts 20.9 KB
- 📄 swarm-status.ts 5.5 KB
- 📄 test-orchestrator.ts 5.7 KB
- 📄 token-optimizer.ts 11.2 KB
📄 .gitignore 425 B
📄 AGENTS.md 10.0 KB
📄 bun.lock 1.2 KB
📄 CLAUDE.md 2.4 KB
📄 COMPOSITE_ROUTER_DESIGN.md 18.5 KB
📄 config.json 512 B
📄 index.ts 30 B
📄 package.json 208 B
📄 README.md 12.4 KB
📄 SKILL.md 12.0 KB
📄 test-bad-campaign.json 345 B
📄 test-remediation-campaign.json 1010 B
📄 test-tasks.json 907 B
📄 tsconfig.json 713 B

SKILL.md

---
name: zo-swarm-orchestrator
description: Local-only multi-agent orchestrator with token optimization, 6-signal composite routing, and persistent memory. Routes all tasks through local executor bridges (Claude Code, Hermes, Gemini, Codex) with DAG dependencies, auto-episode creation, and cognitive profiles.
metadata:
  created: 2026-02-08
  updated: 2026-03-07
  version: 4.5.0
---
# Swarm Orchestrator Skill v4.5.0

A reusable skill that enables **any persona** to spawn parallel agent teams, delegate tasks across specialized personas, and synthesize results into coherent output.

**v4.5 "Memory-Enriched Routing":** All tasks execute locally through bridge scripts (no API calls). 6-signal composite routing distributes work based on capability matching, health signals, complexity fit, execution history, procedural learning, and episodic performance. Auto-creates memory episodes after every swarm run.

---

## ⚡ Quick Start

```bash
cd Skills/zo-swarm-orchestrator/scripts

# Run with hierarchical memory
bun orchestrate-v4.ts examples/test-v4-simple.json --swarm-id my-project

# Cost-optimized: no memory
bun orchestrate-v4.ts tasks.json --strategy none

# Bounded context: sliding window
bun orchestrate-v4.ts tasks.json --strategy sliding --max-tokens 8000

# Health check
bun orchestrate-v4.ts doctor
```

---

## Version Status

| Version | Status | Key Innovation |
|---------|--------|----------------|
| **v4.5** | ✅ **Current** | **Memory-Enriched Routing** — local-only execution, 6-signal composite routing (+ procedure + temporal), auto-episodes, cognitive profiles |
| v4.3 | ✅ Current | Hivemind Routing — semantic synonym matching, flattened affinity matrix |
| v4.2 | ✅ Current | Composite router, retry-with-reroute, executor history, routing strategies |
| v4.1 | ✅ Current | DAG dependencies, NDJSON logging, inter-agent messaging |
| v4.0 | ✅ Current | Hierarchical memory, token budgets, pre-warm caching |
| v1–v3 | Archived | Superseded by v4 |

---

## Architecture: Local-Only Execution

As of v4.4, **all tasks execute through local executor bridges**. There are no remote API calls — no Zo API, no Anthropic Direct, no API credentials needed.

```
BEFORE (v4.3)                  AFTER (v4.4+)
─────────────                  ──────────────
3 execution paths              1 execution path (local bridges)
  - Local executor               - Local executor only
  - Anthropic Direct API
  - Zo API fallback
Dual concurrency channels      Single concurrency channel
  - maxConcurrency (API)          - concurrency (local)
  - localConcurrency (local)
API credentials required       No API credentials needed
```

All tasks must have a matching local executor in the registry. The preflight check validates this before execution starts.

---

## Version 4 - Token-Optimized Hierarchical Memory

Building on v3's persistent memory, **v4 introduces intelligent memory strategies** that automatically manage token budgets to prevent the context window exhaustion that caused v1 failures.

### The Problem v4 Solves

From February 2026 production failures:
- **Context window exhaustion**: 5 agents × 256k tokens = system failure
- **Unbounded memory growth**: Sequential memory grows forever
- **No token budgeting**: No visibility into prompt token usage

### What v4 Adds

| Feature | Implementation | Benefit |
|---------|----------------|---------|
| **Token cleaning** | HTML stripping, deduplication, normalization | ~10-15% token reduction |
| **Hierarchical memory** | Working memory + long-term memory retrieval | Bounded context, relevant history |
| **Sliding window** | Fixed-size recent context window | Predictable token usage |
| **Token budgets** | Configurable max tokens per context | Never exceed context limits |
| **Strategy selection** | Choose memory strategy per task | Optimize for cost vs. context |

---

## 6-Signal Composite Routing (v4.5)

The orchestrator scores each executor on six signals to pick the best agent for each task:

| Signal | Weight | What it measures |
|--------|--------|------------------|
| **Capability** | configurable | Task keyword matching against executor expertise |
| **Health** | configurable | Circuit breaker state, recent error rate |
| **Complexity fit** | configurable | Simple tasks → fast executors, deep analysis → thorough ones |
| **History** | configurable | Historical success rate for similar tasks |
| **Procedure** | 0.10 | Learned workflow preference from procedural memory (±0.05) |
| **Temporal** | 0.05 | Recent episodic performance bonus/penalty (±0.025) |

```
composite = (w.capability × capScore)
          + (w.health × healthScore)
          + (w.complexityFit × complexityScore)
          + (w.history × historyScore)
          + (0.10 × (procedureScore - 0.5))
          + (0.05 × (temporalScore - 0.5))
```

The routing improves with use — after a few runs, tasks flow to whichever executor handles them best.

### Routing presets

| Preset | Best for |
|--------|----------|
| `balanced` (default) | Equal consideration of all signals |
| `fast` | Speed-optimized, prefer simple executors |
| `reliable` | Maximize uptime, penalize unhealthy executors |
| `explore` | Favor executors with proven track records |

```bash
bun orchestrate-v4.ts tasks.json --routing-strategy reliable
```

---

## Auto-Episodes & Cognitive Profiles (v4.5)

### Auto-Episodes

Every swarm run automatically creates an episode in the zo-memory-system with:
- Outcome (success/partial/failure)
- Duration and task count
- Executor list and per-task results
- Entity tags for querying

Query past runs:
```bash
bun ~/Skills/zo-memory-system/scripts/memory.ts episodes --entity "swarm.ffb" --since "7 days ago"
```

### Cognitive Profiles

Executor history is extended with:
- **Recent episode IDs** — last 10 episodes for "why did this happen?" queries
- **Failure patterns** — auto-classified: timeout, mutation_failed, file_not_found, permission_denied
- **Entity affinities** — per-entity success rates as exponential moving averages

These feed back into the composite router for smarter task assignment.

---

## Memory Strategies

### Comparison

| Strategy | Token Efficiency | Context Quality | Best For |
|----------|------------------|-----------------|----------|
| `none` | ⭐⭐⭐⭐⭐ | ⭐☆☆☆☆ | Independent tasks, cost-sensitive |
| `sliding` | ⭐⭐⭐⭐☆ | ⭐⭐⭐☆☆ | Recent context matters |
| `hierarchical` | ⭐⭐⭐⭐☆ | ⭐⭐⭐⭐⭐ | Complex multi-step workflows |
| `sequential` | ⭐☆☆☆☆ | ⭐⭐⭐⭐⭐ | Debugging, small swarms only |

### Benchmark Results

```
Strategy       Avg Prompt    Memory    Token
               Tokens        Items     Savings
───────────────────────────────────────────────
none           26            0         -93%
sliding        356           3         -8%
hierarchical   416           4         -8%
sequential     386           5         0%
```

---

## CLI Options

| Option | Description | Default |
|--------|-------------|---------|
| `--swarm-id <id>` | Unique swarm identifier | auto-generated |
| `--strategy <type>` | Memory strategy | hierarchical |
| `--max-tokens <n>` | Token budget for context | 8000 |
| `--concurrency <n>` | Max parallel local executors | 4 |
| `--timeout <seconds>` | Per-task timeout | 300 |
| `--dag-mode <mode>` | `streaming` or `waves` | streaming |
| `--routing-strategy <s>` | `fast`, `reliable`, `balanced`, `explore` | balanced |
| `--no-memory` | Disable all memory | false |
| `--notify <channel>` | Send completion notification: sms or email | none (file always written) |

---

## Task File Format (v4)

```json
[
  {
    "id": "task-1",
    "persona": "frontend-developer",
    "task": "Analyze UI/UX for accessibility issues",
    "priority": "high",
    "memoryStrategy": "hierarchical",
    "outputToMemory": true,
    "memoryMetadata": {
      "category": "ui-analysis",
      "priority": "high",
      "tags": ["accessibility", "responsive"]
    }
  }
]
```

---

## Files Reference

| File | Purpose |
|------|---------|
| `orchestrate-v4.ts` | Main orchestrator (v4.5 with 6-signal routing) |
| `token-optimizer.ts` | Token cleaning + hierarchical memory |
| `swarm-memory.ts` | SQLite persistence + inter-agent messaging |
| `swarm-config.ts` | Configuration management CLI |
| `benchmark.ts` | Memory strategy benchmarking |
| `test-orchestrator.ts` | Test suite |
| `performance-test.ts` | Baseline vs enhanced performance test |
| `inter-agent-comms.ts` | Inter-agent communication system |

---

## Local Executors

All tasks are routed to **local executor bridges**. The bridge scripts, registry, and tooling live in the companion skill [`zo-swarm-executors`](../zo-swarm-executors/):

| Executor | Bridge | Speed | Strengths |
|----------|--------|-------|-----------|
| `claude-code` | `claude-code-bridge.sh` | ~25-120s | Complex multi-file changes, codebase-aware analysis, git operations |
| `hermes` | `hermes-bridge.sh` | ~15-60s | Web research, security audits, multi-tool investigation, data gathering |
| `gemini` | `gemini-bridge.sh` | ~2-12s (daemon) | Large-context analysis (1M+ tokens), multimodal, cross-validation |
| `codex` | `codex-bridge.sh` | ~3s | Fast code generation, shell commands, rapid prototyping |

```
Skills/zo-swarm-executors/
├── bridges/          # claude-code, hermes, gemini, codex bridge scripts
├── registry/         # executor-registry.json
├── scripts/          # doctor.ts, register.ts, test-harness.ts, gemini-daemon.ts
└── docs/             # BRIDGE_PROTOCOL.md, identity references
```

The orchestrator discovers executors via `executor-registry.json`. All task personas must have a matching local executor — the preflight check validates this before execution starts.

---

## Utilities

```bash
# Benchmark all memory strategies
bun benchmark.ts

# Test orchestrator
bun test-orchestrator.ts

# Memory management
bun swarm-memory.ts stats
bun swarm-memory.ts list-sessions
bun swarm-memory.ts cleanup 30
```

---

## Configuration

You can configure the orchestrator using **either** a config file **or** environment variables.

### Option 1: Config File (Recommended)

Create `config.json` in the skill root:

```json
{
  "localConcurrency": 4,
  "timeoutSeconds": 300,
  "maxRetries": 3,
  "memory": {
    "enable": true,
    "workingMemorySize": 2,
    "longTermMemorySize": 3,
    "enableDeduplication": true,
    "enableHTMLStripping": true,
    "maxTokens": 8000
  }
}
```

**Priority:** CLI flags > Config file > Environment variables > Defaults

### Option 2: Environment Variables

| Variable | Description | Default |
|----------|-------------|---------|
| `SWARM_WORKSPACE` | Root for deployment resources | `/home/workspace` |
| `SWARM_LOCAL_CONCURRENCY` | Max parallel local executors | 4 |
| `SWARM_TIMEOUT_SECONDS` | Per-task timeout | 300 |
| `SWARM_MAX_RETRIES` | Retry attempts | 3 |
| `SWARM_IDENTITY_DIR` | Persona identity files directory | `$SWARM_WORKSPACE/IDENTITY` |
| `SWARM_SOUL_FILE` | Path to constitution file | `$SWARM_WORKSPACE/SOUL.md` |
| `SWARM_PERSONA_MEMORY_DIR` | Persona-specific memory files | `$SWARM_WORKSPACE/.zo/memory/personas` |
| `SWARM_MEMORY_SCRIPT` | Memory search script path | `$SWARM_WORKSPACE/.zo/memory/scripts/memory.ts` |
| `SWARM_EXECUTOR_REGISTRY` | Local executor registry JSON path | `Skills/zo-swarm-executors/registry/executor-registry.json` |

---

## Roadmap

Planned optimizations from production profiling (see README.md for full details):

| Phase | Optimizations | Expected Savings |
|-------|--------------|------------------|
| **Phase 1** — Quick Wins | O3: Pre-warm cache TTL, O4: Prompt format constraints, O6: Circuit breaker tuning | 5-13% |
| **Phase 2** — Execution Engine | O2: DAG streaming improvements, O1: Request batching | +13-30% |
| **Phase 3** — Refinements | O5: Early filtering, O7: Output deduplication, O8: Concurrent caching | +2-5% |

---

## References

- Prompt-Refiner: https://github.com/JacobHuang91/prompt-refiner
- Agent-Memory-Playground: https://github.com/AIAnytime/Agent-Memory-Playground

登录后下载/点赞/收藏 ❤ 3 | ★ 0

zo-swarm-orchestrator

目录结构

SKILL.md

举报内容

提示