web-browsing

分类: 开发与编程 | 上传者: bradbrok | 下载: 0 | 版本: v1.0（最新）

使用 Camoufox（反检测 Firefox）进行隐秘网页浏览和抓取。当您需要抓取网站、搜索网络、截取屏幕截图、提取页面元素或抓取网站时使用。绕过阻止标准 HTTP 请求和无头浏览器的机器人检测。

更新日志: Source: GitHub https://github.com/bradbrok/PinkyBot

目录结构

当前层级: tree/main/skills/web-browsing/

📄 SKILL.md 2.4 KB

SKILL.md

---
name: web-browsing
description: Stealth web browsing and scraping using Camoufox (anti-detect Firefox). Use when you need to scrape websites, search the web, take screenshots, extract page elements, or crawl sites. Bypasses bot detection that blocks standard HTTP requests and headless browsers.
mcp_servers:
  pinky-web:
    command: "{PINKY_VENV}/bin/python"
    args: ["-m", "pinky_web"]
    cwd: "{PINKY_ROOT}/src"
---

# Web Browsing (Camoufox)

Stealth web access powered by Camoufox — an anti-detect Firefox build that rotates fingerprints at the C++ level and evades bot detection.

## Available Tools

### scrape(url, only_main_content?, wait_for?, timeout?)
Fetch a page and return clean markdown. Best for reading articles, docs, READMEs.
```
scrape("https://example.com")
scrape("https://example.com", only_main_content=False)  # full page
scrape("https://example.com", wait_for=".content")  # wait for element
```

### screenshot(url, full_page?, wait_for?, output_path?)
Capture a PNG screenshot. Returns the file path.
```
screenshot("https://example.com")
screenshot("https://example.com", full_page=True, output_path="/tmp/shot.png")
```

### search(query, num_results?, engine?)
Web search via DuckDuckGo (default) or Google. Returns structured results.
```
search("python async best practices")
search("site:github.com camoufox", engine="google")
```

### extract(url, selectors, wait_for?)
Extract specific elements by CSS selector. Returns text + attributes for each match.
```
extract("https://example.com", selectors=["h1", "a.nav-link", ".price"])
```

### crawl(url, max_pages?, same_domain?, only_main_content?)
Crawl a site starting from a URL, following links. Returns markdown per page.
```
crawl("https://docs.example.com", max_pages=10)
crawl("https://example.com", max_pages=5, same_domain=True)
```

## When to Use This vs Direct HTTP

- **Use pinky-web** when: sites block bots, need JS rendering, need screenshots, need to interact with dynamic content
- **Use httpx/fetch** when: hitting APIs, downloading files, simple requests that don't need a browser

## Tips
- `scrape` with `only_main_content=True` (default) strips nav/footer/ads for cleaner output
- `search` with DuckDuckGo is less likely to get captcha'd than Google
- `crawl` respects `max_pages` (capped at 20) and stays on the same domain by default
- The browser instance is reused across calls for speed
- All tools use a fresh fingerprint per browser session

登录后下载/点赞/收藏 ❤ 5 | ★ 0

web-browsing

目录结构

SKILL.md

举报内容

提示