MobileClaw

Category: Tools & Productivity | Uploader: stone20141010-lgtm | Downloads: 0 | Version: v1.0（Latest）

Control Android UI through accessibility service.

Changelog: Source: GitHub https://github.com/stone20141010-lgtm/MobileClaw

Directory Structure

Current level: workspace/skills/accessibility/

📄 accessibility.py 3.2 KB
📄 SKILL.md 4.0 KB

SKILL.md

# Accessibility Skill

Control Android UI through accessibility service.

## Prerequisites

Enable MobileClaw Accessibility Service:
1. Open Settings → Accessibility
2. Find "MobileClaw Accessibility Service"
3. Toggle ON
4. Grant permissions

## Usage

```bash
# Get screen elements
python skills/accessibility/accessibility.py screen '{}'

# Click element by text
python skills/accessibility/accessibility.py click '{"text":"Send"}'

# Tap at coordinates
python skills/accessibility/accessibility.py tap '{"x":540,"y":1200}'

# Input text
python skills/accessibility/accessibility.py input_text '{"text":"Hello World"}'

# Press back button
python skills/accessibility/accessibility.py back '{}'

# Get notifications
python skills/accessibility/accessibility.py notifications '{}'

# Take screenshot (Android 11+)
python skills/accessibility/accessibility.py screenshot '{}'
```

## Actions

### screen
Get all UI elements on screen (text, bounds, clickable, editable).

**Arguments**: `{}`

**Returns**:
```json
{
  "ok": true,
  "summary": "Retrieved 25 screen elements",
  "data": {
    "elements": [
      {
        "text": "Send",
        "bounds": "100 200 300 400",
        "clickable": true,
        "editable": false
      }
    ]
  }
}
```

### tree
Get full accessibility node tree (detailed structure).

**Arguments**:
- `maxDepth` (optional): Maximum tree depth, default 10

**Example**: `{"maxDepth": 5}`

### click
Click element by text or bounds.

**Arguments**:
- `text` (optional): Text to search for
- `bounds` (optional): Bounds string "left top right bottom"

**Example**:
```json
{"text": "Send"}
{"bounds": "100 200 300 400"}
```

### tap
Tap at exact coordinates.

**Arguments**:
- `x` (required): X coordinate
- `y` (required): Y coordinate
- `duration` (optional): Tap duration in ms, default 100

**Example**: `{"x": 540, "y": 1200}`

### input_text
Input text into focused field.

**Arguments**:
- `text` (required): Text to input
- `append` (optional): Append to existing text, default false

**Example**: `{"text": "Hello World", "append": false}`

### scroll
Scroll screen.

**Arguments**:
- `direction` (optional): "up", "down", "left", "right", default "down"
- `bounds` (optional): Bounds string of the scrollable container to target

**Example**: `{"direction": "down"}` or `{"direction": "up", "bounds": "0 200 1080 1800"}`

### back
Press back button.

**Arguments**: `{}`

### home
Press home button.

**Arguments**: `{}`

### notifications
Get recent notifications (up to 50).

**Arguments**: `{}`

**Returns**:
```json
{
  "ok": true,
  "summary": "Retrieved 3 notifications",
  "data": {
    "notifications": [
      {
        "timestamp": 1234567890,
        "packageName": "com.example",
        "title": "...",
        "body": "...",
        "text": ["..."]
      }
    ]
  }
}
```

### swipe
Swipe gesture.

**Arguments**:
- `x1`, `y1` (required): Start coordinates
- `x2`, `y2` (required): End coordinates
- `duration` (optional): Swipe duration in ms, default 300

**Example**: `{"x1": 500, "y1": 1000, "x2": 500, "y2": 500, "duration": 300}`

### screenshot
Take a screenshot and save to Pictures/mobileclaw/. Requires Android 11+.

**Arguments**: `{}`

**Returns**:
```json
{
  "ok": true,
  "summary": "Screenshot saved",
  "data": { "path": "/sdcard/Pictures/mobileclaw/screenshot_20260218_213300.png" }
}
```

## Import Usage

```python
from accessibility.accessibility import screen, click, tap, screenshot

# Get screen elements
result = screen({})
elements = result['data']['elements']

# Click a button
click({"text": "Send"})

# Tap at coordinates
tap({"x": 540, "y": 1200})

# Take screenshot
result = screenshot({})
path = result['data']['path']
```

## Architecture

```
Python skill (accessibility.py)
  ↓ Chaquopy JNI
AccessibilityCapability.kt
  ↓
MobileClawAccessibilityService.kt
  ↓ Android Accessibility API
Device UI
```

## Error Handling

If accessibility service is not enabled:
```json
{
  "ok": false,
  "error": "Accessibility service not enabled",
  "error_code": "service_not_enabled",
  "hint": "Enable MobileClaw Accessibility Service in Settings"
}
```

Comments 0

Latest | Hot

Please login before commenting.

No comments yet. Be the first one!

MobileClaw

Directory Structure

SKILL.md

Report

Notice