openai-voice-skill

Category: 数据与AI | Uploader: nia-agent-cyber | Downloads: 0 | Version: v1.0（Latest）

Real-time voice conversations using OpenAI's native SIP integration. Way more fluid than multi-hop STT→LLM→TTS solutions.

Changelog: Source: GitHub https://github.com/nia-agent-cyber/openai-voice-skill

Directory Structure

Current level: Root

📁 .github/
- 📁 ISSUE_TEMPLATE/
  - 📄 bug_report.md 264 B
  - 📄 feature_request.md 177 B
- 📁 workflows/
  - 📄 tests.yml 624 B
📁 channel-plugin/
- 📁 dist/
  - 📁 adapters/
    
    📄 config.d.ts 2.6 KB
    
    📄 config.d.ts.map 1.3 KB
    
    📄 config.js 3.9 KB
    
    📄 config.js.map 2.8 KB
    
    📄 gateway.d.ts 2.3 KB
    
    📄 gateway.d.ts.map 1.2 KB
    
    📄 gateway.js 5.2 KB
    
    📄 gateway.js.map 3.5 KB
    
    📄 inbound.d.ts 7.8 KB
    
    📄 inbound.d.ts.map 3.5 KB
    
    📄 inbound.js 13.7 KB
    
    📄 inbound.js.map 8.9 KB
    
    📄 inbound.test.d.ts 100 B
    
    📄 inbound.test.d.ts.map 140 B
    
    📄 inbound.test.js 6.1 KB
    
    📄 inbound.test.js.map 6.3 KB
    
    📄 outbound.d.ts 1.9 KB
    
    📄 outbound.d.ts.map 693 B
    
    📄 outbound.js 4.1 KB
    
    📄 outbound.js.map 2.4 KB
    
    📄 session-bridge.d.ts 5.8 KB
    
    📄 session-bridge.d.ts.map 3.0 KB
    
    📄 session-bridge.js 41.6 KB
    
    📄 session-bridge.js.map 33.6 KB
    
    📄 status.d.ts 2.4 KB
    
    📄 status.d.ts.map 1.4 KB
    
    📄 status.js 4.7 KB
    
    📄 status.js.map 3.2 KB
  - 📄 index.d.ts 932 B
  - 📄 index.d.ts.map 362 B
  - 📄 index.js 2.1 KB
  - 📄 index.js.map 1.1 KB
  - 📄 meta.d.ts 160 B
  - 📄 meta.d.ts.map 194 B
  - 📄 meta.js 466 B
  - 📄 meta.js.map 389 B
  - 📄 types.d.ts 2.8 KB
  - 📄 types.d.ts.map 2.3 KB
  - 📄 types.js 229 B
  - 📄 types.js.map 115 B
- 📁 src/
  - 📁 adapters/
    
    📄 config.ts 4.9 KB
    
    📄 gateway.ts 6.1 KB
    
    📄 inbound.test.ts 5.9 KB
    
    📄 inbound.ts 16.4 KB
    
    📄 outbound.ts 4.4 KB
    
    📄 session-bridge.ts 40.5 KB
    
    📄 status.ts 5.4 KB
  - 📄 index.ts 2.2 KB
  - 📄 meta.ts 478 B
  - 📄 types.ts 2.6 KB
- 📄 index.ts 731 B
- 📄 openclaw.plugin.json 934 B
- 📄 package-lock.json 417.7 KB
- 📄 package.json 618 B
- 📄 README.md 2.7 KB
- 📄 tsconfig.json 481 B
📁 config/
- 📄 agent.json 1.7 KB
- 📄 inbound.json 462 B
- 📄 integration-config.yaml 4.2 KB
- 📄 openclaw-voice-config.yaml 3.7 KB
- 📄 phone_mapping.json 955 B
📁 docs/
- 📄 bridge-cleanup.md 5.7 KB
- 📄 BUG_ANALYSIS_ask_openclaw.md 8.4 KB
- 📄 CALCOM_OUTREACH.md 7.8 KB
- 📄 COMPETITIVE_ANALYSIS_VISIONCLAW.md 10.9 KB
- 📄 INBOUND.md 9.5 KB
- 📄 ISSUE_38_ROOT_CAUSE.md 4.0 KB
- 📄 MISSED_CALL_TUTORIAL.md 14.0 KB
- 📄 OBSERVABILITY.md 9.0 KB
- 📄 SHOW_HN_DRAFT.md 1.4 KB
- 📄 streaming-tool-responses.md 12.7 KB
- 📄 TOOL_INTEGRATION.md 6.7 KB
📁 examples/
- 📄 missed_call_handler.py 3.3 KB
- 📄 README.md 497 B
📁 scripts/
- 📄 call_context_store.py 3.0 KB
- 📄 call_metrics.py 41.3 KB
- 📄 call_recording.py 23.8 KB
- 📄 cleanup_zombie_calls.py 4.5 KB
- 📄 context_example.py 6.5 KB
- 📄 fix-bridge-conflict.sh 3.5 KB
- 📄 inbound_handler.py 16.5 KB
- 📄 metrics_server.py 13.8 KB
- 📄 openclaw-webhook-bridge.py 14.8 KB
- 📄 openclaw_bridge.py 21.6 KB
- 📄 openclaw_executor.py 17.7 KB
- 📄 outbound_call_example.py 5.6 KB
- 📄 realtime_tool_handler.py 26.7 KB
- 📄 requirements.txt 150 B
- 📄 security_utils.py 13.4 KB
- 📄 session_context.py 24.9 KB
- 📄 smart_chunker.py 7.0 KB
- 📄 start-integrated-system.sh 8.8 KB
- 📄 test-integration.sh 6.3 KB
- 📄 test_call_integration.py 5.9 KB
- 📄 test_context_integration.py 14.6 KB
- 📄 test_enhanced_context.py 2.4 KB
- 📄 test_recording.py 4.8 KB
- 📄 user_context.py 13.4 KB
- 📄 webhook-server.py 43.7 KB
📁 src/
- 📁 bridge/
  - 📄 python-webhook-bridge.ts 10.6 KB
- 📁 channel/
  - 📁 voice/
    
    📄 call-handler.ts 13.8 KB
    
    📄 context-manager.ts 12.2 KB
    
    📄 index.ts 5.8 KB
    
    📄 integrated-call-handler.ts 14.4 KB
    
    📄 integrated-plugin.ts 11.3 KB
    
    📄 session-manager.ts 10.6 KB
    
    📄 types.ts 4.1 KB
- 📄 package.json 1.6 KB
- 📄 README.md 7.8 KB
- 📄 tsconfig.json 571 B
📁 tests/
- 📄 test_call_metrics.py 18.8 KB
- 📄 test_error_handling.py 7.6 KB
- 📄 test_inbound.py 8.9 KB
- 📄 test_smart_chunker.py 12.3 KB
📄 .env.example 1.1 KB
📄 .gitignore 129 B
📄 COMMS_DRAFTS.md 5.4 KB
📄 COMMS_LOG.md 7.4 KB
📄 COMMS_PLAN.md 7.6 KB
📄 CONTRIBUTING.md 1.9 KB
📄 CTXLY_FOLLOWUP_DRAFT.md 1.6 KB
📄 DECISIONS.md 9.2 KB
📄 DEVTO_POST_DRAFT.md 9.5 KB
📄 IMPLEMENTATION_COMPLETE.md 5.5 KB
📄 IMPLEMENTATION_SUMMARY.md 4.8 KB
📄 INTEGRATION_GUIDE.md 11.3 KB
📄 ISSUE_17_IMPLEMENTATION.md 3.9 KB
📄 LICENSE 1.1 KB
📄 phone_mapping.json 507 B
📄 PR_SUMMARY.md 6.0 KB
📄 PROGRESS.md 9.7 KB
📄 PROTOCOL.md 6.3 KB
📄 pyproject.toml 134 B
📄 README.md 12.3 KB
📄 REDDIT_POST_DRAFT.md 1.7 KB
📄 requirements-dev.txt 66 B
📄 requirements.txt 114 B
📄 send_email_outreach.py 3.1 KB
📄 SESSION_CONTEXT_README.md 9.3 KB
📄 skill.json 706 B
📄 SKILL.md 2.6 KB
📄 STATUS.md 26.2 KB
📄 STRATEGY.md 22.3 KB
📄 SYNC_NOTES.md 4.3 KB
📄 test_context.py 1.8 KB
📄 VOICE_ARCHITECTURE_RESEARCH.md 16.1 KB

SKILL.md

# OpenAI Voice Skill

Real-time voice conversations using OpenAI's native SIP integration. Way more fluid than multi-hop STT→LLM→TTS solutions.

## How It Works

```
Phone call → Twilio SIP → OpenAI Realtime API
                              ↓
                         Your webhook accepts call
                         with custom instructions
                              ↓
                         Native voice conversation
```

OpenAI handles STT, LLM, and TTS in a single low-latency pipeline.

## Prerequisites

1. **Twilio account** with a phone number
2. **OpenAI API key** with Realtime API access
3. **Public webhook URL** (ngrok, cloudflared, or deployed server)

## Setup

### 1. Install Dependencies

```bash
cd scripts
pip install -r requirements.txt
```

### 2. Configure Environment

```bash
cp .env.example .env
# Edit .env with your credentials:
# - OPENAI_API_KEY
# - OPENAI_PROJECT_ID (from platform.openai.com/settings)
# - WEBHOOK_SECRET (generate with: openssl rand -hex 32)
```

### 3. Start Webhook Server

```bash
python webhook-server.py
```

### 4. Expose Webhook (Development)

```bash
# Using cloudflared (recommended, no auth needed)
cloudflared tunnel --url http://localhost:8080

# Or ngrok
ngrok http 8080
```

### 5. Configure OpenAI Webhook

1. Go to platform.openai.com/settings → Project → Webhooks
2. Add webhook URL: `https://your-tunnel.trycloudflare.com/webhook`
3. Subscribe to: `realtime.call.incoming`

### 6. Configure Twilio SIP Trunk

1. In Twilio Console → Elastic SIP Trunking → Create trunk
2. Set Termination SIP URI: `sip:$PROJECT_ID@sip.api.openai.com;transport=tls`
3. Assign your phone number to the trunk

## Customization

Edit `config/agent.json` to customize:

```json
{
  "name": "Your Agent Name",
  "instructions": "You are a helpful assistant...",
  "voice": "alloy",
  "model": "gpt-realtime"
}
```

Available voices: `alloy`, `echo`, `fable`, `onyx`, `nova`, `shimmer`

## Making Outbound Calls

```bash
# Via API
curl -X POST http://localhost:8080/call \
  -H "Content-Type: application/json" \
  -d '{"to": "+1234567890"}'
```

## Monitoring

```bash
# View active calls
curl http://localhost:8080/calls

# View call logs
tail -f logs/calls.log
```

## Troubleshooting

**Call doesn't connect:**
- Verify Twilio SIP trunk points to correct OpenAI SIP URI
- Check OpenAI webhook is receiving events
- Ensure PROJECT_ID matches your OpenAI project

**Poor audio quality:**
- OpenAI Realtime uses Opus codec by default
- Ensure network has low latency to OpenAI servers

**Webhook not firing:**
- Verify webhook URL is publicly accessible
- Check webhook signature validation

Comments 0

Latest | Hot

Please login before commenting.

No comments yet. Be the first one!

openai-voice-skill

Directory Structure

SKILL.md

Report

Notice