---
created: 2026-03-12
tags: [project, active, voice-ai]
related: ["[[08-Infrastructure/Infrastructure Map]]", "Rivet (hibernated 2026-04-29)", "[[03-Projects/Growth Engine]]"]
---

# Voice AI

Two separate voice AI systems serving different purposes.

---

## System 1: VAPI — Inbound Phone Receptionist

**Purpose:** AI phone receptionist that qualifies inbound leads
**Status:** Operational

| Component | Detail |
|---|---|
| Platform | VAPI (hosted) |
| Model | GPT Realtime API (`gpt-realtime-2025-08-28`) |
| Voice | OpenAI `alloy` (natural male) |
| Config | `phone-ai/vapi-config.json` |
| Webhook | Growth Engine `/api/vapi/webhook` |
| Route | `src/routes/vapi.js` |

**Flow:**
1. Inbound call → VAPI handles conversation
2. Call ends → `end-of-call-report` webhook fires
3. AI parses transcript → saves to `vapi_tasks` table
4. `taskExecutor.js` processes tasks asynchronously

**Setup scripts:** `phone-ai/setup-vapi.js`, `phone-ai/test-vapi.js`

---

## System 2: Pipecat + Twilio — Rivet Personal Assistant

**Purpose:** Morning/evening briefing calls between Michael and Rivet (hibernated 2026-04-29)
**Status:** Operational

| Component | Detail |
|---|---|
| Framework | Pipecat (Python, real-time voice pipeline) |
| STT | Deepgram (Australian English, nova-2) |
| LLM | Claude Opus 4.5 (Anthropic) |
| TTS | ElevenLabs ("Charlie" voice, ID: `IKne3meq5aSn9XLyUdCD`) |
| Phone | +61238205443 |
| WebSocket | Port 8765 on VPS |
| Service | `rivet-voice.service` (systemd) |

**Call Schedule:**
- **Morning (6:30 AM):** Site brief + daily priorities + hard questions
- **Evening (5:30 PM):** Business debrief + accountability
- **Sunday:** Weekly review

**Key Files:**
- `voice-assistant/voice_assistant.py` — Main implementation
- `voice-assistant/make_call.py` — Outbound call script
- `voice-assistant/rivet-voice.service` — systemd service
- Logs: `voice-assistant/logs/YYYY-MM-DD.log` (7-day retention)

**Context:** Reads `todays-hard-questions.md` before each call. System prompt: "You are Rivet, the COO system for RateRight..."

---

## Monthly Costs
- **ElevenLabs:** $22 (TTS for Pipecat)
- **VAPI:** Usage-based
- **Deepgram:** Usage-based
- **Twilio voice:** Included in $76/mo Twilio bill
