# 📊 Research Status Report
**Generated:** 2026-02-06
**Scope:** All completed market research, competitor analysis, API explorations, learning summaries, and knowledge gaps

---

## 📋 Executive Summary

Research across the RateRight project is **extensive and well-documented**, covering market analysis, competitor intelligence, API integrations, UX/UI patterns, legal/regulatory considerations, and Clawdbot/Rivet operational learnings. **26+ research documents** exist across `memory/plans/` and `memory/research/`. The depth is strong in market positioning, competitor pricing, and UX research. Key gaps remain in **actuarial modeling for payment protection**, **live user testing data**, and **state-by-state regulatory compliance** beyond NSW.

---

## ✅ COMPLETED RESEARCH

### 1. Market Research

| Document | Location | Status | Depth |
|----------|----------|--------|-------|
| Competitor Analysis (6 competitors) | `plans/competitor-analysis.md` | ✅ Complete | ⭐⭐⭐⭐⭐ |
| Agency Model Research | `plans/agency-model-research.md` | ✅ Complete | ⭐⭐⭐⭐⭐ |
| Crew Hire Market Research | `plans/crew-hire-market-research.md` | ✅ Complete | ⭐⭐⭐⭐⭐ |
| Marketing/Content Research | `plans/marketing-research.md` | ✅ Complete | ⭐⭐⭐⭐⭐ |
| Construction Labour Market Size | Embedded in multiple files | ✅ Complete | ⭐⭐⭐⭐ |

**Key findings documented:**
- Australian construction labour hire market: **$3.8B** addressable market
- Total industry: **$175B+ GVA**, **1.2M+ workers**
- Traditional agencies charge **20-40% markup** ($1,600-3,200/month per worker)
- Sidekicker: ~30% markup; Airtasker: 10-20% worker fee + ~15% poster fee
- RateRight's $50 flat fee = **85-95% savings** vs traditional agencies
- **No competitor** offers payment protection for workers (RateRight's unique angle)
- Target segment: Small-medium contractors most price-sensitive and underserved
- Flat-fee recruitment disruption model validated by analogous industry examples (Purplebricks, robo-advisors)

### 2. Competitor Analysis

| Competitor | Analysed | Key Intel |
|------------|----------|-----------|
| Traditional Agencies (Randstad, Hays, etc.) | ✅ Deep | 20-40% markup, full-service, locked-in relationships |
| Sidekicker | ✅ Deep | ~30% markup, tech platform, temp/casual focus |
| Airtasker | ✅ Deep | 10-20% worker fee, general tasks, race-to-bottom pricing |
| Hipages | ✅ Deep | $129-429/month subscription, lead-gen model, residential focus |
| SEEK | ✅ Moderate | $299-600/job posting, traditional job board, no matching |
| Workmate Pro | ✅ Moderate | Offshore workforce, NOT direct competitor |

**Competitive positioning matrix** documented with cost-to-business, cost-to-worker, payment protection, and specialization comparisons.

### 3. API Explorations

| API / Integration | Location | Status | Notes |
|-------------------|----------|--------|-------|
| ABR (Australian Business Register) | `plans/abr-api-research.md` | ✅ **Code written** | JSON API chosen, mod-89 validation implemented. **Needs ABR_GUID to go live.** |
| ASIC Connect (Company verification) | `plans/verification-apis-research.md` | ✅ Researched | Official API requires application. Third-party vigil.sh available. |
| NSW Fair Trading Builder Licence | `plans/verification-apis-research.md` | ✅ Researched | **Official API exists** (API.NSW). Free tier: 2,500 calls/month. OAuth 2.0. **Feasibility: Easy.** |
| SafeWork NSW White Card | `plans/verification-apis-research.md` | ✅ Researched | **No public API.** Web-only verification. Scraping or manual required. **Feasibility: Hard.** |
| iCare Workers Comp | `plans/verification-apis-research.md` | ✅ Researched | Web lookup by ABN. No API. Data refreshed weekly. **Feasibility: Medium.** |
| Google Places (Address validation) | `plans/verification-apis-research.md` | ✅ Researched | ~$0.017/request. Next.js integration code ready. **Feasibility: Easy.** |
| Stripe Checkout (Payment) | `plans/stripe-payment-flow.md` | ✅ **Fully designed** | Full flow spec, DB schema, webhook design, fee analysis ($48.82 net on $50). |
| VAPI (Voice AI) | `plans/vapi-realtime-setup.md`, `plans/vapi-webhook-tools-spec.md` | ✅ Designed | Assistant config created, webhook architecture specified. Setup script exists. |
| YouTube Data API | `plans/youtube-api-scan.md` | ⚠️ Partial | yt-dlp blocked by YouTube bot detection. Need deno runtime or cookies workaround. |

### 4. UX/UI Research

| Topic | Location | Status | Depth |
|-------|----------|--------|-------|
| Construction UX Best Practices | `plans/construction-ux-best-practices.md` | ✅ Complete | ⭐⭐⭐⭐⭐ |
| Construction UX Research (Platform Analysis) | `plans/construction-ux-research.md` | ✅ Complete | ⭐⭐⭐⭐⭐ |
| Gig App UI Patterns (Uber/DoorDash/Tinder) | `plans/gig-app-ui-research.md` | ✅ Complete | ⭐⭐⭐⭐⭐ |
| Voice Signup Flow | `plans/voice-signup-flow.md` | ✅ Complete | ⭐⭐⭐⭐ |

**Key UX insights documented:**
- **Glove-first design** is non-negotiable: 48px min touch targets, 7:1 contrast ratio
- 78% of construction workers use Android devices
- Each additional screen in job posting reduces completion by **18%**
- **40%** of construction workers have limited digital literacy
- One-tap/swipe mechanics from Uber/DoorDash validated for construction context
- Sub-60-second onboarding target established (phone → trade → location → done)
- GPS-first over address-entry for location matching
- Hipages, Airtasker, ServiceSeeking user feedback analysed (Reddit/Whirlpool)

### 5. Product & Business Design

| Document | Location | Status |
|----------|----------|--------|
| RateRight v2 Product Spec | `plans/rateright-v2-product-spec.md` | ✅ Complete (DRAFT) |
| Comprehensive Gap Analysis (27 gaps) | `plans/deep-gap-analysis.md` | ✅ Complete |
| Payment Protection Research | `plans/payment-protection-research.md` | ✅ Complete |
| Stripe Payment Flow | `plans/stripe-payment-flow.md` | ✅ Complete |
| Brand Voice Guide | `plans/brand-voice-guide.md` | ✅ Complete |
| Content Engine Plan | `plans/content-engine-plan.md` | ✅ Complete |
| SMS Sequences | `plans/sms-sequences.md` | ✅ Complete |

**Payment protection key findings:**
- Current $10/week worker-paid model has **fundamental flaws**: no actuarial basis, likely requires AFSL, adverse selection risk, pool too small for claims
- Recommended restructure: **contractor-funded** 1-2% transaction fee + optional worker supplement
- Existing Security of Payment legislation already provides some worker protection
- Partnering with licensed insurer as authorized representative avoids direct AFSL requirement
- Estimated AFSL setup cost: $150,000-300,000 + 6-12 month regulatory approval

**Gap analysis highlights (27 critical issues identified):**
- No grace period for accidental accepts/hires
- No real-time availability toggle (🟢/🟡/🔴)
- No same-day urgent job flow
- Text-based location matching (must be GPS)
- Self-reported skill verification (no actual checks)
- Identity verification doesn't exist
- Hours dispute has no resolution mechanism
- GST handling undefined
- No-show handling missing
- Rating system cold start problem

### 6. Security Research

| Document | Location | Status |
|----------|----------|--------|
| Security Audit v2 (RateRight app) | `plans/security-audit-v2.md` | ✅ Complete |
| Code Quality Review (Kimi K2 work) | `plans/claude-code-review-kimi-k2.md` | ✅ Complete |

**Security findings:** 27 critical, 35 medium, 18 low severity issues identified in RateRight v2. Critical: no rate limiting, no email verification, ABN validation bypass, missing RLS policies, CSRF gaps.

### 7. Clawdbot / Rivet Operational Research

| Document | Location | Status |
|----------|----------|--------|
| YouTube & Community Intel | `plans/clawdbot-youtube-intel.md` | ✅ Complete |
| YouTube Video Scan | `research/clawdbot-youtube-intel.md` | ✅ Complete |
| Community Research | `plans/clawdbot-community-research.md` | ✅ Complete |
| Autonomous Agent Research | `plans/autonomous-agent-research.md` + summary | ✅ Complete |
| Self-Improvement System | `plans/self-improvement-system.md` | ✅ Designed |
| Coding Pipeline | `plans/coding-pipeline.md` | ✅ Complete |
| Subagent Reliability Guide | `plans/subagent-reliability-guide.md` | ✅ Complete |

**Key operational findings:**
- 537+ ClawdHub skills available; we're barely using any
- Security: gateway confirmed bound to loopback ✅
- Need regular `~/.clawdbot/` backups (not currently doing)
- Alex Finn's "Henry" bot capabilities benchmarked (we match on most, gap on YouTube scripts/newsletters)
- Autonomous agent frameworks compared: LangGraph, CrewAI, AutoGPT, OpenDevin, Codel
- Biggest agent improvement areas: vector memory, task decomposition, systematic error recovery

### 8. Other Documented Research

| Document | Location | Status |
|----------|----------|--------|
| Construction Glossary | `memory/construction-glossary.md` | ✅ Complete |
| Construction Management System (idea) | `plans/construction-management-system.md` | 📝 Idea stage |
| Notion Site Logbook Structure | `plans/notion-site-logbook-structure.md` | ✅ Complete |
| Website Gap Analysis | `plans/website-gap-analysis.md` | ✅ Complete |
| Website Code Analysis | `plans/website-code-analysis.md` | ✅ Complete |

---

## ⚠️ GAPS IN KNOWLEDGE

### High Priority Gaps

| Gap | Why It Matters | Suggested Action |
|-----|---------------|-----------------|
| **Actuarial modeling for payment protection** | $10/week pricing has no mathematical basis. A single $50K claim destroys 100-worker pool. | Engage actuary or model claim rates using construction insolvency data (2,636 companies FY2024-25) |
| **AFSL regulatory guidance** | Payment protection likely requires an AFSL. This is a ~$150-300K, 6-12 month blocker. | Seek ASIC guidance on proposed model structure before building |
| **State-by-state regulatory compliance** | Labour hire licensing differs by state (required in QLD, SA, WA, ACT; under consideration in NSW). Only NSW deeply researched. | Research QLD, VIC, SA, WA, ACT requirements for labour hire licensing |
| **Sham contracting legal risk** | Uber-like UX (accept jobs, GPS check-in, platform-controlled matching) could classify workers as employees. | Get formal legal opinion on independent contractor vs employee classification |
| **Live user testing / validation** | All research is desk-based. Zero user interviews, surveys, or prototype testing with real tradies/contractors. | Run 10-20 user interviews with contractors and workers. Test signup flow prototype. |
| **ABR GUID registration** | ABN lookup code is written but can't go live without the GUID. | Register at abr.business.gov.au/Tools/WebServicesAgreement (free, minutes to complete) |
| **Unit economics at scale** | $50/hire model validated conceptually but no financial projections for CAC, LTV, burn rate, break-even. | Build financial model: customer acquisition cost, retention rates, monthly burn, runway projections |

### Medium Priority Gaps

| Gap | Why It Matters | Suggested Action |
|-----|---------------|-----------------|
| **Insurance partner identification** | Payment protection requires licensed insurer partnership to avoid AFSL. No candidates researched. | Research Australian general insurers willing to partner on construction payment protection products |
| **Real competitor pricing data** | Sidekicker's exact markup is estimated (~30%), not confirmed. Agency markups are ranges. | Mystery-shop Sidekicker and 2-3 agencies to get exact pricing |
| **Worker persona validation** | "Dave the Chippy" persona is assumed, not validated. Don't know actual app usage patterns of construction workers. | Survey or interview 10+ construction workers about phone habits, app usage, hiring pain points |
| **Construction industry seasonality data** | No data on demand cycles, peak hiring periods, weather impact on matching. | Research ABS construction employment data by quarter, weather-related site shutdowns |
| **SEO keyword research** | Content engine plan exists but no actual keyword research data (search volumes, difficulty, opportunity). | Run Ahrefs/SEMrush analysis on construction hiring keywords in Australia |
| **Google Maps API billing** | Address validation at $0.017/request costed, but no estimate of monthly volume or total cost projection. | Estimate monthly address lookups and model API costs at different user scales |
| **yt-dlp / YouTube transcript pipeline** | Blocked by bot detection. Need workaround for automated YouTube content scanning. | Install deno runtime or implement YouTube Data API v3 with Google Cloud API key |

### Low Priority Gaps

| Gap | Why It Matters | Suggested Action |
|-----|---------------|-----------------|
| **International expansion research** | No research on NZ, UK, or other markets. | Not needed now; focus on Sydney first |
| **Equipment rental marketplace** | Mentioned as long-term feature in UX research. No research done. | Park for 12+ months |
| **AI matching algorithm benchmarks** | No data on ML-based matching performance in construction marketplaces. | Research after MVP launches with real matching data |
| **Trade school partnership models** | Mentioned in strategy but no specific institutions or partnership structures researched. | Research after initial traction |

---

## 📊 Research Coverage Heatmap

| Domain | Coverage | Confidence |
|--------|----------|------------|
| Market size & opportunity | 🟢 Excellent | High |
| Competitor landscape | 🟢 Excellent | High |
| Pricing & business model | 🟢 Excellent | High |
| UX/UI design patterns | 🟢 Excellent | High |
| API integrations (verification) | 🟢 Good | High |
| Payment flow (Stripe) | 🟢 Excellent | High |
| Brand & content strategy | 🟢 Good | Medium-High |
| Security posture | 🟢 Good | High |
| Product gap analysis | 🟢 Excellent | High |
| Legal & regulatory | 🟡 Partial | Medium |
| Payment protection viability | 🟡 Partial | Low-Medium |
| Financial projections | 🔴 Missing | Low |
| User validation (real humans) | 🔴 Missing | Low |
| Clawdbot/Rivet operations | 🟢 Good | High |
| Voice AI (VAPI) setup | 🟡 Designed, not tested | Medium |

---

## 🎯 Top 5 Research Priorities (Next Actions)

1. **Register ABR GUID** — Unblocks ABN verification with zero cost. Code already written.
2. **User interviews** — Talk to 10+ real contractors and workers. All current research is desk-based.
3. **Legal opinion on contractor classification** — Sham contracting risk is existential. Need formal advice.
4. **Financial model** — Build unit economics: CAC, LTV, burn rate, break-even point, funding needs.
5. **AFSL / payment protection regulatory check** — Determine if the insurance model requires AFSL before investing in building it.

---

## 📁 File Index

All research files for reference:

### `memory/plans/` (Research Documents)
- `abr-api-research.md` — ABR JSON API, validation algorithm, implementation code
- `agency-model-research.md` — Agency business models, fee structures, market size
- `autonomous-agent-research.md` + `*-summary.md` — AI agent frameworks comparison
- `brand-voice-guide.md` — Tone, messaging, copywriting guidelines
- `claude-code-review-kimi-k2.md` — Code quality review of automated work
- `clawdbot-community-research.md` — Community best practices, heartbeat patterns, skills
- `clawdbot-youtube-intel.md` — YouTube creator intel, tips we're not using
- `competitor-analysis.md` — 6-competitor deep analysis with positioning matrix
- `construction-management-system.md` — Idea-stage Notion-based job logging
- `construction-ux-best-practices.md` — Glove-first design, trust features, onboarding
- `construction-ux-research.md` — Hipages/Airtasker/ServiceSeeking UX analysis
- `content-engine-plan.md` — Automated content marketing system design
- `crew-hire-market-research.md` — Flat-fee crew hire, Uber model translation, legal
- `deep-gap-analysis.md` — 27 product gaps across 8 categories
- `gig-app-ui-research.md` — Uber/DoorDash/Tinder UI patterns for construction
- `marketing-research.md` — Platform-by-platform content strategy
- `payment-protection-research.md` — Insurance model critical analysis, AFSL requirements
- `rateright-v2-product-spec.md` — Full product specification (AI-first marketplace)
- `security-audit-v2.md` — 80 security issues (27 critical)
- `self-improvement-system.md` — Rivet error tracking and learning framework
- `sms-sequences.md` — Worker/contractor SMS flows
- `stripe-payment-flow.md` — Full Stripe Checkout integration design
- `vapi-realtime-setup.md` — Voice AI assistant configuration
- `vapi-webhook-tools-spec.md` — VAPI webhook architecture
- `verification-apis-research.md` — ASIC, NSW Fair Trading, SafeWork, iCare, Google Places
- `voice-signup-flow.md` — Voice-first worker onboarding design
- `website-gap-analysis.md` — Current website gaps
- `youtube-api-scan.md` — YouTube scanning setup

### `memory/research/`
- `clawdbot-youtube-intel.md` — YouTube video scan results

---

*Report compiled by Rivet research subagent. Last updated: 2026-02-06.*