# INVESTIGATION: Repository Cleanup
Date: 2025-01-15
Issue: Repository contains 647.46 MB with extensive clutter from failed attempts

## FINDINGS

### Repository Status
- Current Size: 647.46 MB
- Potential Cleanup: 139.44 MB (reduced - keeping AUDIT_EVIDENCE)
- Target Size After Cleanup: 508.02 MB
- App Status: WORKING (initializes successfully)
- 87.2% of endpoints confirmed working (95/109 tested per context)

### Cleanup Targets Identified (19 directories + app backups)
NOTE: AUDIT_EVIDENCE (37.07 MB) will be KEPT per user directive

#### Large Cleanup Targets
- evidence: 108.55 MB (contains 4 Python files - need review)
- audit: 27.87 MB

#### Medium Cleanup Targets
- backups: 1.36 MB (contains 10 Python files - likely old code)
- ui_rebuild: 0.28 MB (contains 3 Python files)
- performance_optimization: 0.10 MB (contains 12 Python files)
- QC_Evidence: 0.09 MB
- ui_rebuild_v5: 0.09 MB (contains 7 Python files)

#### Small Cleanup Targets
- conversion_workspace: 0.06 MB
- discovery_audit: 0.05 MB (contains 1 Python file)
- ui_rebuild_v3: 0.04 MB
- ui_rebuild_v4: 0.03 MB
- migrations_backup_: 0.03 MB (redundant - main migrations has 23 files)
- control_tower: 0.02 MB
- audit_reports: 0.01 MB
- investigation_logs: 0.01 MB
- temp: 0.00 MB (contains 2 Python files)
- deep_discovery: 0.00 MB
- ui_rebuild_v2: 0.00 MB
- ui_rebuild_v6: 0.00 MB

#### App Folder Backups
- templates_backup_ (2/09/2025)
- templates_backup_20250902_123220 (2/09/2025)
- templates_backup_20250907_150642 (7/09/2025)
- routes.py.broken_backup (19/08/2025)
- routes.py.critical_backup (19/08/2025)

### Files to KEEP
- AUDIT_EVIDENCE/ (37.07 MB - per user directive)
- README.md (updated 10/09/2025 8:38 PM - current accurate version)
- migrations/ (23 files - active migrations)
- 3.7 Evidence Archive/ (MDP documentation)
- .env (configuration)
- requirements.txt
- run.py
- All working code in app/ (except backups)

### Files to REMOVE
- README_Developer_Onboarding.md (outdated, 15KB)
- All 19 investigation/audit/rebuild directories listed above (excluding AUDIT_EVIDENCE)
- All backup files in app/

### Python Files in Cleanup Targets
WARNING: Some cleanup targets contain Python files:
- backups: 10 files
- performance_optimization: 12 files
- ui_rebuild_v5: 7 files
- evidence: 4 files
- ui_rebuild: 3 files
- temp: 2 files
- discovery_audit: 1 file

These appear to be old/redundant code from failed attempts but should be verified before deletion.

### Git Status
- Multiple uncommitted changes detected
- Recommendation: Commit current state before cleanup

### Verification Complete
- App starts successfully
- Flask blueprints register correctly
- No database operations tested (out of scope for cleanup)

## CRITICAL UPDATE - Further Investigation Results

### Evidence Folder Analysis
- Size: 108.55 MB (78% of total cleanup target)
- Activity: 176 files modified in last 7 days
- TODAY: 8 files modified on 2025-09-10
- Contents: 1075 .txt files, test results, audit logs, checklists

### Safety Classification

#### CONFIRMED SAFE TO DELETE (31MB total):
- ui_rebuild, ui_rebuild_v2-v6: Failed UI attempts
- migrations_backup_: Redundant (main migrations exists)
- control_tower, conversion_workspace: Old workspace folders
- deep_discovery, discovery_audit: Old investigation folders
- audit_reports, investigation_logs: Old audit trails
- temp: Empty temp folder
- performance_optimization: Old optimization attempts (August)
- audit: Old audit folder (August)
- backups: Old code backups (August)
- App folder template backups and .backup files
- README_Developer_Onboarding.md

#### PENDING USER CONFIRMATION (108MB):
- evidence/: Awaiting confirmation if user-created or app-generated

### Revised Cleanup Targets:
- Minimum Safe Cleanup: 31MB (keeping evidence + AUDIT_EVIDENCE)
- Maximum Cleanup: 139MB (if evidence confirmed as user investigation files)

## CRITICAL UPDATE 2 - Root Directory Disaster

### Root Directory Analysis
- **848 FILES** in root directory (should be ~10-15 max)
- Total size: 5.37 MB of clutter
- File types:
  - 334 .py files (test scripts, fixes, diagnostics)
  - 226 .md files (reports, investigations)
  - 159 .txt files (commands, notes)
  - 28 .json files (test results)
  - 20 .sql files (schema, fixes)
  - 16 .bat files
  - 14 .ps1 files
  - 13 .sh files
  - 10 .log files

### Pattern Analysis
- Multiple "EMERGENCY", "FIX_NOW", "URGENT" files
- "nuclear_deployment" attempts (panic mode)
- Hundreds of test_*.py scripts
- Dozens of fix_*.py scripts
- Investigation reports with timestamps
- SSH command files everywhere
- Database fix attempts

### Files That Should Be in Root (Keep)
- run.py, requirements.txt, .env, README.md
- .gitignore, fly.toml, LICENSE
- pyproject.toml, setup.py, pytest.ini, .flake8
- docker-compose.production.yml, Dockerfile
- Maybe 15 files MAX

### Cleanup Required
- Move ~830+ files out of root
- Create investigation_archive folder for historical value
- Or delete if truly redundant

### Total Cleanup Scope Revision
- Previously cleaned: 176 MB from folders
- Additional root cleanup: 5.37 MB + organization
- File count reduction: 848  ~15 files in root