iconocl4st/clio
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

adding a bunch of untested files
Some checks failed
Deploy API / deploy (push) Failing after 1s
Details

Browse source
This commit is contained in:
Your Name 2026-05-19 20:12:49 -04:00
parent ab3a76cd0f
commit 56d8fb4d56
85 changed files with 8879 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

153
clio-infra/TODO.md Normal file
View file

@ -0,0 +1,153 @@
# Clio - Consolidated TODO
## Architecture Overview
```
┌─────────────────────────────────────────────────────────────────────────┐
│ TARGET ARCHITECTURE │
├─────────────────────────────────────────────────────────────────────────┤
│ │
│ ┌──────────┐ ┌──────────────────────────────────────────────┐ │
│ │ Phone │───────▶│ Server (10.0.0.45) │ │
│ │ (Android)│ push │ - Storage hub (recordings) │ │
│ └──────────┘ │ - clio-api (FastAPI) │ │
│ │ - clio-ui (React frontend) │ │
│ ┌──────────┐ │ - Database (highlights, transcripts) │ │
│ │ Pi │───────▶│ - Forgejo (code.hallocks.xyz) │ │
│ │(portable)│ push └──────────────────────────────────────────────┘ │
│ └──────────┘ │ │
│ │ pulls recordings │
│ ▼ │
│ ┌──────────────────────────────────────────────┐ │
│ │ Desktop (10.0.0.130) │ │
│ │ - GPU: RTX 3090 │ │
│ │ - clio-ai/transcription (Whisper) │ │
│ │ - clio-ai/real_time (wake word detection) │ │
│ │ - Off at night (non-critical) │ │
│ └──────────────────────────────────────────────┘ │
│ │
└─────────────────────────────────────────────────────────────────────────┘
```
## Immediate Tasks
### Infrastructure Setup
- [x] Import Pi recorder code (systemd setup) → clio-pi/
- [ ] Migrate ~100s GB of recordings from Pi to server storage
- [ ] Pi: Add sync script to push recordings to server
- [ ] Pi: Auto-detect audio device (currently hardcoded to hw:1)
- [ ] Set up Forgejo repos for all clio-* projects
- [ ] Configure Forgejo Actions for server deployments (10.0.0.45)
- [ ] Create backup strategy for viewer, highlights, and database
### Deployment Pipeline
- [ ] clio-api: Forgejo Actions → deploy to 10.0.0.45
- [ ] clio-ui: Forgejo Actions → deploy to 10.0.0.45:/var/www/recordings-viewer
- [ ] clio-ai: Manual deploy to desktop (10.0.0.130) - not via Actions
---
## Feature Backlog
### High Priority
- [ ] QR code for key import (avoid email/typing)
- [ ] Server URL configuration in app UI
- [ ] Manual sync trigger button
- [ ] View sync history/status in app
- [ ] Display last successful sync time on phone
- [ ] Server status page/dashboard:
- When phone/pi last synced
- Total recordings count
- Recent uploads
- Disk space usage
### Wake Word / Voice Recognition (clio-ai)
- [ ] Manage wake words in UI (currently hardcoded)
- [ ] Centralize voice recognition training data
- [ ] Real-time detection improvements (currently sucks even on desktop)
- [ ] Future: Real-time detection on phone/pi (low priority)
### Audio Analysis & Intelligence
- [ ] Speech detection bar in recording detail view
- [ ] Sleeping/silence detection for overnight recordings
- [ ] Auto voice recognition / speaker identification
- [ ] Auto highlight generation (audio-based, not text search)
### Viewer UX
- [ ] Background audio playback (mini player across views)
- [ ] Highlight duration (currently point-only, add end time)
- [ ] Auto-scroll timeline to recordings
### Medium Priority
- [ ] Configurable recording quality (bitrate, sample rate)
- [ ] Configurable segment duration (currently 2 hours)
- [ ] Delete synced files automatically (with retention)
- [ ] Server authentication for upload endpoint
- [ ] Server HTTPS with Let's Encrypt (partially done via Caddy)
### Low Priority / Nice to Have
- [ ] Multiple server destinations
- [ ] Compression before encryption
- [ ] Resume interrupted uploads
- [ ] Docker container for server
---
## Questions to Resolve
### Key Rotation
- What happens when server keypair changes?
- Options:
1. Keep old private key archived
2. Sync all files before rotating
3. Store key version in encrypted file header
### Manual Decryption
- Document steps to decrypt files copied via USB
- CLI tool needed
### Desktop Worker Architecture
- How does desktop pull recordings from server?
- How does it push transcriptions back?
- Queue system needed?
---
## Known Limitations
1. **No streaming encryption**: Entire temp file must complete before encryption
2. **No partial sync**: If upload fails, whole file retries
3. **Single server**: Can only sync to one destination at a time
4. **No authentication**: Relies on encryption for confidentiality
5. **Desktop off at night**: Real-time detection unavailable
---
## Repository Structure
```
/work/projects/clio/
├── clio-api/ # FastAPI server (recordings, highlights, transcripts)
├── clio-android/ # Android recording app
├── clio-ui/ # React frontend (viewer)
├── clio-ai/ # ML/AI components
│ ├── real_time/ # Wake word detection, voice classifier
│ └── transcription/ # Whisper transcription scripts
├── clio-pi/ # Raspberry Pi recorder
│ ├── bin/ # Recording scripts
│ ├── systemd/ # Service units
│ └── setup.sh # Pi setup script
└── clio-infra/ # Deployment, configs, docs
├── nixos/ # NixOS modules
├── scripts/ # Deploy scripts
└── TODO.md # This file
```
## Hosts
| Host | IP | Role |
|------|-----|------|
| Server | 10.0.0.45 | Storage, API, UI, Forgejo |
| Desktop | 10.0.0.130 | GPU transcription, real-time detection |
| Phone | (mobile) | Recording source |
| Pi | (TBD) | Portable recording source |