snxraven/gnome-jarvis
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 1 Wiki Activity

P6

Browse Source
This commit is contained in:
snxraven
2026-09-11 14:20:57 -04:00
parent 275a44975f
commit 78cb03e6cb
22 changed files with 248 additions and 25 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/ROADMAP.md
+9 -6
View File
@@ -204,13 +204,16 @@ process and reflects daemon state without jank.
## Phase 6 — computer-use observe and semantic action
- [ ] Complete `cu-doctor`: Wayland/X11, portal, PipeWire, AT-SPI, libei, and
- [x] Complete `cu-doctor`: Wayland/X11, portal, PipeWire, AT-SPI, libei, and
optional fallback detection.
- [ ] Implement portal ScreenCast/Screenshot and tmpfs frame normalization.
- [ ] Implement GNOME Shell window truth and focus methods.
- [ ] Implement AT-SPI tree snapshots with per-step stable refs.
- [ ] Implement OCR and QVAC multimodal observe bundles.
- [ ] Implement `cu.observe`, `cu.zoom`, `cu.tree`, and `cu.find`.
- [x] Implement portal ScreenCast/Screenshot and tmpfs frame normalization.
- [x] Implement GNOME Shell window truth and focus methods.
- [x] Implement AT-SPI tree snapshots with per-step stable refs.
- [x] Implement OCR and QVAC multimodal observe bundles.
- [x] Implement `cu.observe`, `cu.zoom`, `cu.tree`, and `cu.find`.
- [x] Keep frames local in `/tmp/jarvis-cu`, downscale to WebP before
perception, and return explicit unavailable reasons when portal, Shell, or
AT-SPI providers cannot connect.
- [ ] Implement `cu.act` and semantic `cu.click`.
- [ ] Implement grant/revoke, expiry, step budget, audit hashes, and no-frame
retention by default.