
A local-first engineering operating system that turns live work into deliberate goals, evidence and context-aware guidance.
- Situation
- Coding agents can implement quickly, but they rarely preserve the engineer's longer-term objective, recognize weak evidence or know when an interruption would do more harm than good.
- Task
- Build a private Windows companion that connects a 90-day mission to the work happening on screen without becoming another autonomous agent or surveillance layer.
- Action
- Designed a least-invasive perception cascade from UI Automation to local OCR, a deterministic intervention gate, scoped SQLite memory and schema-constrained Codex CLI advice behind explicit user approval.
- Result
- Released a reviewable V0.3.3 prototype with 56/56 automated tests, 14/14 release-gate metrics and 90% Top-5 recall on its current deterministic retrieval corpus; real-world usefulness remains under pilot evaluation.
Why this stack
Electron and TypeScript keep the Windows observer, state machine and always-on-top interface in one typed runtime. SQLite FTS5 makes memory local, inspectable and cheap to query. Codex CLI is a deliberately narrow reasoning gateway: calls are ephemeral, schema-constrained, read-only and only happen after deterministic policy finds enough evidence to justify one.
What I decided not to build
I refused to give Kovacs control of the computer. It cannot click, type, publish, commit or silently resume observation after restart. I also cut continuous model interpretation: unchanged, weak or unsafe context ends in silence, while local policy owns routine decisions. That makes the product less theatrical and substantially easier to trust.
Business impact
The product problem is guidance that either interrupts constantly or arrives without enough context to be useful. Kovacs makes silence the default, so screen sampling does not imply model spend and sensitive context stays local unless a guarded path explicitly allows more. The current release evidence is repository-scoped—not a production claim—and the ongoing pilot is designed to measure usefulness, false interventions, latency and privacy in real work.







