Where ABxAG is headed
Every era below is tracked in the open — specs and plans live in
conductor/tracks/ on GitHub. Shipped means live in a
release, not just merged.
Shipped
Era 1 · Voice companion
Gemini Live voice chat, “Hey AB” wake word, reminders & alarms, quiet hours, auto-update that switches between any versions.
Era 2 · Eyes
Real-time screen vision and OCR — she reads errors, documents and analytics straight from your screen. Screen text is always untrusted data.
Era 3 · Hands
96 local PC tools: apps, files, mouse & keyboard, browser, clipboard, coding help — gated by confirmations, an emergency stop, and a permission board.
Era 4 · Memory & mind
Local cognition runtime: episodic memory, goals, learned skills, curiosity and presence — she knows when to speak and when to stay quiet.
Era 5 · Body
3D character engine (three.js): import any .pmx / .vrm / .glb / .fbx model, Character Studio, cloth physics, and a desktop-companion doll you can drag onto windows.
Era 6 · Co-pilot
Dual-cursor: her own neon-red pointer works in the background while your mouse stays 100% yours — with a real OFF switch in Settings → PC control & safety.
In progress & next
Statuses move as work lands. next is planned · exploring is research, not a promise.
Full-isolation mode next
Today's background clicks suit most apps; a separate virtual desktop session would isolate even canvas-heavy software completely.
Voice v2 next
Fuller hands-free flow and wider language coverage, keeping the same low-latency live link.
Skill sharing next
Export a learned skill, send it to a friend, import theirs — verified routines that travel between PCs.
Richer characters next
More formats, better auto-rigging, livelier idle life for the desktop doll.
Phone remote exploring
Check on tasks and approve confirmations from your phone on the same network.
Beyond Windows exploring
The desktop agent is Win32-native today; other platforms need their own automation backend first.