How should I architect an AI agent that edits a visual canvas through tools / JSON state?

whiteboard + tts/stt - draw what you need You mean like this, so you can explain to your video call avatar what they should do? Try CRDT… Ah and welcome to the developer community - where we steal your ideas long before you write them here haha.