Superapp Architecture: ChatGPT Should Be the Non-Blocking Master Process, Not a Peer Tab

Good refinement. You’re right that as the number of concurrent workers grows, you need to separate “what to do” (master controller) from “who gets the terminal right now” (resource manager). Mixing those two responsibilities in one layer would overload the master context with scheduling details it shouldn’t care about. But I’d argue this is a phase 2 concern. The semaphore layer becomes necessary when you have 4+ workers contending for shared resources. The first step — and the one that delivers 90% of the user experience improvement — is simply making the conversation non-blocking. Even with a single background worker and zero resource contention, the cognitive continuity gain is massive. Get the hierarchy right first. The resource management layer slots in naturally once the master-worker relationship exists.