Best way to connect to open-ai realtime http then websocket or websocket first then update

At what point in the process are you calling response.create?

The goal is to separate the immutable setup from any later updates. If this happens in the wrong order, assistant audio may start before the configuration has been updated.

Right after creating the session, send the initial session.update with voice, instructions, audio formats, tools, turn detection, and any other required configuration.

Once you receive session.updated, call response.create. This is where your failure case may originate from.

Essentially, you want to prevent the conversation from starting until the session has received its initial update.