Can Hosted AgentBuilder accept images from client tools?

I’ve tried a few styles of returning base64 encoded image urls from my onClientTool handler, but the agent only sees it as text and just guesses at what the image is. This is on hosted (AgentBuilder on open ai server)