SURROUND VIEW VISUALIZATION USING VISION LANGUAGE MODELS

DRIVE May 7, 2026
Source
In various examples, a vision language model may be prompted to select a supported environment visualization pipeline (e.g., a bowl visualization pipeline that models the surrounding environment as a 3D bowl, surface topology visualization pipeline that that models the surrounding environment as a detected 3D surface topology), one or more parameters of a supported environment visualization pipeline (e.g., for a bowl visualization pipeline, a parametrization of the shape of the 3D bowl model, stitching parameters such as seam placement, blend width, or blend area, etc.), and/or a rendering viewport (e.g., a virtual camera position and orientation). As such, the selected and/or configured technique may be used to visualize an environment around an ego-machine, such as a vehicle, robot, and/or other type of object, in systems such as parking visualization systems, Surround View Systems, and/or others.

Discussion in the ATmosphere

Loading comments...