SELF-SUPERVISED TRAINING FROM A TEACHER NETWORK FOR COST VOLUME BASED DEPTH ESTIMATES

DRIVE March 14, 2024
Source
A method for controlling a vehicle in an environment includes generating, via a cross-attention model, a cross-attention cost volume based on a current image of the environment and a previous image of the environment in a sequence of images. The method also includes generating combined features by combining cost volume features of the cross-attention cost volume with single-frame features associated with the current image. The single-frame features may be generated via a single-frame encoding model. The method further includes generating a depth estimate of the current image based on the combined features. The method still further includes controlling an action of the vehicle based on the depth estimate.

Discussion in the ATmosphere

Loading comments...