SYSTEMS AND METHODS FOR DERIVING AN AGENT TRAJECTORY BASED ON MULTIPLE IMAGE SOURCES

Examples disclosed herein may involve a computing system that is operable to (i) derive, from a first set of one or more images captured by a monocular camera associated with a vehicle, a first set of position information for a given agent; (ii) derive, from a second set of one or more image pairs captured by a stereo camera associated with the vehicle, a second set of position information for the given agent; (iii) input the first and second sets of position information for the given agent into a motion model that encodes knowledge regarding physical constraints on the given agent's real-world behavior; and (iv) determine a trajectory for the given agent based on an output of the motion model.