ILLUMINATED SURFACE SENSING FOR IN-CABIN APPLICATIONS

Optical sensors (e.g., cameras) and (e.g., IR) illumination sources may be distributed in an environment (e.g., an interior space such as a cabin or cockpit of an ego-machine) and synchronized to generate frames of sensor data. By positioning the optical sensors and assigning them corresponding frequency ranges, the resulting sensor data (e.g., images from different perspectives and with different illumination patterns) may be used to extract reflectance data, the reflectance data may be used to generate more accurate sensor data (e.g., HDR images, images re-rendered using an extracted bidirectional reflectance distribution function), and the resulting sensor data may be used in one or more downstream tasks, such as operator or occupant monitoring or detection tasks (e.g., gaze detection, pose detection, attentiveness or fatigue assessment, facial recognition, gesture recognition, occupant presence detection, child presence detection, seat belt detection, hands-on-wheel detection, etc.), generating visualizations (e.g., video conference calls), and/or otherwise.