SYSTEMATIC FAULT DETECTION IN VEHICLE CONTROL SYSTEMS

An evaluation computing system may implement techniques to validate a vehicle controller, such as based on a detection of a systematic fault. The evaluation computing system may access data (e.g., log data and/or map data) associated with an operation of the vehicle in an environment as controlled by the controller. The evaluation computing system may modify a portion of the map data representative of a simulated change associated with a portion of the environment. The evaluation computing system may run a simulation with a simulated environment, generated based on the modified map data, to determine whether the controller detects and/or mitigates the simulated change in a sufficient manner. Based on a determination of whether or not the controller detects and/or mitigates the simulated change in a sufficient manner, the evaluation computing system may determine an error associated with the controller or may validate the controller.