SELECTING TESTING SCENARIOS FOR EVALUATING THE PERFORMANCE OF AUTONOMOUS VEHICLES

In an example method, a computer system receives first data representing a plurality of scenarios for estimating a performance of a vehicle in conducting autonomous operations. Further, the computer system determines, for each of the scenarios: (i) a first metric indicating an observed performance of the vehicle in that scenario, where the first metric is determined based on at least one rule, and (ii) a second metric indicating a degree of information gain associated with that scenario. The computer system selects a subset of the scenarios based on the first metrics and the second metrics, and outputs second data indicative of the subset of the scenarios.