MAINTENANCE OF AUTONOMOUS VEHICLE TESTS

The disclosed technology provides solutions for maintaining autonomous vehicle (AV) tests and, provides methods for evaluating test relevance and for determining how to fix outdated AV tests. In some aspects, a process of the disclosed technology includes steps for associating a set of test metrics with an AV test, monitoring operation of an AV to identify one or more behaviors performed by the AV in the simulated environment and determining a validity of the AV test with respect to the simulated environment based on the AV behaviors and the set of test metrics. Systems and machine-readable media are also provided.