CAPTURING AND SIMULATING RADAR DATA FOR AUTONOMOUS DRIVING SYSTEMS

A simulation system may generate radar data for synthetic simulations of autonomous vehicles, by using a data store of object radar data and attributes determined from sensor data captured in real-world physical environments. The radar data store may include radar point clouds representing real-world objects and associated object attributes, as well as radar background data captured for a number of physical environments. The simulation system may construct radar data for use in a simulation based on radar object data and/or radar background data, including using various probabilities within various overlay regions to determine subsets of object and background radar points to be rendered. During a simulation, the generated radar data may be provided to a simulated radar sensor of a simulated vehicle configured to execute trained perception models based on radar data input.