Autonomous Electrical Grid Management

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for managing an electrical grid by controlling devices connected to the electrical grid. In one aspect, a method comprises: autonomously determining whether a control strategy update criterion is satisfied, and in response to determining that the control strategy update criterion is satisfied: identifying: (i) a plurality of devices connected to the electrical grid, and (ii) one or more objectives to be satisfied by the plurality of devices; generating, for the plurality of devices and for a plurality of controls, simulated data that simulates operation of the plurality of devices based on application of the plurality of controls; and identifying, by an optimization procedure and based on at least the simulated data, a respective control to be applied to each of the plurality of devices to satisfy the objectives.