Driving surface cost landscape

Techniques for generating a driving surface cost landscape for determining costs for vehicle positions in an environment are described herein. A planning component within a vehicle may determine a non-preferred surface associated with a type of non-preferred area of an environment along a route of a vehicle, determine a preferred surface associated with a preferred area of the environment, determine an adjusted non-preferred surface by removing an overlapping area of the non-preferred surface that overlaps the preferred surface and determine a cost associated with a vehicle position based at least on the preferred surface and the adjusted non-preferred surface. The planning component may then determine a control trajectory for the autonomous vehicle based at least in part on the cost associated with the vehicle position.