Multi-Stage Autonomous Localization Architecture for Charging Electric Vehicles

An automated charging system for an electric vehicle is disclosed that includes a plug with a built-in camera assembly. The camera assembly captures images of a charging port of the electric vehicle, which are processed by one or more processors to estimate the location of the charging port relative to the plug. A multi-stage localization architecture is described that includes a gross localization procedure and a fine localization procedure. The gross localization procedure can implement a first convolutional neural network (CNN) to estimate a position of an object in the image. The fine localization procedure can implement a second CNN to estimate a position and orientation of the object. Actuators for moving the plug in a three-dimensional space can be controlled by the multi-stage localization architecture.