NAVIGATION SYSTEM WITH SEMANTIC DATA MAP MECHANISM AND METHOD OF OPERATION THEREOF

A navigation system includes: a control circuit configured to: a control circuit configured to: capture a semantic frame from a sensor data stream for a region of interest, calculate a score (EQ1) for semantic points in the semantic frame, align the semantic points includes a pose error corrected, generate a semantic grid map of the semantic points including a high-level grid and a low-level grid, calculate grid map statistics by counting the semantic points in the low-level grid within the high-level grid, filter the semantic points in the low-level grid based on the grid map statistics of the high-level grid, and generate a semantic map from the low-level grid filtered and the high-level grid; and a communication circuit, coupled to the control circuit, configured to: process the semantic frame through a network, and process the semantic map through the network for displaying on a device.