A method generating planning-based attention signals includes receiving driving-scene data. The driving-scene data is indicative of a driving scene around a host vehicle. The driving-scene data includes map data and localization data. The driving scene includes a plurality of actors. The method further includes converting the driving-scene data into a scene-graph. The method further includes inputting the scene-graph into a deep neural network (DNN). Further, the method includes determining an attention score for each of the plurality of actors using the DNN and the scene-graph. The attention score of each of the plurality of actors represents a priority given to each of the plurality of actors in the driving scene. The method further includes commanding the host vehicle to autonomously drive according to a trajectory determined by taking into account the attention score of each of the plurality of actors.