Techniques for updating data operations in a perception system are discussed herein. A vehicle may use a perception system to capture data about an environment proximate to the vehicle. The perception system may receive state data stored in cyclic buffer of globally registered detection and occasionally converted to gridded point cloud in a local reference frame. The two-dimensional gridded point cloud may be processed using one or more neural networks to generate semantic data associated with a scene or physical environment surrounding the vehicle such that the vehicle can make environment aware operational decisions, which may improve reaction time(s) and/or safety outcomes of the autonomous vehicle.