Method and device for processing LIDAR sensor data are disclosed. The method includes: receiving a first dataset and a second dataset having pluralities of data points; matching at least some of the plurality of first points with at least some of the plurality of second points, thereby determining a plurality of pairs; for the given one of the plurality of pairs, determining a pair-specific filtering parameter by calculating neighbour beam distances between the given first data point and respective ones the set of neighboring points, a given neighbour beam distance being representative of a linear distance between the given first data point and a respective one of the set of neighbouring points; in response to the pair-specific parameter being positive, excluding the given one of the plurality of pairs from further processing; and processing the reduced plurality of pairs for merging the first dataset and the second dataset.