In particular embodiments, fusing structures includes receiving sensor data sets generated by sensors in response to sensing a structure system. Each sensor data set describes structures of the structure system. Structure pairs are generated, where a structure pair comprises a first structure from a first sensor data set and a second structure from a second sensor data set. A relational vector set is defined for each structure pair, and a relational vector score is calculated for each structure pair according to the relational vector set of the structure pair. An association score is calculated for each structure pair according to the relational vector score of the structure pair. The association score of the structure pair indicates a likelihood that the structure pair is fusable.