Validation of asset movement can begin with the definition of a virtual tripwire for video cameras of a video surveillance system that monitor a defined area of interest through which RFID-identified assets are conveyed. The virtual tripwire can visually define a boundary within the view field of the video camera. The video camera can detect the movement of an asset through a virtual tripwire and an asset management system can be notified of the potential misdirection of the asset. The asset management system can obtain the asset's RFID data from a RFID handling system that monitors the area of interest. The validity of the detected movement can be determined using RFID data and an asset movement specification that defines pathing rules for assets and virtual tripwires. When the movement of the asset is determined to be invalid, a record of suspect movement data can be generated for the asset.