According to one aspect, data collected from various modules on an autonomous vehicle is synchronized, and snapshots of the synchronized data, referred to herein as ‘data snapshots’, are created. Contextual information associated with the data snapshots, e.g., indexes and/or metadata, is collected and/or derived, and the contextual information is stored along with the snapshots. The data snapshots may then be substantially searched, using the contextual information, to identify particular scenes for analysis. In addition to searching for particular scenes, series of scenes may be searched using the contextual information such that scenarios encountered by the autonomous vehicle over time may be identified.