Methods, systems, and non-transitory computer readable storage media are disclosed for processing data for a subset of domains in parallel with publishing data to a tenant database for another subset of domains within a shared infrastructure. Specifically, the disclosed system assigns one or more partitions of an intermediate shared processing queue to a set of domains indicated by a scan request from a client device. The disclosed system extracts data from a subset of domains of the set of domains via the one or more partitions and publishes scan results of the subset of domains to the tenant database. Furthermore, the disclosed system extracts, in parallel with publishing the data of the subset of domains, additional data of an additional subset of domains via the one or more partitions of the intermediate shared processing queue.