An apparatus comprising a memory and a processor coupled to the memory. The processor receives input from a user, processes a first portion of the input via more than one service module while receiving a second portion of the input to determine a first speculative result, wherein processing the first portion of the input comprises executing at least one service module coupled to a corresponding speculation buffer, processes a second portion of the input via the more than one service module to determine a second speculative result, wherein processing the second portion of the input comprises executing the at least one service module coupled to the corresponding speculation buffer, processes the input via the more than one service module to determine a final output, wherein processing the input comprises executing the at least one service module coupled to the corresponding speculation buffer, and outputs the final output to the user.