An approach is provided in which an information handling system trains multiple classifiers using a set of training samples. The information handling system selects a leader classifier from the multiple classifiers that generates the most amount of correct decisions corresponding to the set of training samples. Next, the information handling system identifies an endorser classifier from the multiple classifiers that generates the highest proportion of correct decisions among the endorser classifier's decisions matching the leader classifier's decisions, and combines the leader classifier and the endorser classifier into a combined classifier stage. In turn, the information handling system utilizes the combined classifier stage to process inquiries and generate results.