Disclosed are various embodiments for identifying a message deliverability problem. Responses are received from one or more client devices that include information that identifies whether a respective response is associated with a first group of messages or a second group of messages. A message deliverability problem for at least one of the first group of messages or the second group of messages may be identified based at least in part on the information included in at least a portion of the plurality of responses.