Provided is a video information processing system which processes a motion video which is configured from a plurality of still images in time series, comprising: a subject recognition unit which detects from among the plurality of still images the still images wherein a subject for detection is present, by a similarity determination with respect to registration data of the subject for detection using a first threshold; and a time period determination unit which, if an interval of the still images wherein the subject for detection is determined to be present is less than or equal to a second threshold, determines that the subject for detection is present also in the still images which are between the still images wherein the subject for detection is determined to be present. The start time and the end time of the contiguous still images wherein the subject for detection is determined to be present are associated with the registration data of the subject for detection and registered.