The invention discloses a non-character image recognition method and device. The non-character image recognition method comprises the steps of: acquiring an image; binarizing the image to obtain a binary image; summating the gray values of pixels in each row of the binary image to obtain a row value of each row; regarding continuous rows having maximum row values in the binary image as a group, and detecting whether the binary image has N target groups, wherein N is a positive integer, and the target group is specifically such a group that the first row is not the one of the binary image and the last row is not the one of the binary image; and if not, determining the image as a non-character image. The technical solution can realize automatic recognition of non-character images.