The invention discloses a modal independent retrieval method and system based on an intermediate text semantic enhancement space. The method comprises the following steps of obtaining the bottom features of pairs of text and image, constructing a training data set and a test data set; establishing the intermediate text semantic enhancement space based on linear discriminant analysis; calculating asimilarity matrix of image text pairs; respectively constructing a projection matrix model of an image retrieval text and a text retrieval image according to the intermediate text semantic enhancement space and the similarity matrix; using the training dataset to solve the projection matrix parameters of the retrieved text and the retrieved image respectively; and based on the projection matrix parameters of the text/text retrieval images, retrieving the text/text retrieval images by using the test data set. The method respectively learns mapping matrix for image retrieval text and retrievaltask of text retrieval image, the retrieval is more pertinent, and the retrieval accuracy is greatly improved.