A system and computer-implemented method for classifying skin disorders using an image of a skin portion is provided. The system comprises a server configured to receive the image of the skin portion from an electronic communication device and process the received image of the skin portion, wherein the processing comprises at least one of: resizing, removing artifacts and noise, applying new color space, sharpening the image and correcting background. Furthermore, the server is configured to segment the processed image to identify the region of interest within the processed image and extract one or more features from the identified region of interest. The system further comprises a trained learning module configured to classify the skin disorder by mapping the extracted features with pre-stored images, wherein the pre-stored images that map with the extracted features are associated with a particular category of skin disorder.