The present invention provides a system for providing image-based video service, including a cache system configured to store video information that matches image-related data; a fingerprint extraction unit configured to extract the fingerprint of an image corresponding to input image-related data; and a matching unit configured to determine video information that matches the fingerprint of the image extracted by the fingerprint extraction unit; wherein the system for providing image-based video service determines video information, matching image-related data received from a client terminal, via the cache system or the matching unit, and transmits video result information corresponding to the determined video information to the client terminal, and a method using the same.