Provided is a system and method for broadcasting stereoscopic video data to users on the Internet based on Moving Picture Experts Group (MPEG)-4. The system includes: an encoding server for receiving stereoscopic video data, audio data, and Object Descriptor/Binary Format for Scene (OD/BIFS), which is information for controlling a content, and encoding the data into elementary stream (ES) having an MPEG-4 structure; a web server for receiving from the client any one among two-dimensional video display mode, field-shuttering video display mode and frame-shuttering video display mode; and a streaming server for generating a RTP (RTP) packet for real-time data transmission on the Internet by multiplexing the ES based on the display mode inputted into the web server, and transmitting the RTP packet to the client.