A subject's head position and motion can be tracked by analyzing a series of frames from a monocular camera and mapping distinguishing points visible in the frames onto an elliptical cylinder. The tracking data can be used to control a physical pan/tilt actuator or to reconfigure/reposition virtual objects, images of which can be synthesized and displayed, or composited back into the original frames and displayed.