An optical tracking system for determining the pose of a moving object in a reference coordinate system includes light emitters, optical detectors, and a pose processor. The processor is coupled with an optical detector and also with a light emitter. The processor determines the object's pose according to detected light. An optical detector and a light emitter are situated at a fixed position in the reference coordinate system. Other ones of the optical detectors and light emitters are attached to the object. One optical detector is a WFOV detector comprising an optical sensor and optical receptors. The receptors are spaced apart and optically coupled with the optical sensor. The sensor senses light received from a light emitter. Each receptor projects a different angular section of a scene on the sensor. The pose processor associates the representation on the sensor, with a respective receptor which projected the light on the sensor.