A method for conducting a three dimensional (3D) video conference between multiple participants, the method may include receiving direction of gaze information regarding a direction of gaze of each participant within a representation of a virtual 3D video conference environment that is associated with the participant; determining, for each participant, updated 3D participant representation information within the virtual 3D video conference environment, that reflects the direction of gaze of the participant; and generating, for at least one participant, an updated representation of virtual 3D video conference environment, the updated representation of virtual 3D video conference environment represents the updated 3D participant representation information for at least some of the multiple participants.