An augmented reality device sends data representative of a field of view to a remote system. The field of view is comprises two portions, a first portion displayed to a user of the augmented reality device, and a second portion encompassing an area outside of the first portion. The remote system generates an element of an augmented reality display based on the second portion, and sends the element to the augmented reality device. When movement of the device causes the field of view to shift, the device includes the generated element in the augmented reality display.