-
公开(公告)号:US10274737B2
公开(公告)日:2019-04-30
申请号:US15056804
申请日:2016-02-29
IPC分类号: G09G5/36 , G02B27/01 , B60R11/04 , G06T3/00 , H04N5/232 , H04N19/00 , H04N7/18 , H04N13/00 , H04N21/414 , H04N21/4223
摘要: A vehicle camera system captures and transmits video to a user device, which includes a viewing device for playback of the captured video, such as virtual reality or augmented reality glasses. A rendering map is generated that indicates which pixels of the video frame (as identified by particular coordinates of the video frame) correspond to which coordinates of a virtual sphere in which a portion of the video frame is rendered for display. When a video frame is received, the rendering map is used to determine the texture values (e.g., colors) for coordinates in the virtual sphere, which is used to generate the display for the user. This technique reduces the rendering time when a user turns his or her head (e.g., while in virtual reality) and so it reduces motion and/or virtual reality sickness induced by the rendering lag.
-
公开(公告)号:US10271021B2
公开(公告)日:2019-04-23
申请号:US15056678
申请日:2016-02-29
摘要: A vehicle has a camera system that captures video while the vehicle moves. The vehicle records the captured video and/or wirelessly transmits the captured video to a remote user device for playback. When the vehicle is moving, a coarse waypoint is identified and a trajectory is determined from the current location of the vehicle to the coarse waypoint that reduces (e.g., minimizes) sudden changes in direction of movement of the vehicle, reduces (e.g., minimizes) sudden changes in speed of the vehicle, and/or reduces (e.g., minimizes) sudden changes in acceleration of the vehicle by reducing (e.g., minimizing) jerk or snap of the vehicle trajectory. One or more fine waypoints along the trajectory are selected and the vehicle moves to the coarse waypoint along the trajectory by passing through those fine waypoints, resulting in smooth movement of the device that reduces or eliminates motion sickness for users viewing the captured video.
-
公开(公告)号:US09875533B2
公开(公告)日:2018-01-23
申请号:US15408885
申请日:2017-01-18
发明人: Seiichi Kato , Yasufumi Shiraishi , Daniel J. Moffitt , Kenji Nikaido , Daniel Eduardo Martinez , Lu Yuan , Jiangyu Liu , Aleksandar B. Tomic , Ivan Stojiljkovic , Zhengyou Zhang
IPC分类号: G06K9/00 , G06T7/00 , G06T7/13 , G06T5/00 , G06K9/62 , G06T7/33 , G06K9/52 , G06K9/46 , G06K9/32
CPC分类号: G06T7/0004 , G06K9/00442 , G06K9/3275 , G06K9/4642 , G06K9/4647 , G06K9/4652 , G06K9/52 , G06K9/6215 , G06K9/6267 , G06T5/00 , G06T5/008 , G06T5/40 , G06T7/13 , G06T7/33 , G06T7/90 , G06T2207/20021 , G06T2207/30176 , H04N1/3878 , H04N1/6027
摘要: Image processing for productivity applications is provided. An image may be received by a computing device. The computing device may detect the edges comprising the received image and adjust the image based on a skew state of the detected edges. The computing device may then process the adjusted image to correct imbalances. The computing device may then assign an image classification to the processed image. The computing device may then adjust the processed image based on the assigned image classification.
-
公开(公告)号:US09864430B2
公开(公告)日:2018-01-09
申请号:US14593955
申请日:2015-01-09
发明人: Dijia Wu , Michael J. Conrad , Tim Burrell , Xu Miao , Zicheng Liu , Qin Cai , Zhengyou Zhang
CPC分类号: G06F3/013 , G06F3/0304 , G06F3/038 , G06K9/0061
摘要: Examples are disclosed herein that are related to gaze tracking via image data. One example provides, on a gaze tracking system comprising an image sensor, a method of determining a gaze direction, the method comprising acquiring image data via the image sensor, detecting in the image data facial features of a human subject, determining an eye rotation center based upon the facial features using a calibrated face model, determining an estimated position of a center of a lens of an eye from the image data, determining an optical axis based upon the eye rotation center and the estimated position of the center of the lens, determining a visual axis by applying an adjustment to the optical axis, determining the gaze direction based upon the visual axis, and providing an output based upon the gaze direction.
-
公开(公告)号:US09756284B2
公开(公告)日:2017-09-05
申请号:US14817021
申请日:2015-08-03
发明人: Cha Zhang , Timothy A. Large , Zhengyou Zhang , Ruigang Yang
摘要: The described implementations relate to enhancement images, such as in videoconferencing scenarios. One system includes a poriferous display screen having generally opposing front and back surfaces. This system also includes a camera positioned proximate to the back surface to capture an image through the poriferous display screen.
-
公开(公告)号:US20170251180A1
公开(公告)日:2017-08-31
申请号:US15056922
申请日:2016-02-29
CPC分类号: H04N7/185 , B64C39/02 , G02B27/017 , G02B2027/0178 , G05D1/0038 , G06Q10/101 , G06T19/006 , H04N5/23296
摘要: In embodiments of collaborative camera viewpoint control for interactive telepresence, a system includes a vehicle that travels based on received travel instructions, and the vehicle includes a camera system of multiple cameras that each capture video of an environment in which the vehicle travels from different viewpoints. Viewing devices receive the video of the environment from the different viewpoints, where the video of the environment from a selected one of the viewpoints is displayable to users of the viewing devices. Controller devices that are associated with the viewing devices can each receive a user input as a proposed travel instruction for the vehicle based on the selected viewpoint of the video that is displayed on the viewing devices. A trajectory planner receives the proposed travel instructions initiated via the controller devices, and generates a consensus travel instruction for the vehicle based on the proposed travel instructions.
-
公开(公告)号:US20170251179A1
公开(公告)日:2017-08-31
申请号:US15056678
申请日:2016-02-29
CPC分类号: H04N7/185 , B64C39/024 , B64C2201/027 , B64C2201/127 , B64C2201/146 , G02B27/017 , G02B2027/0178 , G05D1/0094 , H04B7/18506
摘要: A vehicle has a camera system that captures video while the vehicle moves. The vehicle records the captured video and/or wirelessly transmits the captured video to a remote user device for playback. When the vehicle is moving, a coarse waypoint is identified and a trajectory is determined from the current location of the vehicle to the coarse waypoint that reduces (e.g., minimizes) sudden changes in direction of movement of the vehicle, reduces (e.g., minimizes) sudden changes in speed of the vehicle, and/or reduces (e.g., minimizes) sudden changes in acceleration of the vehicle by reducing (e.g., minimizing) jerk or snap of the vehicle trajectory. One or more fine waypoints along the trajectory are selected and the vehicle moves to the coarse waypoint along the trajectory by passing through those fine waypoints, resulting in smooth movement of the device that reduces or eliminates motion sickness for users viewing the captured video.
-
公开(公告)号:US20170090560A1
公开(公告)日:2017-03-30
申请号:US14866534
申请日:2015-09-25
发明人: Yinpeng Chen , Sasa Junuzovic , Zhengyou Zhang , Zicheng Liu
IPC分类号: G06F3/01 , G06K9/00 , G06F3/041 , G06F17/24 , G06F3/0346
摘要: The large display interaction implementations described herein combine mobile devices with people tracking to enable new interactions including making a non-touch-sensitive display touch-sensitive and allowing personalized interactions with the display. One implementation tracks one or more mobile computing device users relative to a large computer-driven display, and configures content displayed on the display based on a distance a given mobile computing device user is from the display. Another implementation personalizes user interactions with a large display. One or more mobile computing device users are tracked relative to a display. The identity of each of the one or more mobile computing device users is obtained. Content displayed on the display is configured based on a distance an identified mobile computing device user is from the display and the identity of the user that provides the content.
-
公开(公告)号:US09552061B2
公开(公告)日:2017-01-24
申请号:US14226136
申请日:2014-03-26
发明人: Zhengyou Zhang , Qin Cai
CPC分类号: G06F3/013 , G06K9/00604 , G06T7/0002 , G06T7/85 , G06T2207/10012 , G06T2207/30196
摘要: The subject disclosure is generally directed towards eye gaze detection based upon both eyes being fixated on the same gaze location. In one aspect, an image including a subject's left and right eyes is captured, from which left and right glint and pupil center information are extracted. The left and right glint data and the left and right pupil data are used with left and right bias correction matrices to jointly determine a gaze location.
摘要翻译: 主题公开通常针对基于两只眼睛固定在同一注视位置上的眼睛注视检测。 在一个方面,捕获包括被摄体的左眼和右眼的图像,从中提取左,右闪光和瞳孔中心信息。 左和右闪烁数据以及左和右瞳孔数据与左和右偏置校正矩阵一起使用以共同确定凝视位置。
-
公开(公告)号:US20160205353A1
公开(公告)日:2016-07-14
申请号:US15073928
申请日:2016-03-18
发明人: Andrew D. Wilson , Zhengyou Zhang , Philip A. Chou , Neil S. Fishman , Donald M. Gillett , Hrvoje Benko
CPC分类号: H04N7/157 , A47G1/02 , G06F3/005 , G06F3/011 , G06F3/0304 , G06F2203/0381 , G06T17/20 , G06T19/006 , H04N7/147
摘要: A tele-immersive environment is described that provides interaction among participants of a tele-immersive session. The environment includes two or more set-ups, each associated with a participant. Each set-up, in turn, includes mirror functionality for presenting a three-dimensional virtual space for viewing by a local participant. The virtual space shows at least some of the participants as if the participants were physically present at a same location and looking into a mirror. The mirror functionality can be implemented as a combination of a semi-transparent mirror and a display device, or just a display device acting alone. According to another feature, the environment may present a virtual object in a manner that allows any of the participants of the tele-immersive session to interact with the virtual object.
摘要翻译: 描述了远程沉浸式环境,其提供远程沉浸式会话的参与者之间的交互。 环境包括两个或多个设置,每个与参与者相关联。 反过来,每个设置包括用于呈现三维虚拟空间以供本地参与者查看的镜像功能。 虚拟空间至少显示了一些参与者,如同参与者实际存在于相同的位置并观察镜像。 反射镜功能可以实现为半透明反射镜和显示设备的组合,或者仅仅是单独操作的显示设备。 根据另一特征,环境可以以允许远程沉浸式会话的任何参与者与虚拟对象交互的方式呈现虚拟对象。
-
-
-
-
-
-
-
-
-