公开(公告)号：US20240331296A1

公开(公告)日：2024-10-03

申请号：US18574846

申请日：2021-08-24

Applicant: Google LLC

Inventor： Robert Marchant ,  Tríona Éidín Butler ,  Henry John Holland ,  David Matthew Jones ,  Benjamin Guy Alexander Pawle ,  Michael Colville ,  George Joseph Rickerby

IPC: G06T17/20 ,  G06T13/40 ,  G06T19/20 ,  G06V40/16

CPC classification number: G06T17/20 ,  G06T13/40 ,  G06T19/20 ,  G06T2210/52 ,  G06T2219/024 ,  G06T2219/2016 ,  G06V40/171

Abstract: The technology provides enhanced co-presence of interactive media participants without high quality video or other photo-realistic representations of the participants. A low-resolution graphical representation (318) of a participant provides real-time dynamic co-presence. Face detection captures a maximum amount of facial expression with minimum detail in order to construct the low-resolution graphical representation. A set of facial mesh data (304) is generated by the face detection to include a minimal amount of information about the participant's face per frame. The mesh data, such as facial key points, is provided to one or more user devices so that the graphical representation of the participant can be rendered in a shared app at the other device(s) (308, 804). The rendering can include generating a hull (314, 806) that delineates a perimeter of the user mask and generating a set of facial features (316, 808), in which the graphical representation is assembled by combining the hull and the set of facial features (318, 810).

公开(公告)号：US20240320904A1

公开(公告)日：2024-09-26

申请号：US18574878

申请日：2021-07-29

Applicant: Google LLC

Inventor： Donald Allen Barnett ,  Carsten Hinz ,  Corbin Alexander Cunningham ,  George Joseph Rickerby ,  Benjamin Guy Alexander Pawle ,  Michael Colville ,  Scott Douwes

IPC: G06T15/60 ,  G06F3/0346 ,  G06T3/40 ,  G06T5/70 ,  G06T7/50 ,  G09G3/00

CPC classification number: G06T15/60 ,  G06F3/0346 ,  G06T3/40 ,  G06T5/70 ,  G06T7/50 ,  G09G3/001 ,  G09G2354/00

Abstract: The technology provides tactile copresence for participants working in a real-time remote collaborative arrangement. This enhanced user experience enables different users to work remotely through their own local physical media such as whiteboards, large screen displays or poster boards (208, 228, 262, 272). Participants are able to view a common workspace in the same way, and are able to experience tactile copresence via silhouette representations (106, 312, 600) of the other people. A method includes receiving depth map information of a participant at a first location, the depth map information being derived from a raw image captured at the first location (904). A presence shadow for the participant is generated by a computing device associated with a different location, in which the presence shadow reprojects aspects of the participant according to the depth map information where the aspects are blurred according to a proximity of each aspect to a physical medium at the first location (906).