-
公开(公告)号:US12101505B2
公开(公告)日:2024-09-24
申请号:US17500345
申请日:2021-10-13
申请人: TENCENT AMERICA LLC
发明人: Xiang Zhang , Wen Gao , Shan Liu , Weiwei Feng , Bing Jian
IPC分类号: H04N19/597 , H04N19/186
CPC分类号: H04N19/597 , H04N19/186
摘要: Methods and apparatuses of encoding a video stream using video point cloud coding include obtaining a source point cloud; obtaining a geometry-reconstructed point cloud, wherein the geometry-reconstructed point cloud is reconstructed using lossy coding; obtaining a target point included in the geometry-reconstructed point cloud; performing at least one of a forward K-dimensional (KD)-tree search to determine a first plurality of points of the source point cloud which are nearest neighbors to the target point, and a backward KD-tree search to determine a second plurality of points of the source point cloud for which the target point is a nearest neighbor; determining an average color value based on at least one of a first average color value of the first plurality of points and a second average color value of the second plurality of points; selecting a color value for the target point based on the average color value; and generating an encoded video stream based on the selected color value.
-
公开(公告)号:US11670045B2
公开(公告)日:2023-06-06
申请号:US17502973
申请日:2021-10-15
申请人: TENCENT AMERICA LLC
发明人: Xiang Zhang , Bing Jian , Lu He , Haichao Zhu , Shan Liu , Kelin Liu , Weiwei Feng
CPC分类号: G06T17/00 , G06T7/50 , G06T7/60 , G06T7/73 , G06T7/90 , G06T2200/24 , G06T2207/20164
摘要: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a three-dimensional (3D) geometry of a room from a panorama image of the room. An apparatus includes processing circuitry that determine two-dimensional (2D) positions of wall corner points of the room in the panorama image based on a user input. Each wall corner point is in one of a floor plane or a ceiling plane of the room. The processing circuitry calculates 3D positions of the wall corner points based on the 2D positions of the wall corner points, a size of the panorama image, and a distance between the floor plane and a capture position of a device capturing the panorama image, determines a room layout based on an order of the wall corner points, and generates the 3D geometry based on the room layout and the 3D positions of the wall corner points.
-
公开(公告)号:US12062206B2
公开(公告)日:2024-08-13
申请号:US17497025
申请日:2021-10-08
申请人: TENCENT AMERICA LLC
发明人: Xiang Zhang , Bing Jian , Lu He , Haichao Zhu , Shan Liu , Kelin Liu , Weiwei Feng
CPC分类号: G06T7/73 , G06T2207/30204 , G06T2207/30244
摘要: A method, computer program, and computer system is provided for 3D pose graph reconstruction. 3D reconstruction of indoor buildings for VR/AR applications, such as virtual touring, digital museum, and virtual home sale, may be performed based on estimating pose graph and transformation matrix between cameras by recognizing markers on the ground in panorama images. Image data corresponding to one or more views of a first camera is received. One or more markers corresponding to a second camera are identified within the received image data. A pose graph corresponding to the one or more views of the first camera is constructed based on the identified one or more markers, the pose graph comprising at least an edge.
-
公开(公告)号:US11651533B2
公开(公告)日:2023-05-16
申请号:US17502520
申请日:2021-10-15
申请人: TENCENT AMERICA LLC
发明人: Xiang Zhang , Bing Jian , Lu He , Haichao Zhu , Shan Liu , Kelin Liu , Weiwei Feng
CPC分类号: G06T11/203 , G06T7/60 , G06T19/00 , G06T2207/10028 , G06T2219/008
摘要: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a floor plan from a point cloud model. An apparatus includes processing circuitry that receives an input three-dimensional point cloud corresponding to a three-dimensional space. The processing circuitry determines a plurality of wall planes in the received input three-dimensional point cloud. The processing circuitry generates a plurality of line segments. Each line segment is generated by projecting a respective wall plane of the plurality of wall planes to a floor plane in the three-dimensional space. The processing circuitry represents the plurality of wall planes in the three-dimensional space using the plurality of line segments in a two-dimensional space corresponding to the floor plan. The processing circuitry adjusts the plurality of line segments in the two-dimensional space to improve the floor plan. The processing circuitry generates the floor plan based on the plurality of adjusted line segments.
-
公开(公告)号:US20220394294A1
公开(公告)日:2022-12-08
申请号:US17496270
申请日:2021-10-07
申请人: TENCENT AMERICA LLC
发明人: Xiang ZHANG , Weiwei Feng , Wen Gao , Shan Liu , Bing Jian
IPC分类号: H04N19/597 , H04N19/105 , H04N19/182 , H04N19/176 , G06T9/00
摘要: Methods and apparatuses of encoding a video stream encoded using video point cloud coding include obtaining a source point cloud; generating an occupancy map including one or more pixels based on the source point cloud, an occupancy value associated with each pixel being a non-binary value; encoding the occupancy map to generate an encoded occupancy map, wherein a block of the encoded occupancy map corresponds to the one or more pixels of the occupancy map; selecting an occupancy value of the block based on the one or more pixels; and generating an encoded video stream based on the selected occupancy value.
-
公开(公告)号:US20220394295A1
公开(公告)日:2022-12-08
申请号:US17500345
申请日:2021-10-13
申请人: TENCENT AMERICA LLC
发明人: Xiang Zhang , Wen Gao , Shan Liu , Weiwei Feng , Bing Jian
IPC分类号: H04N19/597 , H04N19/186
摘要: Methods and apparatuses of encoding a video stream using video point cloud coding include obtaining a source point cloud; obtaining a geometry-reconstructed point cloud, wherein the geometry-reconstructed point cloud is reconstructed using lossy coding; obtaining a target point included in the geometry-reconstructed point cloud; performing at least one of a forward K-dimensional (KD)-tree search to determine a first plurality of points of the source point cloud which are nearest neighbors to the target point, and a backward KD-tree search to determine a second plurality of points of the source point cloud for which the target point is a nearest neighbor; determining an average color value based on at least one of a first average color value of the first plurality of points and a second average color value of the second plurality of points; selecting a color value for the target point based on the average color value; and generating an encoded video stream based on the selected color value.
-
公开(公告)号:US20220394293A1
公开(公告)日:2022-12-08
申请号:US17495301
申请日:2021-10-06
申请人: TENCENT AMERICA LLC
发明人: Xiang Zhang , Wen Gao , Shan Liu , Weiwei Feng , Bing Jian
IPC分类号: H04N19/597 , H04N19/184 , G06T15/04
摘要: Methods and apparatuses of encoding a video stream using video point cloud coding include obtaining a source point cloud; generating a geometry map and a texture map based on the source point cloud; generating a reconstructed geometry map and a reconstructed texture map using lossy coding without using recoloring, wherein a resolution of the reconstructed geometry map is same as a resolution of the reconstructed texture map; obtaining a point of the source point cloud corresponding to a geometry pixel of the geometry map and a texture pixel of the texture map; selecting a color of the texture pixel based on a color of the obtained point; and generating an encoded video stream based on the selected color, the geometry map, and the texture map.
-
公开(公告)号:US12086931B2
公开(公告)日:2024-09-10
申请号:US17982945
申请日:2022-11-08
申请人: TENCENT AMERICA LLC
发明人: Dan Miao , Bing Jian , Weiwei Feng , Shan Liu , Ye Wang
CPC分类号: G06T17/00 , G06T7/194 , G06T7/30 , G06T7/40 , G06T13/40 , G06T15/04 , G06V10/761 , G06T2207/30196
摘要: A method for 3D human model reconstruction and animation includes receiving a two-dimensional (2D) image of a human, segmenting the 2D image into a foreground with the human and a background without the human in the 2D image, generating a parametric model comprising a pose, a shape, and one or more rigging parameters based on the human in the foreground, predicting a textured three-dimensional (3D) model using implicit surface reconstruction of the human in the foreground, aligning the parametric model and the textured 3D model using a 3D registration, and generating a textured 3D clothed human model based on the aligned parametric model and the predicted textured 3D model.
-
公开(公告)号:US11979606B2
公开(公告)日:2024-05-07
申请号:US17495301
申请日:2021-10-06
申请人: TENCENT AMERICA LLC
发明人: Xiang Zhang , Wen Gao , Shan Liu , Weiwei Feng , Bing Jian
IPC分类号: H04N19/597 , G06T15/04 , H04N19/184
CPC分类号: H04N19/597 , G06T15/04 , H04N19/184 , G06T2210/56
摘要: Methods and apparatuses of encoding a video stream using video point cloud coding include obtaining a source point cloud; generating a geometry map and a texture map based on the source point cloud; generating a reconstructed geometry map and a reconstructed texture map using lossy coding without using recoloring, wherein a resolution of the reconstructed geometry map is same as a resolution of the reconstructed texture map; obtaining a point of the source point cloud corresponding to a geometry pixel of the geometry map and a texture pixel of the texture map; selecting a color of the texture pixel based on a color of the obtained point; and generating an encoded video stream based on the selected color, the geometry map, and the texture map.
-
公开(公告)号:US20220358716A1
公开(公告)日:2022-11-10
申请号:US17502973
申请日:2021-10-15
申请人: TENCENT AMERICA LLC
发明人: Xiang ZHANG , Bing Jian , Lu He , Haichao Zhu , Shan Liu , Kelin Liu , Weiwei Feng
摘要: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a three-dimensional (3D) geometry of a room from a panorama image of the room. An apparatus includes processing circuitry that determine two-dimensional (2D) positions of wall corner points of the room in the panorama image based on a user input. Each wall corner point is in one of a floor plane or a ceiling plane of the room. The processing circuitry calculates 3D positions of the wall corner points based on the 2D positions of the wall corner points, a size of the panorama image, and a distance between the floor plane and a capture position of a device capturing the panorama image, determines a room layout based on an order of the wall corner points, and generates the 3D geometry based on the room layout and the 3D positions of the wall corner points.
-
-
-
-
-
-
-
-
-