Fast recolor for video based point cloud coding

    公开(公告)号:US12101505B2

    公开(公告)日:2024-09-24

    申请号:US17500345

    申请日:2021-10-13

    IPC分类号: H04N19/597 H04N19/186

    CPC分类号: H04N19/597 H04N19/186

    摘要: Methods and apparatuses of encoding a video stream using video point cloud coding include obtaining a source point cloud; obtaining a geometry-reconstructed point cloud, wherein the geometry-reconstructed point cloud is reconstructed using lossy coding; obtaining a target point included in the geometry-reconstructed point cloud; performing at least one of a forward K-dimensional (KD)-tree search to determine a first plurality of points of the source point cloud which are nearest neighbors to the target point, and a backward KD-tree search to determine a second plurality of points of the source point cloud for which the target point is a nearest neighbor; determining an average color value based on at least one of a first average color value of the first plurality of points and a second average color value of the second plurality of points; selecting a color value for the target point based on the average color value; and generating an encoded video stream based on the selected color value.

    Method and apparatus for constructing a 3D geometry

    公开(公告)号:US11670045B2

    公开(公告)日:2023-06-06

    申请号:US17502973

    申请日:2021-10-15

    摘要: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a three-dimensional (3D) geometry of a room from a panorama image of the room. An apparatus includes processing circuitry that determine two-dimensional (2D) positions of wall corner points of the room in the panorama image based on a user input. Each wall corner point is in one of a floor plane or a ceiling plane of the room. The processing circuitry calculates 3D positions of the wall corner points based on the 2D positions of the wall corner points, a size of the panorama image, and a distance between the floor plane and a capture position of a device capturing the panorama image, determines a room layout based on an order of the wall corner points, and generates the 3D geometry based on the room layout and the 3D positions of the wall corner points.

    Method and apparatus for generating a floor plan

    公开(公告)号:US11651533B2

    公开(公告)日:2023-05-16

    申请号:US17502520

    申请日:2021-10-15

    IPC分类号: G06T11/20 G06T19/00 G06T7/60

    摘要: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a floor plan from a point cloud model. An apparatus includes processing circuitry that receives an input three-dimensional point cloud corresponding to a three-dimensional space. The processing circuitry determines a plurality of wall planes in the received input three-dimensional point cloud. The processing circuitry generates a plurality of line segments. Each line segment is generated by projecting a respective wall plane of the plurality of wall planes to a floor plane in the three-dimensional space. The processing circuitry represents the plurality of wall planes in the three-dimensional space using the plurality of line segments in a two-dimensional space corresponding to the floor plan. The processing circuitry adjusts the plurality of line segments in the two-dimensional space to improve the floor plan. The processing circuitry generates the floor plan based on the plurality of adjusted line segments.

    NON-BINARY OCCUPANCY MAP FOR VIDEO BASED POINT CLOUD CODING

    公开(公告)号:US20220394294A1

    公开(公告)日:2022-12-08

    申请号:US17496270

    申请日:2021-10-07

    摘要: Methods and apparatuses of encoding a video stream encoded using video point cloud coding include obtaining a source point cloud; generating an occupancy map including one or more pixels based on the source point cloud, an occupancy value associated with each pixel being a non-binary value; encoding the occupancy map to generate an encoded occupancy map, wherein a block of the encoded occupancy map corresponds to the one or more pixels of the occupancy map; selecting an occupancy value of the block based on the one or more pixels; and generating an encoded video stream based on the selected occupancy value.

    FAST RECOLOR FOR VIDEO BASED POINT CLOUD CODING

    公开(公告)号:US20220394295A1

    公开(公告)日:2022-12-08

    申请号:US17500345

    申请日:2021-10-13

    IPC分类号: H04N19/597 H04N19/186

    摘要: Methods and apparatuses of encoding a video stream using video point cloud coding include obtaining a source point cloud; obtaining a geometry-reconstructed point cloud, wherein the geometry-reconstructed point cloud is reconstructed using lossy coding; obtaining a target point included in the geometry-reconstructed point cloud; performing at least one of a forward K-dimensional (KD)-tree search to determine a first plurality of points of the source point cloud which are nearest neighbors to the target point, and a backward KD-tree search to determine a second plurality of points of the source point cloud for which the target point is a nearest neighbor; determining an average color value based on at least one of a first average color value of the first plurality of points and a second average color value of the second plurality of points; selecting a color value for the target point based on the average color value; and generating an encoded video stream based on the selected color value.

    CONDITIONAL RECOLOR FOR VIDEO BASED POINT CLOUD CODING

    公开(公告)号:US20220394293A1

    公开(公告)日:2022-12-08

    申请号:US17495301

    申请日:2021-10-06

    摘要: Methods and apparatuses of encoding a video stream using video point cloud coding include obtaining a source point cloud; generating a geometry map and a texture map based on the source point cloud; generating a reconstructed geometry map and a reconstructed texture map using lossy coding without using recoloring, wherein a resolution of the reconstructed geometry map is same as a resolution of the reconstructed texture map; obtaining a point of the source point cloud corresponding to a geometry pixel of the geometry map and a texture pixel of the texture map; selecting a color of the texture pixel based on a color of the obtained point; and generating an encoded video stream based on the selected color, the geometry map, and the texture map.

    Conditional recolor for video based point cloud coding

    公开(公告)号:US11979606B2

    公开(公告)日:2024-05-07

    申请号:US17495301

    申请日:2021-10-06

    摘要: Methods and apparatuses of encoding a video stream using video point cloud coding include obtaining a source point cloud; generating a geometry map and a texture map based on the source point cloud; generating a reconstructed geometry map and a reconstructed texture map using lossy coding without using recoloring, wherein a resolution of the reconstructed geometry map is same as a resolution of the reconstructed texture map; obtaining a point of the source point cloud corresponding to a geometry pixel of the geometry map and a texture pixel of the texture map; selecting a color of the texture pixel based on a color of the obtained point; and generating an encoded video stream based on the selected color, the geometry map, and the texture map.

    METHOD AND APPARATUS FOR CONSTRUCTING A 3D GEOMETRY

    公开(公告)号:US20220358716A1

    公开(公告)日:2022-11-10

    申请号:US17502973

    申请日:2021-10-15

    摘要: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for generating a three-dimensional (3D) geometry of a room from a panorama image of the room. An apparatus includes processing circuitry that determine two-dimensional (2D) positions of wall corner points of the room in the panorama image based on a user input. Each wall corner point is in one of a floor plane or a ceiling plane of the room. The processing circuitry calculates 3D positions of the wall corner points based on the 2D positions of the wall corner points, a size of the panorama image, and a distance between the floor plane and a capture position of a device capturing the panorama image, determines a room layout based on an order of the wall corner points, and generates the 3D geometry based on the room layout and the 3D positions of the wall corner points.