-
公开(公告)号:US12069301B2
公开(公告)日:2024-08-20
申请号:US17441051
申请日:2020-03-19
发明人: Julien Fleureau , Bertrand Chupeau , Gerard Briand , Renaud Dore , Franck Thudor
IPC分类号: G06T15/08 , G06T17/00 , H04N19/147 , H04N19/177 , H04N19/46 , H04N19/593 , H04N19/597 , G06T19/00
CPC分类号: H04N19/597 , G06T17/00 , H04N19/147 , H04N19/177 , H04N19/46 , H04N19/593 , G06T15/08 , G06T19/00 , G06T2200/04 , G06T2207/10028
摘要: A patch-based atlas format in intra-periods of varying length is used to encode a volumetric video. A first atlas layout is built for a first sequence of 3D scenes. The number of 3D scenes in the sequence is chosen to fit the size of a Group of Pictures of the codec. A second sequence is iteratively set up by appending the next 3D scene of the sequence to encode while the number of patches of the layout built for this iterative second sequence is lower than or equal to the number of patches of the first layout. When iterations end, one of the layouts is selected to generate every atlas of the group. In such a way, size of metadata is decreased, and compression is enhanced.
-
公开(公告)号:US20240013475A1
公开(公告)日:2024-01-11
申请号:US18036556
申请日:2021-11-10
发明人: Julien Fleureau , Bertrand Chupeau , Renaud Dore
CPC分类号: G06T15/10 , G06T19/20 , G06T2200/24 , G06T2210/12 , G06T2210/62 , G06T2210/61 , G06T2219/2012
摘要: Methods, devices and video data encoding a volumetric 3D scene are disclosed. The user is allowed to modify values of rendering effects for some objects of the 3D scene in ranges provided by the content creator or the broadcaster. Metadata describing the possibilities of modifications, the concerned objects and authorized ranges of values are associated with the payload content. On the decoding side, according to these metadata an interface is provided to the user for modifying the values in the authorized ranges.
-
3.
公开(公告)号:US20210074025A1
公开(公告)日:2021-03-11
申请号:US16962405
申请日:2019-01-14
摘要: Methods and devices are provided to encode and decode a data stream carrying data representative of a three-dimensional scene, the data stream comprising color pictures packed in a color image; depth pictures packed in a depth image; and a set of patch data items comprising de-projection data; data for retrieving a color picture in the color image and geometry data. These data are inserted in the video track of the stream with associated temporal information. The color and depth pictures that are repeated at least two times in a sequence of patches are not packed in the images but inserted in the image track of the stream and are pointed by color or geometry data.
-
公开(公告)号:US11095920B2
公开(公告)日:2021-08-17
申请号:US16769807
申请日:2018-11-29
发明人: Julien Fleureau , Bertrand Chupeau , Franck Thudor
IPC分类号: H04N19/597 , G06T9/00
摘要: A colored 3D scene is encoded as one or two patch atlas images. Points of the 3D scene belonging a part of the space defined according to a truncated sphere center on a point of view and visible from this point of view are iteratively projected onto projection maps. At each iteration the projected part is removed from the 3D scene and the truncated sphere defining the next part of the scene to be projected is rotated. Once the entirety of the 3D scene is projected on a set of projection maps, pictures are determined within these maps. A picture, also called patch, is a cluster of depth consistent connected pixels. Patches are packed in a depth and a color atlas associated with data comprising an information relative to the rotation of the truncated sphere, so, a decoder can retrieve the projection mapping and proceed to the inverse projection.
-
公开(公告)号:US12101506B2
公开(公告)日:2024-09-24
申请号:US17622278
申请日:2020-06-23
发明人: Julien Fleureau , Franck Thudor , Gerard Briand , Renaud Dore
IPC分类号: H04N19/597 , H04N19/70
CPC分类号: H04N19/597 , H04N19/70
摘要: At least one embodiment relates to a method and apparatus for encoding a volumetric video representing a scene, said encoding being based on patches representing the color and depth of a 2D projection of subparts of the scene, wherein a first patch is packed in a second patch for a given time interval lower than or equal to a time period along which the second patch is defined when said first patch can be packed in said second patch over said time interval. Decoding method and apparatus are also provided.
-
公开(公告)号:US20240098235A1
公开(公告)日:2024-03-21
申请号:US18272472
申请日:2022-01-11
IPC分类号: H04N13/161 , H04N13/139 , H04N13/156 , H04N13/194
CPC分类号: H04N13/161 , H04N13/139 , H04N13/156 , H04N13/194 , H04N2013/0081
摘要: Methods and devices for generated multiplane images from a representation of a 3D scene are disclosed. When an MPI is generated by the system, an image of the accumulation of the alpha values is computed. A convolutional networked is trained with a penalization function that penalizes MPIs with high values of accumulated alpha according to a parameter selected or trained to reduce the redundancy of information between layers of the MPI. When generating a MPI from a subset of the views of a new captured 3D scene, a first MPI is generated with the trained CNN with the associated parameter. An error is calculated between the other views and corresponding synthesized with the first MPI. This error is used to modify the parameter. Then, a second MPI is generated with the trained CNN with the new parameter.
-
公开(公告)号:US20240193857A1
公开(公告)日:2024-06-13
申请号:US18285947
申请日:2022-04-12
发明人: Bertrand Chupeau , Renaud Dore , Gerard Briand , Julien Fleureau , Remy Gendrot , Franck Thudor , Neus Sabater , Thierry Tapie
IPC分类号: G06T17/00 , H04N13/279 , H04N19/597
CPC分类号: G06T17/00 , H04N13/279 , H04N19/597
摘要: Methods and devices for encoding and decoding 3D scenes of an immersive video are disclosed with the related data stream. Taking advantage of the fact that parts of the 3D scene does not change from one frame of the video to another, even when the cameras move and/or the lighting condition change, dynamic and static parts of the 3D scene are encoded in different atlases. In an embodiment, static patch atlases are repeated between two updates. In another embodiment, only updates are encoded and transmitted. The decoder maintains a memory associating entity of the 3D scene with a set of static patches that is updated with instructions linked to update static patch atlases. At each presentation time the static part of the 3D scene to decode is obtained from the memory.
-
公开(公告)号:US11122294B2
公开(公告)日:2021-09-14
申请号:US16632480
申请日:2018-07-16
发明人: Julien Fleureau , Thierry Tapie , Franck Thudor
IPC分类号: H04N19/85 , H04N19/136 , H04N19/172 , H04N19/177 , H04N19/182 , H04N19/186 , H04N19/597
摘要: A sequence of point clouds is encoded as a video by an encoder and transmitted to a decoder which retrieves the sequence of point clouds. Visible points of a point cloud are iteratively projected on projection maps according to at least two centers of projection, to determine a patch data item lists. One of the centers of projection is selected and corresponding image patches are generated and packed into a picture. Pictures and associated patch data item list are encoded in a stream. The decoding method decodes pictures and associated patch data item lists. Pixels of image patches comprised in pictures are un-projected according to data stored in associated patches. The methods have the advantage of encoding every point of point clouds in a manner avoiding artifacts and allowing decoding at video frame rate.
-
公开(公告)号:US12101507B2
公开(公告)日:2024-09-24
申请号:US17786005
申请日:2020-12-17
发明人: Renaud Dore , Bertrand Chupeau , Franck Thudor , Julien Fleureau
IPC分类号: H04N19/597 , G06T9/00 , G06T15/08 , G06T15/20 , H04N21/235 , H04N21/2662 , H04N21/81
CPC分类号: H04N19/597 , G06T9/00 , G06T15/08 , G06T15/20 , H04N21/2353 , H04N21/2662 , H04N21/816
摘要: Methods and devices for encoding and decoding data representative of a 3D scene are disclosed. A set of first patches is generated from a first MVD content acquired from a first region of the 3D scene. A patch is a part of one of the views of the MVD content. A set of second patches is generated from a second MVD content acquired from a second region of the 3D scene. An atlas packing first and second patches is generated and associated with metadata indicating, for a patch of the atlas, whether the patch is a first or a second patch At the decoding side, first patches are used for rendering the viewport image and second patches are used for pre-processing or post-processing the viewport image.
-
10.
公开(公告)号:US12081719B2
公开(公告)日:2024-09-03
申请号:US17787364
申请日:2020-12-17
发明人: Julien Fleureau , Franck Thudor , Thierry Tapie , Renaud Dore
IPC分类号: H04N13/111 , H04N13/161 , H04N13/178
CPC分类号: H04N13/111 , H04N13/161 , H04N13/178
摘要: Methods and devices are provided for encoding, transmitting and decoding 3DoF+ volumetric video. At the encoding stage one input view (among all the input ones) is selected to convey the viewport dependent light effect and its id is transmitted to the decoder as an extra metadata. On the decoder side, when patches coming from this selected view are available for the rendering of the viewport, they are preferentially used regarding the other candidates whatever the view to synthesize position.
-
-
-
-
-
-
-
-
-