公开(公告)号：US20230179798A1

公开(公告)日：2023-06-08

申请号：US17921619

申请日：2021-04-27

Applicant: SONY GROUP CORPORATION

Inventor： TOSHIYA HAMADA

IPC: H04N19/597 ,  H04N13/111 ,  H04N13/161 ,  H04N19/124 ,  H04N19/513

CPC classification number: H04N19/597 ,  H04N13/111 ,  H04N13/161 ,  H04N19/124 ,  H04N19/513

Abstract: Provided is a delivery apparatus (400) including a viewpoint information acquisition unit (410) configured to acquire viewpoint information of a user in real-time, a rendering unit (404) configured to perform rendering processing on three-dimensional spatial data in real-time on the basis of the viewpoint information to generate two-dimensional video data corresponding to a field of view of the user, a parameter generation unit (412) configured to generate an encoding parameter on the basis of a parameter regarding the rendering processing, an encoding unit (406) configured to perform encoding processing on the two-dimensional video data in real-time on a basis of the encoding parameter to generate delivering data, and a delivery unit (408) configured to deliver the delivering data to a client.

公开(公告)号：US20220124419A1

公开(公告)日：2022-04-21

申请号：US17433580

申请日：2020-03-05

Applicant: SONY GROUP CORPORATION

Inventor： YOSHIYUKI KOBAYASHI ,  TOSHIYA HAMADA

IPC: H04N21/845 ,  H04N21/4335 ,  H04N21/233 ,  H04N21/2343 ,  H04N21/854

Abstract: An information processing device includes: a receiving unit (251) that receives a segment file having a plurality of segments and a setting file in which a group to which the segment file belongs is set; an extraction unit (271) that extracts one or more MP4 samples included in the segment of the segment file received by the receiving unit (251) and adds attribute information including a reproduction start time of the MP4 sample to the MP4 sample; a determination unit (26) that determines a switching position at which the segment file belonging to the group after switching is output in units of the MP4 samples on the basis of an accepted switching operation of the group and the attribute information; and an output unit (2735) that outputs an output signal generated from the segment file belonging to the group after the switching from the switching position to an output device.

公开(公告)号：US20230215102A1

公开(公告)日：2023-07-06

申请号：US17998500

申请日：2021-05-11

Applicant: SONY GROUP CORPORATION

Inventor： TOSHIYA HAMADA ,  TAKUMI TSURU

IPC: G06T19/00 ,  G06T7/20 ,  G10L13/04 ,  G10L19/16

CPC classification number: G06T19/003 ,  G06T7/20 ,  G10L13/04 ,  G10L19/167 ,  G06T2210/61

Abstract: The present disclosure relates to a media distribution device, a media distribution method, and a program enabling to generate a guide voice more appropriately. A media distribution device includes a guide voice generation unit that generates a guide voice describing a rendered image viewed from a viewpoint in a virtual space by using a scene description as information describing a scene in the virtual space and a user viewpoint information indicating a position and a direction of the viewpoint of a user; and an audio encoding unit that mixes the guide voice with original audio, and encodes the guide voice. The present technology can be applied to, for example, a media distribution system that distributes 6DoF media.

公开(公告)号：US20220351484A1

公开(公告)日：2022-11-03

申请号：US17633286

申请日：2020-07-02

Applicant: SONY GROUP CORPORATION

Inventor： TAKUMI TSURU ,  TOSHIYA HAMADA ,  MITSUHIRO HIRABAYASHI

IPC: G06V10/26 ,  G06V20/64

Abstract: A generation unit (111) generates an identification region map indicating whether or not each divided object data is visible from each position in a three-dimensional space by using information regarding orientation of a normal vector (15) dividing an object (10) in the three-dimensional space and information regarding an outline of the object (10).

公开(公告)号：US20220165306A1

公开(公告)日：2022-05-26

申请号：US17593971

申请日：2020-03-30

Applicant: SONY GROUP CORPORATION

Inventor： TOSHIYA HAMADA ,  MITSUHIRO HIRABAYASHI

IPC: G11B27/00 ,  H04N19/597 ,  H04N19/20 ,  H04N19/423 ,  G11B27/10

Abstract: A playback device of the present disclosure includes a processing unit and a control unit. When having acquired identification information, the control unit calculates, on a playback time axis and based on the acquired identification information, a first point-of-time on the playback time axis, the first point-of-time being a point-of-time turning back a current point-of-time on the playback time axis by a first duration-of-time satisfying a first predetermined condition, and newly sets the calculated first point-of-time in the processing unit. The processing unit generates a video in which frames from the first point-of-time are arranged in chronological order, based on at least a part of acquired 6DoF content, a position and an orientation of a set viewpoint, and the first point-of-time newly set by the control unit.

公开(公告)号：US20240196065A1

公开(公告)日：2024-06-13

申请号：US18556361

申请日：2022-01-17

Applicant: SONY GROUP CORPORATION

Inventor： TOSHIYA HAMADA

IPC: H04N21/81 ,  G06F3/01 ,  G06T5/70 ,  G06V10/25 ,  G06V10/74 ,  H04N19/124

CPC classification number: H04N21/816 ,  G06F3/013 ,  G06T5/70 ,  G06V10/25 ,  G06V10/761 ,  H04N19/124

Abstract: An information processing apparatus includes a rendering section. The rendering section performs rendering processing on three-dimensional space data on the basis of field-of-view information regarding a field of view of a user to generate two-dimensional video data depending on the field of view of the user. Further, the rendering section sets a region of interest and a region of non-interest in a display region in which the two-dimensional video data is displayed, the region of interest being to be rendered at a high resolution, the region of non-interest being to be rendered at a low resolution; extracts a gaze object at which the user gazes, on the basis of a parameter related to the rendering processing and the field-of-view information; renders the gaze object in the region of interest at a high resolution; and reduces a data amount of a non-gaze object that is an object other than the gaze object in the region of interest.

公开(公告)号：US20220122616A1

公开(公告)日：2022-04-21

申请号：US17423569

申请日：2019-12-25

Applicant: SONY GROUP CORPORATION

Inventor： YOSHIYUKI KOBAYASHI ,  TOSHIYA HAMADA ,  MITSUHIRO HIRABAYASHI

IPC: G10L19/008 ,  H04S7/00

Abstract: An audio reproduction with a realistic feeling is achieved while suppressing incongruity and discomfort given to a user. The information processing device (1, 2) according to an embodiment includes an acquisition section (11) configured to acquire content data including a plurality of objects; an execution timing decision section (134) configured to decide an execution timing for each of the objects; a rendering processing section (151, 152, 153) configured to render each of the objects on the basis of line-of-sight information of a user that has been input immediately before the execution timing of rendering each of the objects; and an output synthesis section (154) configured to synthesize output data for every object that has been generated by the rendering.

公开(公告)号：US20240267559A1

公开(公告)日：2024-08-08

申请号：US18563097

申请日：2022-02-21

Applicant: SONY GROUP CORPORATION

Inventor： TOSHIYA HAMADA

IPC: H04N19/597 ,  H04N19/119 ,  H04N19/124 ,  H04N19/154 ,  H04N19/167 ,  H04N19/30

CPC classification number: H04N19/597 ,  H04N19/119 ,  H04N19/124 ,  H04N19/154 ,  H04N19/167 ,  H04N19/30

Abstract: An information processing apparatus includes a rendering section and an encoding section. The rendering section performs rendering processing on three-dimensional space data on the basis of field-of-view information regarding a field of view of a user to generate two-dimensional video data depending on the field of view of the user. The encoding section calculates, as evaluation values, values of SSIM or values of VMAF for respective division regions of a plurality of division regions obtained by dividing a display region in which the generated two-dimensional video data is displayed, each evaluation value being obtained by numerically expressing a degradation in image quality that is caused due to encoding; sets quantization parameters for the respective division regions of the plurality of division regions such that the evaluation values for the respective division regions of the plurality of division regions are equal; and performs encoding processing on the two-dimensional video data on the basis of the set quantization parameters.

公开(公告)号：US20240185511A1

公开(公告)日：2024-06-06

申请号：US18554295

申请日：2022-04-19

Applicant: SONY GROUP CORPORATION

Inventor： TAKUMI TSURU ,  TOSHIYA HAMADA

IPC: G06T15/20 ,  G06F3/01 ,  G06T13/20

CPC classification number: G06T15/20 ,  G06F3/012 ,  G06F3/013 ,  G06T13/20 ,  G06T2210/32

Abstract: An information processing apparatus according to an embodiment of the present technology includes a rendering unit and a generation unit. The rendering unit performs rendering processing on three-dimensional space data on the basis of field-of-view information regarding a field of view of a user, to generate two-dimensional video data corresponding to the field of view of the user. The generation unit generates a saliency map representing a saliency of the two-dimensional video data on the basis of a parameter regarding the rendering processing. This makes it possible to achieve distribution of a high-quality virtual video.

公开(公告)号：US20220150464A1

公开(公告)日：2022-05-12

申请号：US17434182

申请日：2020-02-26

Applicant: SONY GROUP CORPORATION

Inventor： NAOTAKA OJIRO ,  RYOHEI TAKAHASHI ,  TOSHIYA HAMADA ,  MITSUHIRO HIRABAYASHI

IPC: H04N13/282 ,  H04N13/279 ,  H04N13/139

Abstract: An image processing apparatus according to the present disclosure includes: an acquisition unit that acquires first field-of-view information, which is information for specifying a first field of view of a user in a wide angle-of-view image, and second field-of-view information, which is information for specifying a second field of view, which is a field of view at a destination of a transition from the first field of view; and a generation unit that generates transition field-of-view information, which is information indicating the transition in field of view from the first field of view to the second field of view on the basis of the first field-of-view information and the second field-of-view information.