-
公开(公告)号：US20220138999A1
公开(公告)日：2022-05-05
申请号：US17430257
申请日：2020-02-03
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Mariko ISOGAWA , Dan MIKAMI , Kosuke TAKAHASHI , Yoshinori KUSACHI
Abstract: A video and audio presentation device configured to present video and audio for sports training with less delay in physical reaction is provided. The device includes: an offset determination unit configured to determine a time-series offset toffset obtained by correcting a time difference tdiff on a basis of a correction coefficient α, the time difference tdiff representing a time difference between Areal and Amix, or a time difference between AVR and Amix, where a physical reaction Areal represents time-series data of physical reaction to an incoming object in a real environment, a physical reaction AVR represents time-series data of physical reaction to an incoming object presented in a virtual reality environment, and a physical reaction Amix represents time-series data of physical reaction to an incoming object presented in a semi-virtual reality environment; a video presentation unit configured to present video in the semi-virtual reality environment; and an audio presentation unit configured to shift audio corresponding to the video on a basis of the time-series offset toffset so that the audio precedes arrival of the video, and to present the shifted audio in the semi-virtual reality environment.
-
公开(公告)号：US20210106893A1
公开(公告)日：2021-04-15
申请号：US17078418
申请日：2020-10-23
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Kosuke TAKAHASHI , Dan MIKAMI , Mariko ISOGAWA , Akira KOJIMA , Hideaki KIMATA , Ayumi MATSUMOTO
Abstract: A virtual reality system is provided that includes a video presentation apparatus, the virtual reality system comprising: the video presentation apparatus which includes circuitry configured to: obtain as input a video sequence composed of a plurality of frames and mask information specifying a complementation target region in the video sequence; separate a frame into a foreground region and a background region based on binary images representing differences between the plurality of frames included in the video sequence; determine either one of patch-search-based completion and paste synthesis as a complementation method for the complementation target region based on a number of pixels belonging to the foreground region and located within a given distance from a periphery of the complementation target region; and complement the complementation target region in accordance with the complementation method; and a virtual reality head mounted display which presents the complemented video sequence to the user.
-
公开(公告)号：US20220156963A1
公开(公告)日：2022-05-19
申请号：US17435759
申请日：2020-02-25
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Kosuke TAKAHASHI , Dan MIKAMI , Mariko ISOGAWA , Yoshinori KUSACHI
IPC: G06T7/73
Abstract: A technology for obtaining a coordinate system conversion parameter more easily than in the related art is provided. A coordinate system conversion parameter estimation device includes: a camera coordinate system correspondence point estimation unit 2 configured to estimate 3-dimensional positions of a joint of a moving body in a camera coordinate system from a camera video in which an aspect indicating that the moving body is moving a marker of which 3-dimensional positions in a sensor coordinate system are able to be acquired by a sensor is shown and to set the 3-dimensional positions as 3-dimensional positions of a correspondence point in the camera coordinate system; a sensor coordinate system correspondence point estimation unit 4 configured to estimate a predetermined point of a figure drawn by all or a part of a 3-dimensional position series of the marker from the 3-dimensional position series of the marker corresponding to the camera video and to set the predetermined point as a 3-dimensional position of the correspondence point in the sensor coordinate system; and a coordinate system conversion parameter estimation unit 5 configured to estimate a coordinate system conversion parameter between the camera coordinate system and the sensor coordinate system from the 3-dimensional positions of the correspondence point in the camera coordinate system and the 3-dimensional positions of the correspondence point in the sensor coordinate system.
-
公开(公告)号：US20220314092A1
公开(公告)日：2022-10-06
申请号：US17845010
申请日：2022-06-21
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Kosuke TAKAHASHI , Dan Mikami , Mariko Isogawa , Akira Kojima , Hideaki Kimata , Ayumi Matsumoto
Abstract: A virtual reality system is provided that includes a video presentation apparatus, the virtual reality system comprising: the video presentation apparatus which includes circuitry configured to: obtain as input a video sequence composed of a plurality of frames and mask information specifying a complementation target region in the video sequence; separate a frame into a foreground region and a background region based on binary images representing differences between the plurality of frames included in the video sequence; determine either one of patch-search-based completion and paste synthesis as a complementation method for the complementation target region based on a number of pixels belonging to the foreground region and located within a given distance from a periphery of the complementation target region; and complement the complementation target region in accordance with the complementation method; and a virtual reality head mounted display which presents the complemented video sequence to the user.
-
公开(公告)号：US20220232249A1
公开(公告)日：2022-07-21
申请号：US17613464
申请日：2019-05-28
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Mariko ISOGAWA , Dan MIKAMI , Kosuke TAKAHASHI , Yoshinori KUSACHI
IPC: H04N19/577 , G06V20/40
Abstract: A technique for interpolating positional information of a target in an image of a frame in which positional information of the target has not been acquired. An information interpolation device includes: a target information acquisition unit 4 acquiring target information that is information related to a target in an image of each frame composing an input video; an indicator determination unit 5 determining, based on the target information, an indicator indicating validity as a starting frame for each frame, the starting frame starting predetermined image processing on a target; a starting frame determination unit 6 determining a starting frame based on the determined indicator; and a target information interpolation unit 7 interpolating, when a frame in which positional information of a target is not included in target information exists among frames within a predetermined number from the determined starting frame, positional information of the target of the frame that does not include the positional information of the target by using positional information of the target included in target information of a frame other than the frame that does not include the positional information of the target.
-
Patent Agency Ranking
公开(公告)号：US20220172478A1
公开(公告)日：2022-06-02
申请号：US17442077
申请日：2020-03-11
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Siqi SUN , Kosuke TAKAHASHI , Dan MIKAMI , Mariko ISOGAWA , Yoshinori KUSACHI
Abstract: A video image synchronization device capable of stably synchronizing multiple viewpoint video images is provided. The video image synchronization device includes: a norm calculation unit that, from chronological data of a coordinate of each of joints of a human body in each of video images taken from a plurality of viewpoints, calculates a norm that is a movement amount per unit time of the joint in the video image; a motion rhythm detection unit that based on the norms, detects a motion rhythm including a movement start timing and a movement stop timing, for each of the joints in each of the video images; and a time shift detection unit that based on the motion rhythms of the respective joints in the respective video images, calculates a matching score indicating a degree of stability of a time shift between the video images and detects a time shift whose matching score is high.
-
公开(公告)号：US20220130138A1
公开(公告)日：2022-04-28
申请号：US17429547
申请日：2020-02-03
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Mariko ISOGAWA , Dan MIKAMI , Kosuke TAKAHASHI , Yoshinori KUSACHI
IPC: G06V10/774 , G06V10/24 , G06T5/00
Abstract: A technique of generating training data which enables improvement of estimation accuracy compared to the related art is provided. A training data generation device includes an image acquisition unit 11 configured to acquire an image of an object on which three or more markers are pasted, a marker measurement unit 12 configured to measure a position of each marker in the image and generate position and attitude information which is information regarding a position and an attitude of the object on the basis of the position of each marker, a recovery region determination unit 13 configured to determine a recovery region for inpainting in the image on the basis of the position of each marker, an image inpainting unit 14 configured to remove each marker from the image on the basis of the recovery region, and a training data generation unit 15 configured to generate training data on the basis of the image in which each marker is removed and the position and attitude information.
-
公开(公告)号：US20220152453A1
公开(公告)日：2022-05-19
申请号：US17438867
申请日：2020-03-04
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Dan MIKAMI , Mariko ISOGAWA , Kosuke TAKAHASHI , Yoshinori KUSACHI
Abstract: A technique that enables, even if a video image corresponding to one period is not obtained, estimating a rotational state of an object is provided. The rotational state estimation device includes: an object image generation unit 1 that generates object images, each of the object images being an image of an object, from an input video image; and a rotational state estimation unit 3 that estimates a rotational state of the object by selecting, from among a plurality of hypotheses of the rotational state, a hypothesis of the rotational state, a likelihood of an image of the object resulting from the object in the object image at a certain time being rotated for tc unit time based on the hypothesis of the rotational state being high, using the object image at a time t and the object image at a time t+tc where tc is a predetermined integer of no less than 1.
-
公开(公告)号：US20210225007A1
公开(公告)日：2021-07-22
申请号：US17059121
申请日：2019-04-23
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Mariko ISOGAWA , Dan MIKAMI , Kosuke TAKAHASHI , Hideaki KIMATA , Ayumi MATSUMOTO
Abstract: A motion classification model learning apparatus that learns a model for early recognizing a motion is provided. A training data acquisition part acquiring training data configured with pairs of video information about a motion that can be classified into any of a plurality of categories according to characteristics of the motion and category information that is a correct label corresponding to the video information; a motion history image generation part generation a motion history image of the video information; and a model learning part learning a model that outputs a label that is the category information, with the motion history image as an input are included.
-
公开(公告)号：US20190022492A1
公开(公告)日：2019-01-24
申请号：US16070382
申请日：2017-01-26
Applicant: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Inventor： Kosuke TAKAHASHI , Dan MIKAMI , Mariko ISOGAWA , Akira KOJIMA , Hideaki KIMATA , Ayumi MATSUMOTO
Abstract: Preliminary experience of a match at a player's perspective is enabled. A virtual environment material storage 13 has stored therein virtual environment materials for reproducing a dynamic object and a static object on a virtual environment. A dynamic object sensing unit 11 chronologically measures a position and a posture of the dynamic object in a real environment and generates position and posture information composed of one movement action. A presentation sequence acquisition unit 17 obtains a presentation sequence including position and posture information of a plurality of different kinds of dynamic objects. A virtual environment construction unit 14 synthesizes a virtual environment material of the dynamic object and a virtual environment material of the static object based on the presentation sequence to construct the virtual environment.
-
-
-
-
-
-
-
-
-
Search Results
10
records
(took 0.018 seconds)
