公开(公告)号：US10777006B2

公开(公告)日：2020-09-15

申请号：US15791029

申请日：2017-10-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sergey Bashkirov ,  Takeo Matsukawa

IPC: G06T19/00 ,  G06T13/40 ,  G05B11/32 ,  G06T11/60 ,  G06N20/00 ,  B25J9/16

Abstract: Plural individual sensor assemblies are engaged with respective parts of a person's body. Each assembly may include accelerometers, magnetometers, and gyroscopes. Sensor data is fused together to get the orientation at each body location. To simplify, the body is assumed to consist of rigid bars of known length connected with ball joints so that once the relative orientations of all bars are given by the respective assemblies, body pose can be computed. Then the body pose is translated as a virtual body into a virtual world either by a ray cast method that anchors a foot of the virtual body to the ground assuming infinite gravity and infinite friction and then translating the other body parts to make the ground contact point fixed, or by implementing an approximate dynamics physics engine on the virtual body. The technique may be used in VR location-based entertainment and for motion capture.

公开(公告)号：US12236339B2

公开(公告)日：2025-02-25

申请号：US16693093

申请日：2019-11-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Sergey Bashkirov

IPC: G06N3/08 ,  G05B13/02 ,  G06F30/27 ,  G06N3/02 ,  G06T13/00 ,  G06T13/40 ,  A63F13/57 ,  B25J9/16 ,  G06N3/006

Abstract: A method, system and non-transitory instructions for control input, comprising, taking an integral of an output value from a Motion Decision Neural Network for a movable joint to generate an integrated output value. Generating a subsequent output value using a machine learning algorithm that includes a sensor value and the integrated output value as inputs to the Motion Decision Neural Network and imparting movement with the moveable joint according to an integral of the subsequent output value.

公开(公告)号：US20240160273A1

公开(公告)日：2024-05-16

申请号：US18056148

申请日：2022-11-16

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sergey Bashkirov

IPC: G06F3/01 ,  A63F13/211 ,  G02B27/01

CPC classification number: G06F3/011 ,  A63F13/211 ,  G02B27/017 ,  A63F2300/8082

Abstract: Respective pose and motion sensors are engaged with the left and right feet of a sitting person and signals from the sensors are used to control the motion of a VR object presented on, e.g., a head-mounted display worn by the person. The sensor signals can be mapped to translational, rotational, and elevational motion of the VR object, and/or can be used to select controls to send controller-like signals to the game engine to control the VR object.

公开(公告)号：US11861777B2

公开(公告)日：2024-01-02

申请号：US17680912

申请日：2022-02-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sergey Bashkirov ,  Michael Taylor

IPC: G06T13/40 ,  G06T7/70

CPC classification number: G06T13/40 ,  G06T7/70 ,  G06T2207/10016 ,  G06T2207/20084

Abstract: Computer animation involving monocular pose prediction is disclosed. A plurality of candidate pose sequences of a three-dimensional model of an animation character is generated such that each candidate pose of each sequence has a segmentation map that matches a segmentation map of a corresponding character derived from a corresponding frame of a video. A distance between candidate poses at each time step is maximized. An optimum pose sequence is determined and used to generate a corresponding sequence of frames of animation.

公开(公告)号：US20230400934A1

公开(公告)日：2023-12-14

申请号：US17837226

申请日：2022-06-10

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Celeste Bean ,  Sergey Bashkirov ,  Michael Taylor

IPC: G06F3/033 ,  A63F13/24

CPC classification number: G06F3/0334 ,  A63F13/24

Abstract: A foot operated controller apparatus is disclosed. The apparatus includes a ball large enough for a human to manipulate with two feet, and a support apparatus configured to support the ball from below, restrict translation of the ball and permit rotation of the ball about its center with respect to at least two axes. One or more position encoders are disposed proximate a surface of the ball. The encoder(s) are configured to determine a rotational displacement of the ball with respect to two or more axes.

公开(公告)号：US11568265B2

公开(公告)日：2023-01-31

申请号：US15684830

申请日：2017-08-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Javier Fernandez-Rico ,  Sergey Bashkirov ,  Jaekwon Yoo ,  Ruxin Chen

IPC: G06N3/08 ,  G06N3/00 ,  G06N20/00

Abstract: An autonomous personal companion executing a method including capturing data related to user behavior. Patterns of user behavior are identified in the data and classified using predefined patterns associated with corresponding predefined tags to generate a collected set of one or more tags. The collected set is compared to sets of predefined tags of a plurality of scenarios, each to one or more predefined patterns of user behavior and a corresponding set of predefined tags. A weight is assigned to each of the sets of predefined tags, wherein each weight defines a corresponding match quality between the collected set of tags and a corresponding set of predefined tags. The sets of predefined tags are sorted by weight in descending order. A matched scenario is selected for the collected set of tags that is associated with a matched set of predefined tags having a corresponding weight having the highest match quality.

公开(公告)号：US20220057859A1

公开(公告)日：2022-02-24

申请号：US17519177

申请日：2021-11-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sergey Bashkirov

IPC: G06F3/01 ,  G01S5/16 ,  G06F3/03

Abstract: An event driven sensor (EDS) is used for simultaneous localization and mapping (SLAM) and in particular is used in conjunction with a constellation of light emitting diodes (LED) to simultaneously localize all LEDs and track EDS pose in space. The EDS may be stationary or moveable and can track moveable LED constellations as rigid bodies. Each individual LED is distinguished at a high rate using minimal computational resources (no image processing). Thus, instead of a camera and image processing, rapidly pulsing LEDs detected by the EDS are used for feature points such that EDS events are related to only one LED at a time.

公开(公告)号：US10653943B2

公开(公告)日：2020-05-19

申请号：US16216204

申请日：2018-12-11

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sergey Bashkirov ,  Takeo Matsukawa ,  Jeffrey R. Stafford

IPC: A63F13/211 ,  A63F13/21 ,  A63F13/428 ,  G06F3/01 ,  G06F3/0346 ,  A63F13/5255

Abstract: To derive three dimensional (3D) position and orientation of a 3-axis (or more) magnetometer/accelerometer device (such as may be implemented in VR or AR headset or computer game controller) without line of sight constraints, a spinning magnetic field is used to discriminate and remove the external (Earth's) magnetic field from the spinning magnetic field. This reduces the problem to finding the distance to the source of the magnetic field using a calibration table (or formula), finding two angles describing the deviation of the magnetic sensor from the axis of rotation of the spinning magnetic field and the phase around this axis, and from these values deriving the orientation of the sensor.

公开(公告)号：US20190102667A1

公开(公告)日：2019-04-04

申请号：US15721637

申请日：2017-09-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sergey Bashkirov ,  Michael Taylor ,  Javier Fernandez-Rico

IPC: G06N3/00 ,  G06N5/02 ,  G06N3/08

Abstract: An autonomous personal companion utilizing a method of object identification that relies on a hierarchy of object classifiers for categorizing one or more objects in a scene. The classifier hierarchy is composed of a set of root classifiers trained to recognize objects based on separate generic classes. Each root acts as the parent of a tree of child nodes, where each child node contains a more specific variant of its parent object classifier. The method covers walking the tree in order to classify an object based on more and more specific object features. The system is further comprised of an algorithm designed to minimize the number of object comparisons while allowing the system to concurrently categorize multiple objects in a scene.

公开(公告)号：US20190065960A1

公开(公告)日：2019-02-28

申请号：US15684830

申请日：2017-08-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Javier Fernandez-Rico ,  Sergey Bashkirov ,  Jaekwon Yoo ,  Ruxin Chen

IPC: G06N3/08

Abstract: An autonomous personal companion executing a method including capturing data related to user behavior. Patterns of user behavior are identified in the data and classified using predefined patterns associated with corresponding predefined tags to generate a collected set of one or more tags. The collected set is compared to sets of predefined tags of a plurality of scenarios, each to one or more predefined patterns of user behavior and a corresponding set of predefined tags. A weight is assigned to each of the sets of predefined tags, wherein each weight defines a corresponding match quality between the collected set of tags and a corresponding set of predefined tags. The sets of predefined tags are sorted by weight in descending order. A matched scenario is selected for the collected set of tags that is associated with a matched set of predefined tags having a corresponding weight having the highest match quality.