-
公开(公告)号:US11263796B1
公开(公告)日:2022-03-01
申请号:US17095518
申请日:2020-11-11
Applicant: Sony Interactive Entertainment Inc.
Inventor: Sergey Bashkirov , Michael Taylor
Abstract: Computer animation involving monocular pose prediction is disclosed. A plurality of candidate pose sequences of a three-dimensional model of an animation character is generated such that each candidate pose of each sequence has a segmentation map that matches a segmentation map of a corresponding character derived from a corresponding frame of a video. A distance between candidate poses at each time step is maximized. An optimum pose sequence is determined and used to generate a corresponding sequence of frames of animation.
-
公开(公告)号:US20200254331A1
公开(公告)日:2020-08-13
申请号:US16865303
申请日:2020-05-02
Applicant: Sony Interactive Entertainment Inc.
Inventor: Sergey Bashkirov , Takeo Matsukawa , Jeffrey R. Stafford
IPC: A63F13/21 , A63F13/5255 , G06F3/0346 , G06F3/01 , A63F13/428
Abstract: To derive three dimensional (3D) position and orientation of a 3-axis (or more) magnetometer/accelerometer device (such as may be implemented in VR or AR headset or computer game controller) without line of sight constraints, a spinning magnetic field is used to discriminate and remove the external (Earth's) magnetic field from the spinning magnetic field. This reduces the problem to finding the distance to the source of the magnetic field using a calibration table (or formula), finding two angles describing the deviation of the magnetic sensor from the axis of rotation of the spinning magnetic field and the phase around this axis, and from these values deriving the orientation of the sensor.
-
公开(公告)号:US20190122436A1
公开(公告)日:2019-04-25
申请号:US15791029
申请日:2017-10-23
Applicant: Sony Interactive Entertainment Inc.
Inventor: Sergey Bashkirov , Takeo Matsukawa
Abstract: Plural individual sensor assemblies are engaged with respective parts of a person's body. Each assembly may include accelerometers, magnetometers, and gyroscopes. Sensor data is fused together to get the orientation at each body location. To simplify, the body is assumed to consist of rigid bars of known length connected with ball joints so that once the relative orientations of all bars are given by the respective assemblies, body pose can be computed. Then the body pose is translated as a virtual body into a virtual world either by a ray cast method that anchors a foot of the virtual body to the ground assuming infinite gravity and infinite friction and then translating the other body parts to make the ground contact point fixed, or by implementing an approximate dynamics physics engine on the virtual body. The technique may be used in VR location-based entertainment and for motion capture.
-
14.
公开(公告)号:US20250001307A1
公开(公告)日:2025-01-02
申请号:US18341858
申请日:2023-06-27
Applicant: Sony Interactive Entertainment Inc.
Inventor: Sergey Bashkirov , Celeste Bean , Sudha Krishnamurthy , Masanori Omote , Sagar Sudhakara
Abstract: System, process and device configurations are provided for detecting user socialization preferences and controlling multiplayer selection. A method can include receiving user voice output during gameplay for a first user, and determining a socialization preference for the first user based on the user voice output. The method may also include updating a user profile for the first user based on the socialization preference, selecting at least one second user, and controlling a gameplay session for the first user and the at least one second user, wherein audio output for the first user is controlled using a the user profile. Socialization preferences detected during gameplay may be used to select other users for multiplayer game sessions. The socialization preferences may also be used to control audio output by way of selection/terminating players from a session, filtering audio output to a user, filtering intensity and/or modifying audio output to a user.
-
公开(公告)号:US11869237B2
公开(公告)日:2024-01-09
申请号:US15721637
申请日:2017-09-29
Applicant: Sony Interactive Entertainment Inc.
Inventor: Sergey Bashkirov , Michael Taylor , Javier Fernandez-Rico
IPC: G06N5/022 , G06V20/20 , G06F18/243 , G06V10/764 , G06N3/004 , G06N3/08
CPC classification number: G06V20/20 , G06F18/24323 , G06N3/004 , G06N3/08 , G06N5/022 , G06V10/764
Abstract: An autonomous personal companion utilizing a method of object identification that relies on a hierarchy of object classifiers for categorizing one or more objects in a scene. The classifier hierarchy is composed of a set of root classifiers trained to recognize objects based on separate generic classes. Each root acts as the parent of a tree of child nodes, where each child node contains a more specific variant of its parent object classifier. The method covers walking the tree in order to classify an object based on more and more specific object features. The system is further comprised of an algorithm designed to minimize the number of object comparisons while allowing the system to concurrently categorize multiple objects in a scene.
-
公开(公告)号:US20240001239A1
公开(公告)日:2024-01-04
申请号:US17810556
申请日:2022-07-01
Applicant: Sony Interactive Entertainment Inc.
Inventor: Michael Taylor , Glenn Black , Celeste Bean , Sergey Bashkirov
Abstract: Machine learning is used to transform screen renders from the viewpoint of the player's character to be from the viewpoint of other non-player characters (NPC) in the room. One or more neural networks are trained using game images captured during a human play session, and then subsequently the neural networks are used to create realistic video from the NPC viewpoints. To avoid rendering multiple viewpoints simultaneously, a single viewpoint is rendered, and neural networks are used to transform it for the viewpoints of other NPCs in the area. A group of NPCs may be treated as a batch and a single viewpoint transformed to multiple viewpoints in a single inference pass. For cloud gaming the game video can be rendered/sent immediately for the player but the actions of the NPCs are delayed for a frame while the neural network generates the behavior.
-
公开(公告)号:US20230398438A1
公开(公告)日:2023-12-14
申请号:US17837235
申请日:2022-06-10
Applicant: Sony Interactive Entertainment Inc.
Inventor: Glenn Black , Celeste Bean , Sergey Bashkirov , Michael Taylor
CPC classification number: A63F13/24 , A63F13/21 , A63F2300/1087 , A63F2300/1006 , A63F2300/105 , A63F2300/1068
Abstract: A controller apparatus includes two or more balls having a size sufficient for a human to manipulate with a single foot. Three or more bearings support at least one of the balls from below and permit rotation with respect to at least two axes. One or more position encoders are disposed proximate a surface of each of the two or more balls. The encoders are configured to determine a rotational displacement of each of the two or more balls with respect to two or more axes.
-
公开(公告)号:US20220383576A1
公开(公告)日:2022-12-01
申请号:US17680912
申请日:2022-02-25
Applicant: Sony Interactive Entertainment Inc.
Inventor: Sergey Bashkirov , Michael Taylor
Abstract: Computer animation involving monocular pose prediction is disclosed. A plurality of candidate pose sequences of a three-dimensional model of an animation character is generated such that each candidate pose of each sequence has a segmentation map that matches a segmentation map of a corresponding character derived from a corresponding frame of a video. A distance between candidate poses at each time step is maximized. An optimum pose sequence is determined and used to generate a corresponding sequence of frames of animation.
-
公开(公告)号:US20220148247A1
公开(公告)日:2022-05-12
申请号:US17095481
申请日:2020-11-11
Applicant: Sony Interactive Entertainment Inc.
Inventor: Sergey Bashkirov , Michael Taylor
Abstract: Computer animation involving pose disambiguation is disclosed. Two or more source segmentation masks are generated from corresponding contemporaneous video images of a character from different points of view. A three-dimensional model of an animation character corresponding to the character in the two or more contemporaneous video images is generated. Two or more different target segmentation masks corresponding to different views of the animation character corresponding to the character in the two or more video images. Each target segmentation mask is compared to a corresponding source segmentation mask from the comparison it is determined whether a pose of the three-dimensional model corresponds to a pose of the character in the video images. The model is used to generate a frame of animation of the animated character when the pose of model corresponds to the pose of the character in the video images.
-
公开(公告)号:US20210216136A1
公开(公告)日:2021-07-15
申请号:US16741051
申请日:2020-01-13
Applicant: Sony Interactive Entertainment Inc.
Inventor: Sergey Bashkirov
Abstract: An event driven sensor (EDS) is used for simultaneous localization and mapping (SLAM) and in particular is used in conjunction with a constellation of light emitting diodes (LED) to simultaneously localize all LEDs and track EDS pose in space. The EDS may be stationary or moveable and can track moveable LED constellations as rigid bodies. Each individual LED is distinguished at a high rate using minimal computational resources (no image processing). Thus, instead of a camera and image processing, rapidly pulsing LEDs detected by the EDS are used for feature points such that EDS events are related to only one LED at a time.
-
-
-
-
-
-
-
-
-