公开(公告)号：US20190341025A1

公开(公告)日：2019-11-07

申请号：US16383896

申请日：2019-04-15

Applicant: Sony Interactive Entertainment Inc.

Inventor： Masanori Omote ,  Ruxin Chen ,  Xavier Menendez-Pidal ,  Jaekwon Yoo ,  Koji Tashiro ,  Sudha Krishnamurthy ,  Komath Naveen Kumar

IPC: G10L15/16 ,  G10L15/26

Abstract: A system and method for multimodal classification of user characteristics is described. The method comprises receiving audio and other inputs, extracting fundamental frequency information from the audio input, extracting other feature information from the video input, classifying the fundamental frequency information, textual information and video feature information using the multimodal neural network.

公开(公告)号：US10076705B2

公开(公告)日：2018-09-18

申请号：US14149241

申请日：2014-01-07

Applicant: Sony Interactive Entertainment Inc.

Inventor： Hrishikesh R. Deshpande ,  Ruxin Chen

IPC: H04H60/33 ,  G10L15/00 ,  G10L25/00 ,  G06F17/00 ,  A63F13/49 ,  A63F13/213 ,  A63F13/424 ,  A63F13/00 ,  G06K9/00 ,  H04N5/44 ,  H04N21/433 ,  H04N21/442 ,  H04N21/4223 ,  H04N21/4363 ,  H04N21/439 ,  H04N21/4415 ,  H04N21/422 ,  G06F3/16 ,  G06F3/01

CPC classification number: A63F13/49 ,  A63F13/00 ,  A63F13/10 ,  A63F13/213 ,  A63F13/424 ,  A63F2300/1081 ,  A63F2300/1087 ,  A63F2300/636 ,  G06F3/01 ,  G06F3/012 ,  G06F3/013 ,  G06F3/017 ,  G06F3/167 ,  G06K9/00261 ,  H04N5/4401 ,  H04N21/42203 ,  H04N21/42204 ,  H04N21/4223 ,  H04N21/4333 ,  H04N21/43632 ,  H04N21/4394 ,  H04N21/4415 ,  H04N21/44218

Abstract: A system and method for conditioning execution of a control function on a determination of whether or not a person's attention is directed toward a predetermined device. The method involves acquiring data concerning the activity of a person who is in the proximity of the device, the data being in the form of one or more temporal samples. One or more of the temporal samples is then analyzed to determine if the person's activity during the time of the analyzed samples indicates that the person's attention is not directed toward the device. The results of the determination are used to ascertain whether or not the control function should be performed.

公开(公告)号：US20180093768A1

公开(公告)日：2018-04-05

申请号：US15394473

申请日：2016-12-29

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Dennis Castleman ,  Ruxin Chen ,  Frank Zhao ,  Glenn Black

IPC: B64C39/02 ,  B64D47/08

CPC classification number: B64C39/024 ,  B64C2201/027 ,  B64C2201/042 ,  B64C2201/06 ,  B64C2201/108 ,  B64C2201/18

Abstract: The present disclosure is related to unmanned aerial vehicles or drones that have a capability of quickly swapping batteries. This may be accomplished even as the drone continues to fly. A drone consistent with the present disclosure may drop one battery and pickup another using an attachment mechanism. Attachment mechanisms of the present disclosure may include electro-magnets, mechanical actuators, pins, or hooks. Systems consistent with the present disclosure may also include locations where replacement batteries may be provided to aircraft via actuation devices coupled to a physical location.

公开(公告)号：US20180004478A1

公开(公告)日：2018-01-04

申请号：US15631212

申请日：2017-06-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ruxin Chen

IPC: G06F3/14 ,  G06K9/00 ,  G06F3/01

CPC classification number: G06F3/1454 ,  A61B1/00 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/26 ,  A63F13/5255 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F3/012 ,  G06F3/013 ,  G06K9/00302

Abstract: Method for providing image of HMD user to a non-HMD user includes, receiving a first image of a user including the user's facial features captured by an external camera when the user is not wearing a head mounted display (HMD). A second image capturing a portion of the facial features of the user when the user is wearing the HMD is received. An image overlay data is generated by mapping contours of facial features captured in the second image with contours of corresponding facial features captured in the first image. The image overlay data is forwarded to the HMD for rendering on a second display screen that is mounted on a front face of the HMD.

公开(公告)号：US09575594B2

公开(公告)日：2017-02-21

申请号：US15188887

申请日：2016-06-21

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ruxin Chen

IPC: G06F3/0488 ,  G06F3/041 ,  G06F3/0354 ,  G06F3/0484 ,  G06F3/14 ,  G06F3/0481

CPC classification number: G06F3/0416 ,  G06F1/1626 ,  G06F3/03547 ,  G06F3/0412 ,  G06F3/04815 ,  G06F3/04845 ,  G06F3/0488 ,  G06F3/04883 ,  G06F3/04886 ,  G06F3/1423 ,  G06F2203/04802 ,  G06F2203/04808 ,  G06T19/006

Abstract: A virtual object can be controlled using one or more touch interfaces. A location for a first touch input can be determined on a first touch interface. A location for a second touch input can be determined on a second touch interface. A three-dimensional segment can be generated using the location of the first touch input, the location of the second touch input, and a pre-determined spatial relationship between the first touch interface and the second touch interface. The virtual object can be manipulated using the three-dimensional segment as a control input.

Abstract translation: 可以使用一个或多个触摸界面来控制虚拟对象。 用于第一触摸输入的位置可以在第一触摸界面上确定。 用于第二触摸输入的位置可以在第二触摸界面上确定。 可以使用第一触摸输入的位置，第二触摸输入的位置以及第一触摸界面和第二触摸界面之间的预定空间关系来生成三维区段。 可以使用三维段作为控制输入来操纵虚拟对象。

公开(公告)号：US20240338552A1

公开(公告)日：2024-10-10

申请号：US18296926

申请日：2023-04-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ruxin Chen ,  Min-Hung Chen ,  Jaekwon Yoo ,  Xiaoyu Liu

IPC: G06N3/045 ,  G06N3/084

CPC classification number: G06N3/045 ,  G06N3/084

Abstract: A domain adaptation module is used to optimize a first domain derived from a second domain using respective outputs from respective parallel hidden layers of the domains.

公开(公告)号：US11947593B2

公开(公告)日：2024-04-02

申请号：US16147331

申请日：2018-09-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Arindam Jati ,  Naveen Kumar ,  Ruxin Chen

IPC: G06F16/65 ,  G06F16/632 ,  G06N3/08

CPC classification number: G06F16/65 ,  G06F16/634 ,  G06N3/08

Abstract: A system, method, and computer program product for hierarchical categorization of sound comprising one or more neural networks implemented on one or more processors. The one or more neural networks are configured to categorize a sound into a two or more tiered hierarchical coarse categorization and a finest level categorization in the hierarchy. The categorization sound may be used to search a database for similar or contextually related sounds.

公开(公告)号：US20220327828A1

公开(公告)日：2022-10-13

申请号：US17852602

申请日：2022-06-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ruxin Chen ,  Naveen Kumar ,  Haoqi Li

IPC: G06V20/40 ,  G06N20/00 ,  G06K9/62 ,  G06N3/08 ,  G06N3/00 ,  G06V40/16

Abstract: In sequence level prediction of a sequence of frames of high dimensional data one or more affective labels are provided at the end of the sequence. Each label pertains to the entire sequence of frames. An action is taken with an agent controlled by a machine learning algorithm for a current frame of the sequence at a current time step. An output of the action represents affective label prediction for the frame at the current time step. A pool of actions taken up until the current time step including the action taken with the agent is transformed into a predicted affective history for a subsequent time step. A reward is generated on predicted actions up to the current time step by comparing the predicted actions against corresponding annotated affective labels.

公开(公告)号：US20220203248A1

公开(公告)日：2022-06-30

申请号：US17573587

申请日：2022-01-11

Applicant: Sony Interactive Entertainment Inc.

Inventor： Javier Fernandez Rico ,  Erik Beran ,  Michael Taylor ,  Ruxin Chen

IPC: A63F13/90 ,  B25J5/00 ,  H04N9/31 ,  B25J11/00 ,  B25J15/10 ,  B25J9/04 ,  B25J15/04 ,  A63F13/213 ,  B25J13/08 ,  G06F3/01 ,  G06F3/042 ,  G06F3/04817 ,  G06F3/16

Abstract: Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

公开(公告)号：US11281709B2

公开(公告)日：2022-03-22

申请号：US16941299

申请日：2020-07-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jian Zheng ,  Ruxin Chen

IPC: G06F16/383 ,  G06F16/583 ,  G06K9/32 ,  G06N5/04

Abstract: For image captioning such as for computer game images or other images, bottom-up attention is combined with top-down attention to provide a multi-level residual attention-based image captioning model. A residual attention mechanism is first applied in the Faster R-CNN network to learn better feature representations for each region by taking spatial information into consideration. In the image captioning network, taking the extracted regional features as input, a second residual attention network is implemented to fuse the regional features attentionally for subsequent caption generation.