-
公开(公告)号:US20200372058A1
公开(公告)日:2020-11-26
申请号:US16941299
申请日:2020-07-28
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jian Zheng , Ruxin Chen
IPC: G06F16/383 , G06F16/583 , G06K9/32 , G06N5/04
Abstract: For image captioning such as for computer game images or other images, bottom-up attention is combined with top-down attention to provide a multi-level residual attention-based image captioning model. A residual attention mechanism is first applied in the Faster R-CNN network to learn better feature representations for each region by taking spatial information into consideration. In the image captioning network, taking the extracted regional features as input, a second residual attention network is implemented to fuse the regional features attentionally for subsequent caption generation.
-
公开(公告)号:US10210905B2
公开(公告)日:2019-02-19
申请号:US15394391
申请日:2016-12-29
Applicant: SONY INTERACTIVE ENTERTAINMENT INC.
Inventor: Dennis Dale Castleman , Ruxin Chen , Frank Zhao , Glenn Black
IPC: G01C23/00 , G11B27/10 , B64C39/02 , G05D1/00 , G06F3/0484
Abstract: A flight path management system manages flight paths for an unmanned aerial vehicle (UAV). The flight path management system receives a sequence of controller inputs for the UAV, and stores the sequence of controller inputs in a memory. The flight path management system accesses the memory and selects a selected section of the sequence of controller inputs corresponding to a time period. The flight management system outputs the selected section to a playback device in real time over a length of the time period.
-
公开(公告)号:US10191541B2
公开(公告)日:2019-01-29
申请号:US15385794
申请日:2016-12-20
Applicant: Sony Interactive Entertainment Inc.
Inventor: Ruxin Chen
IPC: G06F3/01 , G02B27/01 , G06T11/60 , G09G5/36 , G06F3/03 , G06F3/0481 , G06F3/0346
Abstract: Methods, devices, and computer programs for augmenting a virtual reality scene with real world content are provided. One example method includes an operation for obtaining sensor data from an HMD of a user to determine that a criteria is met to overlay one or more real world objects into the virtual reality scene to provide an augmented virtual reality scene. In certain examples, the criteria corresponds to predetermined indicators suggestive of disorientation of a user when wearing the HMD and being presented a virtual reality scene. In certain other examples, the one or more real world objects are selected based on their effectiveness at reorienting a disoriented user.
-
公开(公告)号:US11911704B2
公开(公告)日:2024-02-27
申请号:US17573587
申请日:2022-01-11
Applicant: Sony Interactive Entertainment Inc.
Inventor: Javier Fernandez Rico , Erik Beran , Michael Taylor , Ruxin Chen
IPC: G06F3/04817 , A63F13/90 , B25J5/00 , H04N9/31 , B25J11/00 , B25J15/10 , B25J9/04 , B25J15/04 , A63F13/213 , B25J13/08 , G06F3/01 , G06F3/042 , G06F3/16
CPC classification number: A63F13/90 , A63F13/213 , B25J5/007 , B25J9/046 , B25J11/003 , B25J11/0005 , B25J11/008 , B25J13/08 , B25J15/04 , B25J15/10 , G06F3/017 , G06F3/0425 , G06F3/04817 , G06F3/167 , H04N9/3173 , H04N9/3182 , H04N9/3185 , H04N9/3194
Abstract: Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.
-
公开(公告)号:US20230325663A1
公开(公告)日:2023-10-12
申请号:US18145967
申请日:2022-12-23
Applicant: Sony Interactive Entertainment Inc.
Inventor: Ruxin Chen , Min-Hung Chen , Jaekwon Yoo , Xiaoyu Liu
Abstract: A domain adaptation module is used to optimize a first domain derived from a second domain using respective outputs from respective parallel hidden layers of the domains.
-
公开(公告)号:US20210124930A1
公开(公告)日:2021-04-29
申请号:US17141028
申请日:2021-01-04
Applicant: Sony Interactive Entertainment Inc.
Inventor: Ruxin Chen , Naveen Kumar , Haoqi Li
Abstract: Methods and systems for performing sequence level prediction of a video scene are described. Video information in a video scene is represented as a sequence of features depicted each frame. One or more scene affective labels are provided at the end of the sequence. Each label pertains to the entire sequence of frames of data. An action is taken with an agent controlled by a machine learning algorithm for a current frame of the sequence at a current time step. An output of the action represents affective label prediction for the frame at the current time step. A pool of actions taken up until the current time step including the action taken with the agent is transformed into a predicted affective history for a subsequent time step. A reward is generated on predicted actions up to the current time step by comparing the predicted actions against corresponding annotated scene affective labels.
-
公开(公告)号:US10850838B2
公开(公告)日:2020-12-01
申请号:US15394473
申请日:2016-12-29
Applicant: SONY INTERACTIVE ENTERTAINMENT INC.
Inventor: Dennis Dale Castleman , Ruxin Chen , Frank Zhao , Glenn Black
Abstract: The present disclosure is related to unmanned aerial vehicles or drones that have a capability of quickly swapping batteries. This may be accomplished even as the drone continues to fly. A drone consistent with the present disclosure may drop one battery and pickup another using an attachment mechanism. Attachment mechanisms of the present disclosure may include electro-magnets, mechanical actuators, pins, or hooks. Systems consistent with the present disclosure may also include locations where replacement batteries may be provided to aircraft via actuation devices coupled to a physical location.
-
公开(公告)号:US20190286406A1
公开(公告)日:2019-09-19
申请号:US16392589
申请日:2019-04-23
Applicant: Sony Interactive Entertainment Inc.
Inventor: Ruxin Chen
IPC: G06F3/14 , A63F13/211 , G06K9/00 , G06F3/01 , G02B27/01 , A63F13/212 , A63F13/5255 , A63F13/213 , A63F13/26
Abstract: Method for providing image of HMD user to a non-HMD user includes, receiving a first image of a user including the user's facial features captured by an external camera when the user is not wearing a head mounted display (HMD). A second image capturing a portion of the facial features of the user when the user is wearing the HMD is received. An image overlay data is generated by mapping contours of facial features captured in the second image with contours of corresponding facial features captured in the first image. The image overlay data is forwarded to the HMD for rendering on a second display screen that is mounted on a front face of the HMD.
-
公开(公告)号:US10268438B2
公开(公告)日:2019-04-23
申请号:US15631212
申请日:2017-06-23
Applicant: Sony Interactive Entertainment Inc.
Inventor: Ruxin Chen
IPC: G09G5/00 , G06F3/14 , G06K9/00 , G06F3/01 , G02B27/01 , A63F13/26 , A63F13/211 , A63F13/213 , A63F13/5255 , A63F13/212
Abstract: Method for providing image of HMD user to a non-HMD user includes, receiving a first image of a user including the user's facial features captured by an external camera when the user is not wearing a head mounted display (HMD). A second image capturing a portion of the facial features of the user when the user is wearing the HMD is received. An image overlay data is generated by mapping contours of facial features captured in the second image with contours of corresponding facial features captured in the first image. The image overlay data is forwarded to the HMD for rendering on a second display screen that is mounted on a front face of the HMD.
-
公开(公告)号:US20190099681A1
公开(公告)日:2019-04-04
申请号:US15721673
申请日:2017-09-29
Applicant: Sony Interactive Entertainment Inc.
Inventor: Javier Fernandez Rico , Erik Beran , Michael Taylor , Ruxin Chen
IPC: A63F13/90 , G06F3/042 , A63F13/213 , B25J13/08 , G06F3/01 , G06F3/0481 , G06F3/16
Abstract: Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.
-
-
-
-
-
-
-
-
-