Abstract:
A system, method, and processor-readable storage medium for providing sound effects are disclosed. An example method comprises receiving an audio signal associated with a speech of a user, performing speech recognition on the audio signal to identify one or more recognized words, identifying at least one trigger word among the one or more recognized words, and providing to the user at least one sound effect associated with the at least one trigger word. The speech recognition can be implemented by a trained machine-learning system. The sound effects can be provided to the user and optionally to other users, for example, via a network gaming environment. The sound effects can also be adjusted or selected based on a conversational context, user identification, and/or audio characteristics of the received audio signal. The system for providing sound effects can include a smart speaker, mobile device, game console, television device, and the like.
Abstract:
Methods and systems for adjusting a weight of a peripheral device while presenting content to a head mounted display are disclosed. One method includes processing instructions for rendering a virtual reality scene in the head mounted display. The virtual reality scene includes a virtual object. The method also includes receiving pairing of the peripheral device for use with the head mounted display for rendering the virtual reality scene and determining a movement of the virtual object. The method causes sending of instructions to the peripheral device for execution by a controller of the peripheral device to move a weight in the peripheral device. The weight is moved to provide a correlation to the determined movement of the virtual object.
Abstract:
An unmanned aerial vehicle (UAV) may capture a camera feed via a camera of the UAV. Translation instructions stored by a translation server that stores and transmits translation instructions. The translation instructions identify a pre-translation object and a corresponding post-translation object. An instance of the pre-translation object is recognized in the camera feed, and the camera feed is modified to replace the instance of the pre-translation object with an instance of the corresponding post-translation object. The modified camera feed is then transmitted to a display through which the modified camera feed is displayed.
Abstract:
The present disclosure is related to unmanned aerial vehicles or drones that have a capability of quickly swapping batteries. This may be accomplished even as the drone continues to fly. A drone consistent with the present disclosure may drop one battery and pickup another using an attachment mechanism. Attachment mechanisms of the present disclosure may include electro-magnets, mechanical actuators, pins, or hooks. Systems consistent with the present disclosure may also include locations where replacement batteries may be provided to aircraft via actuation devices coupled to a physical location.
Abstract:
Systems and method for processing video frames generated for display on a head mounted display (HMD) to a second screen are provided. In one example, a client system having a processor for generating video frames in response to interactive game play of a video game using the HMD is provided. The generated video frames include in-band regions that include the video game content (VGC) to be displayed on the HMD. A processing device having an input interface for receiving the generated video frames. The processing device including extract logic for extracting a portion of the generated video frames, and a codec unit configured to process the portion of the generated video frames. Further included is a graphics processor unit (GPU) for processing the portion of the generated video frames and formatting for display on the second screen. The portion of the generated video frames processed by the GPU being provided to a first output interface of the processing device. The generated video frames received via the input interface being provided as a pass-through to a second output interface of the processing device. The first output interface of the processing device is connectable to the second screen and the second output interface of the processing device is connectable to the HMD.
Abstract:
A system and method of simulating weight of a virtual object in a virtual environment includes receiving a weight adjusting profile in a handheld peripheral device. The weight adjusting profile corresponding to at least one weight characteristic and/or a movement characteristics of the virtual object presented in the virtual environment where the handheld peripheral device represents the virtual object. The handheld peripheral device includes a movable weight. The weight adjusting profile is stored in the handheld peripheral device and a position of the movable weight in the handheld peripheral device is adjusted to correspond to a movement of the virtual object in the virtual environment.
Abstract:
Systems and method for processing video frames generated for display on a head mounted display (HMD) to a second screen are provided. One example method includes receiving the video frames formatted for display on the HMD, and while passing the video frames to the HMD, selecting a portion of content from the video frames and processing the portion of the content for output to a second screen. The video frames viewed in the HMD are a result of interactive play executed for viewing on the HMD. The second screen configured to render an undistorted view of the interactive play on the HMD. In one example, the method and system enable additional content to be rendered on the second screen (e.g., second screen content, such as social interactive play with others, other non-game content, player-player communication, etc.).
Abstract:
A glove interface object is provided, comprising: a plurality of fluid channels disposed on a palmar side of the glove interface object, the fluid channels containing a magnetic fluid; a plurality of electromagnets positioned on the palmar side of the glove interface object, each of the plurality of electromagnets being configured when activated to generate a magnetic field that acts on at least a portion of the magnetic fluid; a controller configured to control activation and deactivation of the electromagnets based on received haptic feedback data.
Abstract:
A method including capturing a deformed gesture performed by a communicator, wherein the deformed gesture corresponds to a defined gesture that is intended by the communicator. The method including providing the deformed gesture that is captured to an artificial intelligence (AI) model configured to classify a predicted gesture corresponding to deformed gesture. The method including performing an action based on the predicted gesture. The method including capturing at least one multimodal cue to verify the predicted gesture. The method including determining that the predicted gesture is incorrect based on the at least one multimodal cue. The method including providing feedback to the AI model indicating that the predicted gesture is incorrect for training and updating the AI model. The method including classifying an updated predicted gesture corresponding to the deformed gesture using the AI model that is updated.
Abstract:
A method is provided, including: recording gameplay data from one or more sessions of a video game, the one or more sessions defined for interactive gameplay of a user; training a machine learning model using the gameplay data, wherein the training configures the machine learning model to imitate the interactive gameplay of the user; after the training, exposing the machine learning model to one or more scenarios of the video game, such that the machine learning model generates gameplay decisions in response to the one or more scenarios; evaluating the gameplay decisions of the machine learning model in response to the one or more scenarios to determine one or more descriptive features of the user's gameplay; using the determined descriptive features of the user's gameplay to provide a recommendation to the user.