-
公开(公告)号：US20240127006A1
公开(公告)日：2024-04-18
申请号：US17967209
申请日：2022-10-17
Applicant: Snap Inc.
Inventor： Kai Zhou , Jennica Pounds , Zsolt Robotka , Márton Gergely Kajtár
CPC classification number: G06F40/58 , G06F3/014 , G06F3/017 , G06F3/0346 , G06V10/26 , G06V20/20 , G06V40/113 , G06V40/28
Abstract: A method for recognizing sign language using collaborative augmented reality devices is described. In one aspect, a method includes accessing a first image generated by a first augmented reality device and a second image generated by a second augmented reality device, the first image and the second image depicting a hand gesture of a user of the first augmented reality device, synchronizing the first augmented reality device with the second augmented reality device, in response to the synchronizing, distributing one or more processes of a sign language recognition system between the first and second augmented reality devices, collecting results from the one or more processes from the first and second augmented reality devices, and displaying, in near real-time in a first display of the first augmented reality device, text indicating a sign language translation of the hand gesture based on the results.
-
公开(公告)号：US20250069261A1
公开(公告)日：2025-02-27
申请号：US18943047
申请日：2024-11-11
Applicant: Snap Inc.
Inventor： Kai Zhou
Abstract: A method for transferring a gait pattern of a first user to a second user to simulate augmented reality content in a virtual simulation environment is described. In one aspect, the method includes identifying a gait pattern of a first user operating a first visual tracking system in a first physical environment, identifying a trajectory from a second visual tracking system operated by a second user in a second physical environment, the trajectory based on poses of the second visual tracking system over time, modifying the trajectory from the second visual tracking system based on the gait pattern of the first user, applying the modified trajectory in a plurality of virtual environments, and generating simulated ground truth data based on the modified trajectory in the plurality of virtual environments.
-
公开(公告)号：US20240289988A1
公开(公告)日：2024-08-29
申请号：US18656268
申请日：2024-05-06
Applicant: Snap Inc.
Inventor： Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
CPC classification number: G06T7/80 , G06V10/443 , H04N17/002 , H04N23/61 , H04N23/651 , H04N23/6812
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
公开(公告)号：US20240249483A1
公开(公告)日：2024-07-25
申请号：US18623987
申请日：2024-04-01
Applicant: Snap Inc.
Inventor： Kai Zhou , Adrian Schoisengeier
CPC classification number: G06T19/006 , B25J13/08 , G06F3/012 , G06F3/017 , G06T17/00 , G06T19/20 , G06V20/64 , G06T2200/08 , G06T2210/56 , G06T2219/2016
Abstract: A method for programming a robotic system by demonstration is described. In one aspect, the method includes displaying a first virtual object in a display of an augmented reality (AR) device, the first virtual object corresponding to a first physical object in a physical environment of the AR device, tracking, using the AR device, a manipulation of the first virtual object by a user of the AR device, identifying an initial state and a final state of the first virtual object based on the tracking, the initial state corresponding to an initial pose of the first virtual object, the final state corresponding to a final pose of the first virtual object, and programming by demonstration a robotic system using the tracking of the manipulation of the first virtual object, the first initial state of the first virtual object, and the final state of the first virtual object.
-
公开(公告)号：US12028626B2
公开(公告)日：2024-07-02
申请号：US18098939
申请日：2023-01-19
Applicant: Snap Inc.
Inventor： Matthias Kalkgruber , Erick Mendez Mendez , Daniel Wagner , Daniel Wolf , Kai Zhou
IPC: H04N25/531 , G02B27/01 , H04N23/51
CPC classification number: H04N25/531 , G02B27/0172 , H04N23/51 , G02B2027/0138 , G02B2027/014 , G02B2027/0178
Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The eyewear device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the eyewear device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.
-
Patent Agency Ranking
公开(公告)号：US11989843B2
公开(公告)日：2024-05-21
申请号：US17846930
申请日：2022-06-22
Applicant: Snap Inc.
Inventor： Kai Zhou , Adrian Schoisengeier
CPC classification number: G06T19/006 , B25J13/08 , G06F3/012 , G06F3/017 , G06T17/00 , G06T19/20 , G06V20/64 , G06T2200/08 , G06T2210/56 , G06T2219/2016
Abstract: A method for programming a robotic system by demonstration is described. In one aspect, the method includes displaying a first virtual object in a display of an augmented reality (AR) device, the first virtual object corresponding to a first physical object in a physical environment of the AR device, tracking, using the AR device, a manipulation of the first virtual object by a user of the AR device, identifying an initial state and a final state of the first virtual object based on the tracking, the initial state corresponding to an initial pose of the first virtual object, the final state corresponding to a final pose of the first virtual object, and programming by demonstration a robotic system using the tracking of the manipulation of the first virtual object, the first initial state of the first virtual object, and the final state of the first virtual object.
-
公开(公告)号：US11887246B2
公开(公告)日：2024-01-30
申请号：US17877451
申请日：2022-07-29
Applicant: Snap Inc.
Inventor： Kai Zhou , Qi Qi , Jeroen Hol
CPC classification number: G06T15/20 , G06T7/20 , G06T7/50 , G06T7/70 , G06T2207/30241 , G06T2207/30244
Abstract: Systems and methods of generating ground truth datasets for producing virtual reality (VR) experiences, for testing simulated sensor configurations, and for training machine-learning algorithms. In one example, a recording device with one or more cameras and one or more inertial measurement units captures images and motion data along a real path through a physical environment. A SLAM application uses the captured data to calculate the trajectory of the recording device. A polynomial interpolation module uses Chebyshev polynomials to generate a continuous time trajectory (CTT) function. The method includes identifying a virtual environment and assembling a simulated sensor configuration, such as a VR headset. Using the CTT function, the method includes generating a ground truth output dataset that represents the simulated sensor configuration in motion along a virtual path through the virtual environment. The virtual path is closely correlated with the motion along the real path as captured by the recording device. Accordingly, the output dataset produces a realistic and life-like VR experience. In addition, the methods described can be used to generate multiple output datasets, at various sample rates, which are useful for training the machine-learning algorithms which are part of many VR systems.
-
公开(公告)号：US20230274460A1
公开(公告)日：2023-08-31
申请号：US18142879
申请日：2023-05-03
Applicant: Snap Inc.
Inventor： Kai Zhou
CPC classification number: G06T7/74 , G06T11/60 , G06V20/20 , G06V40/25 , G06T2207/30241 , G06T2207/30244
Abstract: A method for transferring a gait pattern of a first user to a second user to simulate augmented reality content in a virtual simulation environment is described. In one aspect, the method includes identifying a gait pattern of a first user operating a first visual tracking system in a first physical environment, identifying a trajectory from a second visual tracking system operated by a second user in a second physical environment, the trajectory based on poses of the second visual tracking system over time, modifying the trajectory from the second visual tracking system based on the gait pattern of the first user, applying the modified trajectory in a plurality of virtual environments, and generating simulated ground truth data based on the modified trajectory in the plurality of virtual environments.
-
公开(公告)号：US20230196647A1
公开(公告)日：2023-06-22
申请号：US17555762
申请日：2021-12-20
Applicant: Snap Inc.
Inventor： Kai Zhou , Kenneth Au
CPC classification number: G06T13/40 , G06T19/006 , G06K9/6217 , G06V20/30 , H04L67/22 , G06F16/90335
Abstract: A system and a method for generating an automated GIF file generation system is described. In one aspect, the method includes accessing an animated GIF file, identifying a plurality of elements displayed in the animated GIF file, applying a variation of one or more elements to the animated GIF file, and generating a variant animated GIF file by applying the variation of the one or more elements to the animated GIF file. The system measures a trending metric of the variant animated GIF file based on a number of times the variant animated GIF file is shared on the communication platform and uses the trending metric as a feedback to generating the variant animated GIF file.
-
公开(公告)号：US11417052B2
公开(公告)日：2022-08-16
申请号：US17342851
申请日：2021-06-09
Applicant: Snap Inc.
Inventor： Kai Zhou , Qi Qi , Jeroen Hol
Abstract: Systems and methods of generating ground truth datasets for producing virtual reality (VR) experiences, for testing simulated sensor configurations, and for training machine-learning algorithms. In one example, a recording device with one or more cameras and one or more inertial measurement units captures images and motion data along a real path through a physical environment. A SLAM application uses the captured data to calculate the trajectory of the recording device. A polynomial interpolation module uses Chebyshev polynomials to generate a continuous time trajectory (CTT) function. The method includes identifying a virtual environment and assembling a simulated sensor configuration, such as a VR headset. Using the CTT function, the method includes generating a ground truth output dataset that represents the simulated sensor configuration in motion along a virtual path through the virtual environment. The virtual path is closely correlated with the motion along the real path as captured by the recording device. Accordingly, the output dataset produces a realistic and life-like VR experience. In addition, the methods described can be used to generate multiple output datasets, at various sample rates, which are useful for training the machine-learning algorithms which are part of many VR systems.
-
-
-
-
-
-
-
-
-
Search Results
38
records
(took 0.028 seconds)
