-
公开(公告)号:US20240338073A1
公开(公告)日:2024-10-10
申请号:US18602034
申请日:2024-03-12
Applicant: Meta Platforms Technologies, LLC
Inventor: Ilya Brailovskiy , Sebastian Sztuk , Oskar Linde , Daniel Maskit , Devraj Gupta , Zheng Liang , Rui Xiao , Gary King
Abstract: In one embodiment, a computing system may determine a gaze of a user of the computing system. The computing system may generate a foveated map based on the gaze to determine a sensor readout for an image sensor of the computing system. The foveated map may include several foveal regions. The computing system may determine the sensor readout including several zones corresponding to the image sensor based on the several foveal regions. Each of the several zones may indicate a readout resolution for an area of the image sensor for the respective zone. The computing system may capture a first image using the image sensor. The computing system may generate a modified first image based on the captured first image and the sensor readout.
-
公开(公告)号:US12101549B2
公开(公告)日:2024-09-24
申请号:US17856760
申请日:2022-07-01
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Linsen Bie , Jun Hu , David Tao , Demetrios Basil Karanikos , Sebastian Sztuk , Zhaonian Zhang , Jiangtao Kuang , Danni Luo , Yilei Li
CPC classification number: H04N23/62 , G02B27/017 , G02B27/0179 , G06F3/012 , G06F3/013 , G06F3/017 , H04N23/64 , H04N23/667 , H04N23/90 , G02B2027/0138 , G02B2027/014 , G06F3/167
Abstract: A method for using cameras in an augmented reality headset is provided. The method includes receiving a signal from a sensor mounted on a headset worn by a user, the signal being indicative of a user intention for capturing an image. The method also includes identifying the user intention for capturing the image, based on a model to classify the signal from the sensor according to the user intention, selecting a first image capturing device in the headset based on a specification of the first image capturing device and the user intention for capturing the image, and capturing the image with the first image capturing device. An augmented reality headset, a memory storing instructions, and a processor to execute the instructions to cause the augmented reality headset as above are also provided.
-
公开(公告)号:US20240062508A1
公开(公告)日:2024-02-22
申请号:US18452445
申请日:2023-08-18
Applicant: Meta Platforms Technologies, LLC
Inventor: Anatoly Litvinov , Andrey Tovchigrechko , Sebastian Sztuk , Ilya Brailovskiy
CPC classification number: G06V10/56 , H04N5/145 , G06T5/002 , G06T5/009 , G06T5/40 , G06V10/60 , G06T2207/10024 , G06T2207/20016
Abstract: In particular embodiments, a computing system may receive a color image captured by a color camera and a monochrome image captured by a monochrome camera. The color camera and the monochrome camera are associated with an artificial reality system. The computing system may compute, for each of the color and monochrome images, histogram statistics and perform, based on the histogram statistics, tone map matching to normalize the monochrome image with respect to the color image. The computing system may perform local motion estimation to calculate motion vectors indicating pixel correspondence between the normalized monochrome image and the color image. The computing system may generate a mono-color merged image for display on the artificial reality system by adding, for each pixel in the normalized monochrome image, color information extracted from corresponding pixel in the color image using the motion vectors.
-
公开(公告)号:US11808945B2
公开(公告)日:2023-11-07
申请号:US17468578
申请日:2021-09-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Sebastian Sztuk , Salvael Ortega Estrada
IPC: G02B27/01 , A61B3/11 , A61B3/113 , A61B5/024 , G02B27/00 , G06F3/16 , G06V40/16 , G06V40/18 , H04R1/10
CPC classification number: G02B27/0172 , A61B3/112 , A61B3/113 , A61B5/02438 , G02B27/0093 , G02B27/0101 , G06F3/165 , G06V40/171 , G06V40/193 , H04R1/1083 , G02B2027/0118 , G02B2027/0138 , G02B2027/0178
Abstract: A method of operating a head mounted device includes capturing eye data with one or more sensors of the head mounted device. The one or more sensors are configured to sense an eyebox region. Operations of the head mounted device are adjusted in response to the eye data.
-
公开(公告)号:US20230196765A1
公开(公告)日:2023-06-22
申请号:US17558185
申请日:2021-12-21
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Andrew Lovitt , Sebastian Sztuk
CPC classification number: G06V20/20 , G06V10/255 , G02B27/017 , G06F3/017 , G06T19/006 , G02B2027/0178
Abstract: A client device of a user (e.g., a headset) provides a software-based user interface, not relying solely on physical buttons built into the client device itself. The client device's user interface system can render the user interface using graphical, virtual user interface elements that take the place of physical buttons, reducing device manufacturing costs, improving user interface reliability, and allowing greater user interface flexibility. Information on user movements can then be obtained using a separate wearable device, and the client device can use such information to determine whether the user's movements indicate interactions with the virtual user interface elements, taking appropriate actions if so. The client device's user interface system can also render the user interface using sounds made to appear to emanate from particular locations. Subsequent user movements can then be analyzed to determine whether they indicate the particular locations corresponding to the sound-based elements.
-
公开(公告)号:US20230119935A1
公开(公告)日:2023-04-20
申请号:US17504396
申请日:2021-10-18
Applicant: Meta Platforms Technologies, LLC
Inventor: Sebastian Sztuk , Salvael Ortega Estrada
IPC: G02B27/01
Abstract: A gaze direction of an eye or eyes of a user of a head mounted device is determined. One or more images is captured with a camera of a head mounted device. Gaze-guided images are generated from the one or more images based on the gaze direction of the user.
-
公开(公告)号:US20230071993A1
公开(公告)日:2023-03-09
申请号:US17468578
申请日:2021-09-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Sebastian Sztuk , Salvael Ortega Estrada
Abstract: A method of operating a head mounted device includes capturing eye data with one or more sensors of the head mounted device. The one or more sensors are configured to sense an eyebox region. Operations of the head mounted device are adjusted in response to the eye data.
-
公开(公告)号:US20230041202A1
公开(公告)日:2023-02-09
申请号:US17863266
申请日:2022-07-12
Applicant: Meta Platforms Technologies, LLC
Inventor: Igor Markovsky , Johana Gabriela Coyoc Escudero , Demetrios Basil Karanikos , Brandon Potens , Rafat Mehdi , Sebastian Sztuk , Pablo Castillo Canales , Eric Daniels , Andriy Pletenetskyy , Abhinav Subramani , Jaykishan Dakshesh Choksi , Katherine Suzi Torigoe , Raymond Lee , Evan Lawrence Coons , Yi-Chen Kuo , Kai Tashima McKenney , Simon David-Levinskas Hodgson , Trevor Grant Boswell , Punit Narendra Govenji , Nan Wang , Melinda Dora Szabo , Yewching Chen , Afsoon Jamali
IPC: G02B27/01
Abstract: A device including a frame and an eyepiece is provided. The eyepiece includes a front glass, a rear glass, and an active element sandwiched between the front glass and the rear glass. The active layer is electrically activated, via an interconnect, by a flex circuit enclosed between a top portion of the frame and a cap, the flex circuit including a memory and a processor. A method for assembling the above device is also provided.
-
公开(公告)号:US20230012426A1
公开(公告)日:2023-01-12
申请号:US17856760
申请日:2022-07-01
Applicant: Meta Platforms Technologies, LLC
Inventor: Sapna Shroff , Linsen Bie , Jun Hu , David Tao , Demetrios Basil Karanikos , Sebastian Sztuk , Zhaonian Zhang , Jiangtao Kuang , Danni Luo , Yilei Li
Abstract: A method for using cameras in an augmented reality headset is provided. The method includes receiving a signal from a sensor mounted on a headset worn by a user, the signal being indicative of a user intention for capturing an image. The method also includes identifying the user intention for capturing the image, based on a model to classify the signal from the sensor according to the user intention, selecting a first image capturing device in the headset based on a specification of the first image capturing device and the user intention for capturing the image, and capturing the image with the first image capturing device. An augmented reality headset, a memory storing instructions, and a processor to execute the instructions to cause the augmented reality headset as above are also provided.
-
10.
公开(公告)号:US20250060817A1
公开(公告)日:2025-02-20
申请号:US18937586
申请日:2024-11-05
Applicant: Meta Platforms Technologies, LLC
Inventor: Sebastian Sztuk , Salvael Ortega Estrada
IPC: G06F3/01 , G06F3/04817 , G06F3/0485 , G06F3/16 , G06F9/451 , H04M1/72469
Abstract: A method for managing a user interface in a smart glass is provided. The method includes identifying an eye gesture of the user of the smart glass, based on an eye-tracking signal indicative of a pupil location of the user, assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture, and activating the application based on the user intention. A smart glass for use with the above method is also provided.
-
-
-
-
-
-
-
-
-