-
公开(公告)号:US20190082118A1
公开(公告)日:2019-03-14
申请号:US16124168
申请日:2018-09-06
Applicant: Apple Inc.
Inventor: Xiaohuan Corina Wang , Zehang Sun , Joe Weil , Omid Khalili , Stuart Mark Pomerantz , Marc Robins , Toshihiro Horie , Eric Beale , Nathalie Castel , Jean-Michel Berthoud , Brian Walsh , Kevin O'Neil , Andy Harding , Greg Dudey
IPC: H04N5/265 , G06T13/80 , G06T7/50 , G06T17/20 , H04N5/247 , H04N5/272 , H04N5/445 , G06T7/194 , G06T7/13
Abstract: Systems, methods, apparatuses and non-transitory, computer-readable storage mediums are disclosed for generating AR self-portraits or “AR selfies.” In an embodiment, a method comprises: capturing, by a first camera of a mobile device, live image data, the live image data including an image of a subject in a physical, real-world environment; receiving, by a depth sensor of the mobile device, depth data indicating a distance of the subject from the camera in the physical, real-world environment; receiving, by one or more motion sensors of the mobile device, motion data indicating at least an orientation of the first camera in the physical, real-world environment; generating a virtual camera transform based on the motion data, the camera transform for determining an orientation of a virtual camera in a virtual environment; and generating a composite image data, using the image data, a matte and virtual background content selected based on the virtual camera orientation.
-
2.
公开(公告)号:US20220335697A1
公开(公告)日:2022-10-20
申请号:US17720227
申请日:2022-04-13
Applicant: Apple Inc.
Inventor: Andrew L. Harding , James A. Queen , Joseph-Alexander P. Weil , Joanna M. Newman , Ron A. Buencamino , Richard H. Salvador , Fernando Garcia , Austin T. Tamaddon , Omid Khalili , Scott W. Wilson , Thomas Smith
IPC: G06T19/00
Abstract: A computer system displays a representation of a field of view of the one or more cameras, including a representation of a portion of a three-dimensional physical environment that is in the field of view of the one or more cameras. The computer system receives a request to add a first virtual effect to the displayed representation of the field of view of the one or more cameras. In response to receiving the request to add the first virtual effect to the displayed representation of the field of view of the one or more cameras and in accordance with a determination that the first virtual effect requires a scan of the physical environment, the computer system initiates a scan of the physical environment to detect one or more features of the physical environment and displays a user interface that indicates a progress of the scan of the physical environment.
-
公开(公告)号:US20190080498A1
公开(公告)日:2019-03-14
申请号:US16177408
申请日:2018-10-31
Applicant: Apple Inc.
Inventor: Toshihiro Horie , Kevin O'Neil , Zehang Sun , Xiaohuan Corina Wang , Joe Weil , Omid Khalili , Stuart Mark Pomerantz , Marc Robins , Eric Beale , Nathalie Castel , Jean-Michel Berthoud , Brian Walsh , Andy Harding , Greg Dudey
Abstract: Systems, methods, apparatuses and non-transitory, computer-readable storage mediums are disclosed for generating AR self-portraits or “AR selfies.” In an embodiment, a method comprises: capturing, by a first camera of a mobile device, image data, the image data including an image of a subject in a physical, real-world environment; receiving, by a depth sensor of the mobile device, depth data indicating a distance of the subject from the camera in the physical, real-world environment; receiving, by one or more motion sensors of the mobile device, motion data indicating at least an orientation of the first camera in the physical, real-world environment; generating a virtual camera transform based on the motion data, the camera transform for determining an orientation of a virtual camera in a virtual environment; and generating a composite image data, using the image data, a matte and virtual background content selected based on the virtual camera orientation.
-
4.
公开(公告)号:US11941764B2
公开(公告)日:2024-03-26
申请号:US17720227
申请日:2022-04-13
Applicant: Apple Inc.
Inventor: Andrew L. Harding , James A. Queen , Joseph-Alexander P. Weil , Joanna M. Newman , Ron A. Buencamino , Richard H. Salvador , Fernando Garcia , Austin T. Tamaddon , Omid Khalili , Scott W. Wilson , Thomas H. Smith, III
CPC classification number: G06T19/006 , G06T15/00 , G06T2200/24
Abstract: A computer system displays a representation of a field of view of the one or more cameras, including a representation of a portion of a three-dimensional physical environment that is in the field of view of the one or more cameras. The computer system receives a request to add a first virtual effect to the displayed representation of the field of view of the one or more cameras. In response to receiving the request to add the first virtual effect to the displayed representation of the field of view of the one or more cameras and in accordance with a determination that the first virtual effect requires a scan of the physical environment, the computer system initiates a scan of the physical environment to detect one or more features of the physical environment and displays a user interface that indicates a progress of the scan of the physical environment.
-
公开(公告)号:US20220353432A1
公开(公告)日:2022-11-03
申请号:US17861086
申请日:2022-07-08
Applicant: Apple Inc.
Inventor: Xiaohuan Corina Wang , Zehang Sun , Joe Weil , Omid Khalili , Stuart Mark Pomerantz , Marc Robins , Toshihiro Horie , Eric Beale , Nathalie Castel , Jean-Michel Berthoud , Brian Walsh , Kevin O'Neil , Andy Harding , Greg Dudey
IPC: H04N5/265 , H04N5/232 , G06T7/11 , H04N5/222 , G06T7/174 , G06T11/60 , G06T7/194 , G06T7/50 , G06T7/13 , G06T13/80 , G06T15/50 , G06T17/20 , H04N5/247 , H04N5/272 , H04N5/445
Abstract: Systems, methods, apparatuses and non-transitory, computer-readable storage mediums are disclosed for generating AR self-portraits or “AR selfies.” In an embodiment, a method comprises: capturing, by a first camera of a mobile device, live image data, the live image data including an image of a subject in a physical, real-world environment; receiving, by a depth sensor of the mobile device, depth data indicating a distance of the subject from the camera in the physical, real-world environment; receiving, by one or more motion sensors of the mobile device, motion data indicating at least an orientation of the first camera in the physical, real-world environment; generating a virtual camera transform based on the motion data, the camera transform for determining an orientation of a virtual camera in a virtual environment; and generating a composite image data, using the image data, a matte and virtual background content selected based on the virtual camera orientation.
-
公开(公告)号:US10909657B1
公开(公告)日:2021-02-02
申请号:US16032844
申请日:2018-07-11
Applicant: Apple Inc.
Inventor: Francesco Rossi , Xiaohuan C. Wang , Brian E. Walsh , Bartlomiej W. Rymkowski , Xiaojin Shi , Marco Zuliani , Alexey Marinichev , Benjamin Poulain , Omid Khalili
Abstract: Artistic styles extracted from one or more source images may be applied to one or more target images, e.g., in the form of stylized images and/or stylized video sequences. The extracted artistic style may be stored as a plurality of layers in a neural network, which neural network may be further optimized, e.g., via the fusion of various elements of the network's architectures. An optimized network architecture may be determined for each processing environment in which the network will be applied. The artistic style may be applied to the obtained images and/or video sequence of images using various optimization methods, such as the use of scalars to control the resolution of the unstylized and stylized images, temporal consistency constraints, as well as the use of dynamically adjustable or selectable versions of Deep Neural Networks (DNN) that are responsive to system performance parameters, such as available processing resources and thermal capacity.
-
-
-
-
-