-
公开(公告)号:US20250088731A1
公开(公告)日:2025-03-13
申请号:US18621999
申请日:2024-03-29
Applicant: Apple Inc.
Inventor: Avijit S. Wasu , Anandhakumar Chinnaiyan , Benjamin A. Darling , Florian Ciurea , Tao Zhang , Zejing Wang
Abstract: Mitigations for camera alignment during image capture preview involve receiving a zoom level request for a multicamera system comprising a first camera having a first optical zoom metric and a second camera having a second optical zoom metric, and obtaining an image frame from the first camera. A target transformation is determined based on difference between the first optical zoom and a requested zoom level, the second camera's native optical zoom level, the relative orientation of the first and second cameras within the system framework and the relative intrinsics on the two cameras. The transformation is applied before, in conjunction with, or followed by a separate digital zoom transform to the image frame to obtain a transformed and digitally zoomed image frame transformation.
-
公开(公告)号:US12052498B2
公开(公告)日:2024-07-30
申请号:US17805119
申请日:2022-06-02
Applicant: Apple Inc.
Inventor: Zejing Wang , Florian Ciurea , Benjamin A. Darling
CPC classification number: H04N23/683 , G06T5/80 , H04N23/67 , H04N23/687
Abstract: Devices, methods, and non-transitory program storage devices are disclosed to provide techniques for distortion compensation in images that are subject to video image stabilization (VIS), e.g., electronic image stabilization (EIS). In some embodiments, the techniques comprise: obtaining a first image captured by a first image capture device; determining a first set of image parameters configured to apply a first distortion operation (e.g., an un-distortion operation) to the first image; determining a second set of image parameters configured to apply a first stabilization operation to a first version of the first image that has already had the first distortion operation applied; determining a third set of image parameters configured to apply a second distortion operation (e.g., an idealized, field of view-preserving, re-distortion operation) to the first image; and applying the determined first, second, and third sets of image parameters to the first image to generate a distortion-compensated and stabilized output image.
-
公开(公告)号:US20230396883A1
公开(公告)日:2023-12-07
申请号:US17805399
申请日:2022-06-03
Applicant: Apple Inc.
Inventor: Ahmed T. Kamal , Feng Li , Florian Ciurea , Jianping Zhou , Saeed Izadi , Sebastien X. Beysserie , Stephane S. Ben Soussan
CPC classification number: H04N5/23267 , H04N5/23212 , H04N5/23296 , G06V10/60 , G06V10/751
Abstract: Devices, methods, and non-transitory computer readable media are disclosed herein to repair or mitigate the appearance of unwanted reflection artifacts in captured video image streams. These unwanted reflection artifacts often present themselves as brightly-colored spots, circles, rings, or halos that reflect the shape of a bright light source in the captured image. These artifacts, also referred to herein as “ghosts” or “green ghosts” (due to often having a greenish tint), are typically located in regions of the captured images where there is not actually a bright light source located in the image. In fact, such unwanted reflection artifacts often present themselves on the image sensor across the principal point of the lens from where the actual bright light source in the captured image is located. Such devices, methods and computer readable media may be configured to detect, track, and repair such unwanted reflection artifacts in an intelligent and efficient fashion.
-
公开(公告)号:US20220394180A1
公开(公告)日:2022-12-08
申请号:US17805119
申请日:2022-06-02
Applicant: Apple Inc.
Inventor: Zejing Wang , Florian Ciurea , Benjamin A. Darling
Abstract: Devices, methods, and non-transitory program storage devices are disclosed to provide techniques for distortion compensation in images that are subject to video image stabilization (VIS), e.g., electronic image stabilization (EIS). In some embodiments, the techniques comprise: obtaining a first image captured by a first image capture device; determining a first set of image parameters configured to apply a first distortion operation (e.g., an un-distortion operation) to the first image; determining a second set of image parameters configured to apply a first stabilization operation to a first version of the first image that has already had the first distortion operation applied; determining a third set of image parameters configured to apply a second distortion operation (e.g., an idealized, field of view-preserving, re-distortion operation) to the first image; and applying the determined first, second, and third sets of image parameters to the first image to generate a distortion-compensated and stabilized output image.
-
公开(公告)号:US11158026B1
公开(公告)日:2021-10-26
申请号:US16825550
申请日:2020-03-20
Applicant: Apple Inc.
Inventor: Ahmed Tashrif Kamal , Florian Ciurea , Jianping Zhou , Paul Hubel
IPC: G06T3/40 , G06T5/00 , H04N13/239 , G06T3/00
Abstract: Electronic devices, computer readable storage media, and related methods are disclosed herein that are configured to stitch together images captured by multiple image capture devices of an image capture system. In particular, various techniques are employed to intelligently extend (and, optionally, smooth) the correspondence mapping between first and second images captured by image capture devices having different fields of view, e.g., fields of view that are at least partially overlapping and at least partially non-overlapping. The techniques may also include determining a “transitional” correspondence in a transitional region between the overlapping and non-overlapping regions of the fields of view, as well as performing one or more appearance correction operations to account for the different properties of the different image capture devices used to capture the first and second images. The techniques described herein may be employed to produce enhanced output images in either the still image or the video context.
-
公开(公告)号:US20250088742A1
公开(公告)日:2025-03-13
申请号:US18621956
申请日:2024-03-29
Applicant: Apple Inc.
Inventor: Tao Zhang , Avijit S. Wasu , Florian Ciurea , Joshua B. Shagam , Richard J. Shields , Zejing Wang
IPC: H04N23/68
Abstract: Stabilizing camera preview frames involves obtaining preview frames and associated camera motion signals, smoothing out the trajectory of these frames to correct for camera movement, and then displaying the corrected frames. The process includes comparing current and prior preview frames and their motion signals to calculate smoothed trajectories and apply appropriate rotation and translation corrections. The specifics of trajectory smoothing take into account factors such as motion state, lighting, or capture mode, which can influence the strength of the smoothing parameter. Transform matrices are utilized based on correction rotation to adjust sample points within images, and special considerations like camera sag are factored into the image corrections.
-
公开(公告)号:US20240080564A1
公开(公告)日:2024-03-07
申请号:US18173443
申请日:2023-02-23
Applicant: Apple Inc.
Inventor: Buyue Zhang , Walker J. Eagleston , Avijit S. Wasu , Jeffrey A. Brasket , Florian Ciurea , Zejing Wang , Sean Z. Amadio , Julio C. Hernandez Zaragoza , Tao Zhang
CPC classification number: H04N23/69 , H04N23/45 , H04N23/6842
Abstract: Electronic devices, methods, and program storage devices for achieving smooth zooming operations during video capture are disclosed. In particular, smooth zooming may be desirable during video capture operations that involve a single image capture device and/or transitioning between two or more distinct image capture devices, e.g., having different optical and/or zooming properties, during the video capture. When video zooming is done abruptly, it can lead to an unpleasant user experience. The techniques described herein to improve the smoothness of zooming operations include: the use of longer zoom “ramps” for image capture devices; the “early” transitioning between image capture devices during video capture; and the performance of additional “digital zoom smoothing-aware” video image stabilization operations. The embodiments described herein also provide for a more consistent user experience between video streaming (i.e., “preview”) modes and the recorded (i.e., “final”) zoomed video that is produced using the various zoom smoothing techniques described herein.
-
公开(公告)号:US12177567B2
公开(公告)日:2024-12-24
申请号:US17805399
申请日:2022-06-03
Applicant: Apple Inc.
Inventor: Ahmed T. Kamal , Feng Li , Florian Ciurea , Jianping Zhou , Saeed Izadi , Sebastien X. Beysserie , Stephane S. Ben Soussan
Abstract: Devices, methods, and non-transitory computer readable media are disclosed herein to repair or mitigate the appearance of unwanted reflection artifacts in captured video image streams. These unwanted reflection artifacts often present themselves as brightly-colored spots, circles, rings, or halos that reflect the shape of a bright light source in the captured image. These artifacts, also referred to herein as “ghosts” or “green ghosts” (due to often having a greenish tint), are typically located in regions of the captured images where there is not actually a bright light source located in the image. In fact, such unwanted reflection artifacts often present themselves on the image sensor across the principal point of the lens from where the actual bright light source in the captured image is located. Such devices, methods and computer readable media may be configured to detect, track, and repair such unwanted reflection artifacts in an intelligent and efficient fashion.
-
公开(公告)号:US10755426B2
公开(公告)日:2020-08-25
申请号:US15987834
申请日:2018-05-23
Applicant: Apple Inc.
Inventor: Mark Norman Lester Jouppi , Michael Wish Tao , Eric Bujold , Stephane Simon Rene Ben Soussan , Volker Roelke , Geoffrey T. Anneheim , Julio Cesar Hernandez Zaragoza , Florian Ciurea
Abstract: An electronic device comprises circuitry implementing a depth map enhancer. The depth map enhancer obtains an initial depth map corresponding to a scene and an image of the scene. The depth map enhancer generates a refined depth map corresponding to the scene using an optimizer, the initial depth map and the image. The refined depth map includes estimated depth indicators corresponding to at least a first depth-information region, identified based at least in part on a first criterion, of the initial depth map. Input based on the refined depth map is provided to an image processing application.
-
公开(公告)号:US20190362511A1
公开(公告)日:2019-11-28
申请号:US15987834
申请日:2018-05-23
Applicant: Apple Inc.
Inventor: Mark Norman Lester Jouppi , Michael Wish Tao , Eric Bujold , Stephane Simon Rene Ben Soussan , Volker Roelke , Geoffrey T. Anneheim , Julio Cesar Hernandez Zaragoza , Florian Ciurea
Abstract: An electronic device comprises circuitry implementing a depth map enhancer. The depth map enhancer obtains an initial depth map corresponding to a scene and an image of the scene. The depth map enhancer generates a refined depth map corresponding to the scene using an optimizer, the initial depth map and the image. The refined depth map includes estimated depth indicators corresponding to at least a first depth-information region, identified based at least in part on a first criterion, of the initial depth map. Input based on the refined depth map is provided to an image processing application.
-
-
-
-
-
-
-
-
-