-
公开(公告)号：US11699097B2
公开(公告)日：2023-07-11
申请号：US16878254
申请日：2020-05-19
Applicant: Apple Inc.
Inventor： Francesco Rossi , Vignesh Jagadeesh , Vinay Sharma , Marco Zuliani , Xiaojin Shi , Benjamin Poulain
CPC classification number: G06N20/00 , G06F9/3885
Abstract: A method includes receiving input data at a trained machine learning model that includes a common part and task-specific parts, receiving an execution instruction that identifies one or more processing tasks to be performed, processing the input data using the common part of the trained machine learning model to generate intermediate data, and processing the intermediate data using one or more of the task-specific parts of the trained machine learning model based on the execution instruction to generate one or more outputs.
-
公开(公告)号：US11671696B2
公开(公告)日：2023-06-06
申请号：US17484844
申请日：2021-09-24
Applicant: Apple Inc.
Inventor： Grant Paul , Francisco Alvaro Munoz , Jeffrey A. Brasket , Brandon J. Corey , Thomas Deselaers , Nathan De Vries , Ryan S. Dixon , Craig M. Federighi , Vignesh Jagadeesh , James N. Jones , Nicholas Lupinetti , Behkish J. Manzari , Vinay Sharma , Xin Wang , Marco Zuliani
IPC: H04N5/232 , G06V30/14 , G06V30/148 , G06F40/58 , G06V20/62 , G06F3/0481 , G06F3/04842 , G06F3/04845 , G06F3/0484 , G06F3/04886
CPC classification number: H04N5/23218 , G06F3/0481 , G06F3/0484 , G06F3/04842 , G06F3/04845 , G06F3/04886 , G06F40/58 , G06V20/63 , G06V30/1456 , G06V30/153 , H04N5/23216 , H04N5/232933 , H04N5/232935 , H04N5/232939 , G06F2203/04806
Abstract: The present disclosure generally relates to methods and user interfaces for managing visual content at a computer system. In some embodiments, methods and user interfaces for managing visual content in media are described. In some embodiments, methods and user interfaces for managing visual indicators for visual content in media are described. In some embodiments, methods and user interfaces for inserting visual content in media are described. In some embodiments, methods and user interfaces for identifying visual content in media are described. In some embodiments, methods and user interfaces for translating visual content in media are described.
-
公开(公告)号：US10909657B1
公开(公告)日：2021-02-02
申请号：US16032844
申请日：2018-07-11
Applicant: Apple Inc.
Inventor： Francesco Rossi , Xiaohuan C. Wang , Brian E. Walsh , Bartlomiej W. Rymkowski , Xiaojin Shi , Marco Zuliani , Alexey Marinichev , Benjamin Poulain , Omid Khalili
Abstract: Artistic styles extracted from one or more source images may be applied to one or more target images, e.g., in the form of stylized images and/or stylized video sequences. The extracted artistic style may be stored as a plurality of layers in a neural network, which neural network may be further optimized, e.g., via the fusion of various elements of the network's architectures. An optimized network architecture may be determined for each processing environment in which the network will be applied. The artistic style may be applied to the obtained images and/or video sequence of images using various optimization methods, such as the use of scalars to control the resolution of the unstylized and stylized images, temporal consistency constraints, as well as the use of dynamically adjustable or selectable versions of Deep Neural Networks (DNN) that are responsive to system performance parameters, such as available processing resources and thermal capacity.
-
公开(公告)号：US10249029B2
公开(公告)日：2019-04-02
申请号：US13954599
申请日：2013-07-30
Applicant: Apple Inc.
Inventor： Marco Zuliani
Abstract: Methods and systems for an image construction component capable of generating pixel information for certain regions of an image based on other, existing regions of the image. For example, the image construction component may identify a target block of pixels for which to generate pixel information and then use pixel information for pixels surrounding the target block of pixels in order to identify similar image information within pixels in another part of the image. These identified pixels may then be used in defining the pixel information of the target block of pixels and also used in blending the target block of pixels with the defined pixels surrounding the target block of pixels.
-
公开(公告)号：US10198839B2
公开(公告)日：2019-02-05
申请号：US15273674
申请日：2016-09-22
Applicant: Apple Inc.
Inventor： Bartlomiej W. Rymkowski , Marco Zuliani
Abstract: Techniques are disclosed herein for applying an artistic style extracted from one or more source images, e.g., paintings, to one or more target images. The extracted artistic style may then be stored as a plurality of layers in a neural network. In some embodiments, two or more stylized target images may be combined and stored as a stylized video sequence. The artistic style may be applied to the target images in the stylized video sequence using various optimization methods and/or pixel- and feature-based regularization techniques in a way that prevents excessive content pixel fluctuations between images and preserves smoothness in the assembled stylized video sequence. In other embodiments, a user may be able to semantically annotate locations of undesired artifacts in a target image, as well as portion(s) of a source image from which a style may be extracted and used to replace the undesired artifacts in the target image.
-
Patent Agency Ranking
公开(公告)号：US20180082407A1
公开(公告)日：2018-03-22
申请号：US15273674
申请日：2016-09-22
Applicant: Apple Inc.
Inventor： Bartlomiej W. Rymkowski , Marco Zuliani
CPC classification number: G06T11/60
Abstract: Techniques are disclosed herein for applying an artistic style extracted from one or more source images, e.g., paintings, to one or more target images. The extracted artistic style may then be stored as a plurality of layers in a neural network. In some embodiments, two or more stylized target images may be combined and stored as a stylized video sequence. The artistic style may be applied to the target images in the stylized video sequence using various optimization methods and/or pixel- and feature-based regularization techniques in a way that prevents excessive content pixel fluctuations between images and preserves smoothness in the assembled stylized video sequence. In other embodiments, a user may be able to semantically annotate locations of undesired artifacts in a target image, as well as portion(s) of a source image from which a style may be extracted and used to replace the undesired artifacts in the target image.
-
公开(公告)号：US20160358341A1
公开(公告)日：2016-12-08
申请号：US14732738
申请日：2015-06-07
Applicant: Apple Inc.
Inventor： Xiaoxing Li , Geoffrey T. Anneheim , Jianping Zhou , Richard D. Seely , Marco Zuliani
CPC classification number: G06K9/6202 , G06T3/40 , G06T7/13 , G06T7/248 , G06T7/90 , G06T2207/10016 , G06T2207/10024
Abstract: Techniques to identify and track a pre-identified region-of-interest (ROI) through a temporal sequence of frames/images are described. In general, a down-sampled color gradient (edge map) of an arbitrary sized ROI from a prior frame may be used to generate a small template. This initial template may be used to identify a region of a new or current frame that may be overscan and used to create a current frame's edge map. By comparing the prior frame's template to the current frame's edge map, a cost value or image may be found and used to identify the current frame's ROI center. The size of the current frame's ROI may be found by varying the size of putative new ROIs and testing for their congruence with the prior frame's template. Subsequent ROI's for subsequent frames may be identified to, effectively, track an arbitrarily sized ROI through a sequence of video frames.
Abstract translation: 描述了通过帧/图像的时间序列来识别和跟踪预先识别的感兴趣区域（ROI）的技术。 通常，可以使用来自先前帧的任意大小的ROI的下采样颜色梯度（边缘图）来生成小模板。 该初始模板可用于识别可能被过扫描并用于创建当前帧的边缘图的新的或当前帧的区域。 通过将先前帧的模板与当前帧的边缘图进行比较，可以找到成本值或图像，并用于识别当前帧的ROI中心。 当前框架的投资回报率的大小可以通过改变推定的新投资回报率的大小和测试与先前框架模板的一致性来确定。 可以通过一系列视频帧来识别后续帧的后续ROI，以有效地跟踪任意大小的ROI。
-
公开(公告)号：US09092853B2
公开(公告)日：2015-07-28
申请号：US14513046
申请日：2014-10-13
Applicant: Apple Inc.
Inventor： Todd S. Sachs , Kevin L. Hunter , Marco Zuliani , Claus Molgaard
CPC classification number: G06T7/0018 , G06T7/80 , G06T2207/10004 , H04N5/23216 , H04N5/23293 , H04N17/002
Abstract: A method for dynamically calibrating rotational offset in a device includes obtaining an image captured by a camera of the device. Orientation information of the device at the time of image capture may be associated with the image. Pixel data of the image may be analyzed to determine an image orientation angle for the image. A device orientation angle may be determined from the orientation information. A rotational offset, based on the image orientation angle and the device orientation angle, may be determined. The rotational offset is relative to the camera or orientation sensor. A rotational bias may be determined from statistical analysis of numerous rotational offsets from numerous respective images. In some embodiments, various thresholds and predetermined ranges may be used to exclude some rotational offsets from the statistical analysis or to discontinue processing for that image.
Abstract translation: 用于动态校准装置中的旋转偏移的方法包括获得由装置的照相机拍摄的图像。 图像拍摄时设备的方向信息可能与图像相关联。 可以分析图像的像素数据以确定图像的图像取向角度。 可以根据取向信息来确定设备取向角度。 可以确定基于图像取向角度和装置取向角度的旋转偏移。 旋转偏移量相对于相机或方位传感器。 旋转偏差可以根据来自大量各自图像的许多旋转偏移的统计分析来确定。 在一些实施例中，可以使用各种阈值和预定范围来从统计分析中排除一些旋转偏移或者中断对该图像的处理。
-
公开(公告)号：US20150036945A1
公开(公告)日：2015-02-05
申请号：US13954599
申请日：2013-07-30
Applicant: Apple Inc.
Inventor： Marco Zuliani
CPC classification number: G06T5/005 , G06T2207/10024 , G06T2207/20021
Abstract: Methods and systems for an image construction component capable of generating pixel information for certain regions of an image based on other, existing regions of the image. For example, the image construction component may identify a target block of pixels for which to generate pixel information and then use pixel information for pixels surrounding the target block of pixels in order to identify similar image information within pixels in another part of the image. These identified pixels may then be used in defining the pixel information of the target block of pixels and also used in blending the target block of pixels with the defined pixels surrounding the target block of pixels.
Abstract translation: 能够基于图像的其他现有区域产生图像的某些区域的像素信息的图像构造部件的方法和系统。 例如，图像构造部件可以识别用于生成像素信息的目标像素块，然后对于像素的像素周围的像素使用像素信息，以便识别图像的另一部分中的像素内的类似图像信息。 然后可以将这些识别的像素用于定义目标像素块的像素信息，并且还用于将目标像素块与围绕目标像素块的限定像素进行混合。
-
公开(公告)号：US10664963B1
公开(公告)日：2020-05-26
申请号：US16032879
申请日：2018-07-11
Applicant: Apple Inc.
Inventor： Francesco Rossi , Xiaohuan C. Wang , Bartlomiej W. Rymkowski , Xiaojin Shi , Marco Zuliani , Alexey Marinichev
Abstract: Artistic styles extracted from one or more source images may be applied to one or more target images, e.g., in the form of stylized images and/or stylized video sequences. The extracted artistic style may be stored as a plurality of layers in a neural network, which neural network may be further optimized, e.g., via the fusion of various elements of the network's architectures. An optimized network architecture may be determined for each processing environment in which the network will be applied. The artistic style may be applied to the obtained images and/or video sequence of images using various optimization methods, such as the use of scalars to control the resolution of the unstylized and stylized images, temporal consistency constraints, as well as the use of dynamically adjustable or selectable versions of Deep Neural Networks (DNN) that are responsive to system performance parameters, such as available processing resources and thermal capacity.
-
-
-
-
-
-
-
-
-
Search Results
39
records
(took 0.018 seconds)
