Systems and methods of memory allocation for neural networks

    公开(公告)号:US11907760B2

    公开(公告)日:2024-02-20

    申请号:US15711781

    申请日:2017-09-21

    Applicant: Apple Inc.

    CPC classification number: G06F9/5016

    Abstract: A method may include accessing a data processing architecture associated with a neural network to determine dependencies between intermediate data layers of the neural network; obtaining dimensions of the intermediate data layers in the neural network; calculating a minimum number of data storage portions for executing the neural network based on the dependencies; determining a memory allocation size for each respective data storage portion of the data storage portions based on the dimensions and dependencies; allocating memory on a storage device for each data storage portion in accordance with its respective determined memory allocation size.

    Enhanced image processing techniques for deep neural networks

    公开(公告)号:US11367163B2

    公开(公告)日:2022-06-21

    申请号:US16794824

    申请日:2020-02-19

    Applicant: Apple Inc.

    Abstract: Artistic styles extracted from source images may be applied to target images to generate stylized images and/or video sequences. The extracted artistic styles may be stored as a plurality of layers in one or more neural networks, which neural networks may be further optimized, e.g., via the fusion of various elements of the networks' architectures. The artistic style may be applied to the target images and/or video sequences using various optimization methods, such as the use of a first version of the neural network by a first processing device at a first resolution to generate one or more sets of parameters (e.g., scaling and/or biasing parameters), which parameters may then be mapped for use by a second version of the neural network by a second processing device at a second resolution. Analogous multi-processing device and/or multi-network solutions may also be applied to other complex image processing tasks for increased efficiency.

    Enhanced Image Processing Techniques for Deep Neural Networks

    公开(公告)号:US20200380639A1

    公开(公告)日:2020-12-03

    申请号:US16794824

    申请日:2020-02-19

    Applicant: Apple Inc.

    Abstract: Artistic styles extracted from source images may be applied to target images to generate stylized images and/or video sequences. The extracted artistic styles may be stored as a plurality of layers in one or more neural networks, which neural networks may be further optimized, e.g., via the fusion of various elements of the networks' architectures. The artistic style may be applied to the target images and/or video sequences using various optimization methods, such as the use of a first version of the neural network by a first processing device at a first resolution to generate one or more sets of parameters (e.g., scaling and/or biasing parameters), which parameters may then be mapped for use by a second version of the neural network by a second processing device at a second resolution. Analogous multi-processing device and/or multi-network solutions may also be applied to other complex image processing tasks for increased efficiency.

    Automated Selection Of Keeper Images From A Burst Photo Captured Set
    38.
    发明申请
    Automated Selection Of Keeper Images From A Burst Photo Captured Set 审中-公开
    从突发照片捕获集中自动选择守护者图像

    公开(公告)号:US20170006251A1

    公开(公告)日:2017-01-05

    申请号:US15266460

    申请日:2016-09-15

    Applicant: Apple Inc.

    Abstract: Systems and methods for improving automatic selection of keeper images from a commonly captured set of images are described. A combination of image type identification and image quality metrics may be used to identify one or more images in the set as keeper images. Image type identification may be used to categorize the captured images into, for example, three or more categories. The categories may include portrait, action, or “other.” Depending on the category identified, the images may be analyzed differently to identify keeper images. For portrait images, an operation may be used to identify the best set of faces. For action images, the set may be divided into sections such that keeper images selected from each section tell the story of the action. For the “other” category, the images may be analyzed such that those having higher quality metrics for an identified region of interest are selected.

    Abstract translation: 描述了用于改善从一组共同拍摄的图像中保持图像的自动选择的系统和方法。 可以使用图像类型识别和图像质量度量的组合来识别该集合中的一个或多个图像作为保持器图像。 可以使用图像类型识别来将捕获的图像分类为例如三个或更多个类别。 类别可以包括纵向,动作或“其他”。根据所识别的类别,可以不同地分析图像以识别守护者图像。 对于肖像图像,可以使用操作来识别最佳面部组。 对于动作图像,该集合可以被划分为部分,使得从每个部分中选择的守护者图像讲述动作的故事。 对于“其他”类别,可以分析图像,以便选择对于所识别的感兴趣区域具有较高质量度量的图像。

    Method And Apparatus For Finding And Using Video Portions That Are Relevant To Adjacent Still Images
    39.
    发明申请
    Method And Apparatus For Finding And Using Video Portions That Are Relevant To Adjacent Still Images 审中-公开
    用于查找和使用与相邻静止图像相关的视频部分的方法和装置

    公开(公告)号:US20160358634A1

    公开(公告)日:2016-12-08

    申请号:US14865752

    申请日:2015-09-25

    Applicant: Apple Inc.

    Abstract: The invention relates to systems, methods, and computer readable media for responding to a user snapshot request by capturing anticipatory pre-snapshot image data as well as post-snapshot image data. The captured information may be used, depending upon the embodiment, to create archival image information and image presentation information that is both useful and pleasing to a user. The captured information may automatically be trimmed or edited to facilitate creating an enhanced image, such as a moving still image. Varying embodiments of the invention offer techniques for trimming and editing based upon the following: exposure, brightness, focus, white balance, detected motion of the camera, substantive image analysis, detected sound, image metadata, and/or any combination of the foregoing.

    Abstract translation: 本发明涉及通过捕获预先预先快照图像数据以及快照后图像数据来响应用户快照请求的系统,方法和计算机可读介质。 根据实施例,可以使用捕获的信息来创建对用户有用和令人愉快的档案图像信息和图像呈现信息。 捕获的信息可以自动修剪或编辑,以便于创建增强图像,例如移动的静止图像。 本发明的不同实施例提供了基于以下内容进行修剪和编辑的技术:曝光,亮度,焦点,白平衡,检测到的相机运动,实质图像分析,检测到的声音,图像元数据和/或前述的任何组合。

Patent Agency Ranking