VIDEO COMPRESSION WITH ADAPTIVE VIEW-DEPENDENT LIGHTING REMOVAL

    公开(公告)号:US20180097867A1

    公开(公告)日:2018-04-05

    申请号:US15832023

    申请日:2017-12-05

    Applicant: Lytro, Inc.

    Abstract: A video stream of a scene for a virtual reality or augmented reality experience may be captured by one or more image capture devices. Data from the video stream may be retrieved, including base vantage data with base vantage color data depicting the scene from a base vantage location, and target vantage data with target vantage color data depicting the scene from a target vantage location. The base vantage data may be reprojected to the target vantage location to obtain reprojected target vantage data. The reprojected target vantage data may be compared with the target vantage data to obtain residual data. The residual data may be compressed by removing a subset of the residual data that is likely to be less viewer-discernable than a remainder of the residual data. A compressed video stream may be stored, including the base vantage data and the compressed residual data.

    Light-field aberration correction

    公开(公告)号:US09628684B2

    公开(公告)日:2017-04-18

    申请号:US14573319

    申请日:2014-12-17

    Applicant: Lytro, Inc.

    CPC classification number: H04N5/2254 G02B27/0075 H04N5/3572 H04N17/002

    Abstract: According to various embodiments, the system and method disclosed herein serve to at least partially compensate for departures of an actual main lens of a light-field camera from the properties of an ideal main lens. Light-field data may be captured and processed through the use of product calibration data and unit calibration data. The product calibration data may be descriptive of departure of a main lens design of the light-field camera from an ideal main lens design. The unit calibration data may be descriptive of departure of the actual main lens of the light-field camera from the main lens design. Corrected light-field data may be generated as a result of the processing, and may be used to generate a light-field image.

    DEPTH-BASED APPLICATION OF IMAGE EFFECTS
    4.
    发明申请
    DEPTH-BASED APPLICATION OF IMAGE EFFECTS 有权
    基于深度的图像效应应用

    公开(公告)号:US20170061635A1

    公开(公告)日:2017-03-02

    申请号:US14837465

    申请日:2015-08-27

    Applicant: Lytro, Inc.

    Abstract: An image such as a light-field image may be captured with a light-field image capture device with a microlens array. The image may be received in a data store along with a depth map that indicates depths at which objects in different portions of the image are disposed. A function may be applied to the depth map to generate a mask that defines a gradual transition between the different depths. An effect may be applied to the image through the use of the mask such that applicability of the effect is determined by the mask. A processed image may be generated. The first effect may be present in the processed image, as applied previously. The processed image may be displayed on a display device. If desired, multiple effects may be applied through the generation of multiple masks, depth maps, and/or intermediate images prior to generation of the processed image.

    Abstract translation: 诸如光场图像的图像可以用具有微透镜阵列的光场图像捕获装置捕获。 可以在数据存储器中接收图像以及指示图像的不同部分中的对象被布置的深度的深度图。 可以将功能应用于深度图以生成限定不同深度之间的渐变的掩模。 可以通过使用掩模对图像施加效果,使得效果的适用性由掩模确定。 可以生成经处理的图像。 如前所述,第一效果可能存在于经处理的图像中。 经处理的图像可以显示在显示装置上。 如果需要,可以在生成处理的图像之前通过生成多个掩模,深度图和/或中间图像来应用多个效果。

    CAPTURING LIGHT-FIELD IMAGES WITH UNEVEN AND/OR INCOMPLETE ANGULAR SAMPLING
    5.
    发明申请
    CAPTURING LIGHT-FIELD IMAGES WITH UNEVEN AND/OR INCOMPLETE ANGULAR SAMPLING 审中-公开
    捕获未图像和/或不正确的角度采样的光场图像

    公开(公告)号:US20160353082A1

    公开(公告)日:2016-12-01

    申请号:US15142565

    申请日:2016-04-29

    Applicant: Lytro, Inc.

    Abstract: A light-field camera may generate four-dimensional light-field data indicative of incoming light. The light-field camera may have an aperture configured to receive the incoming light, an image sensor, and a microlens array configured to redirect the incoming light at the image sensor. The image sensor may receive the incoming light and, based on the incoming light, generate the four-dimensional light-field data, which may have first and second spatial dimensions and first and second angular dimensions. The first angular dimension may have a first resolution higher than a second resolution of the second angular dimension.

    Abstract translation: 光场照相机可以产生指示入射光的四维光场数据。 光场摄像机可以具有被配置为接收入射光的孔径,图像传感器和被配置为将入射光重定向在图像传感器处的微透镜阵列。 图像传感器可以接收入射光,并且基于入射光产生可以具有第一和第二空间维度以及第一和第二角度尺寸的四维光场数据。 第一角度尺寸可以具有比第二角度尺寸的第二分辨率高的第一分辨率。

    OPTIMIZATION OF OPTICAL SYSTEMS FOR IMPROVED LIGHT FIELD CAPTURE AND MANIPULATION
    6.
    发明申请
    OPTIMIZATION OF OPTICAL SYSTEMS FOR IMPROVED LIGHT FIELD CAPTURE AND MANIPULATION 有权
    用于改进光场捕获和操纵的光学系统的优化

    公开(公告)号:US20160173844A1

    公开(公告)日:2016-06-16

    申请号:US15050183

    申请日:2016-02-22

    Applicant: Lytro, Inc.

    Abstract: According to various embodiments of the present invention, the optical systems of light field capture devices are optimized so as to improve captured light field image data. Optimizing optical systems of light field capture devices can result in captured light field image data (both still and video) that is cheaper and/or easier to process. Optical systems can be optimized to yield improved quality or resolution when using cheaper processing approaches whose computational costs fit within various processing and/or resource constraints. As such, the optical systems of light field cameras can be optimized to reduce size and/or cost and/or increase the quality of such optical systems.

    Abstract translation: 根据本发明的各种实施例,对光场捕获装置的光学系统进行了优化,以便改善捕获的光场图像数据。 优化光场捕获设备的光学系统可以导致捕获的光场图像数据(静止和视频),其更便宜和/或更容易处理。 当使用更便宜的处理方法(其计算成本适合各种处理和/或资源约束)时,可以优化光学系统以产生改进的质量或分辨率。 因此,光场照相机的光学系统可以被优化以减小尺寸和/或成本和/或提高这种光学系统的质量。

    Plenoptic Camera Resolution
    8.
    发明申请
    Plenoptic Camera Resolution 有权
    相机分辨率

    公开(公告)号:US20150181091A1

    公开(公告)日:2015-06-25

    申请号:US14573651

    申请日:2014-12-17

    Applicant: Lytro, Inc.

    CPC classification number: H04N5/2254 G02B27/0075 H04N5/3572 H04N17/002

    Abstract: According to various embodiments, the system and method disclosed herein facilitate the design of plenoptic camera lens systems to enhance camera resolution. A first configuration for the plenoptic camera may first be selected, with a first plurality of variables that define attributes of the plenoptic camera. The attributes may include a main lens attribute of a main lens of the plenoptic camera and/or a phase mask attribute of a phase mask of the plenoptic camera. A merit function may be applied by simulating receipt of light through the main lens and the plurality of microlenses of the first configuration to calculate a first merit function value. The main lens attribute and/or the phase mask attribute may be iteratively perturbed, and the merit function may be re-applied. An optimal set of variables may be identified by comparing results of successive applications of the merit function.

    Abstract translation: 根据各种实施例,本文公开的系统和方法有助于设计全光相机透镜系统以增强相机分辨率。 可以首先选择用于全光照相机的第一配置,其中第一多个变量定义全光摄像机的属性。 属性可以包括全光相机的主透镜的主透镜属性和/或全光相机的相位掩模的相位掩模属性。 可以通过模拟通过主透镜和多个第一配置的微透镜的光的接收来应用优值函数,以计算第一优值函数值。 主透镜属性和/或相位掩模属性可以被迭代地扰动,并且优点函数可以被重新应用。 可以通过比较优点函数的连续应用的结果来识别最佳变量集合。

    Light-field processing and analysis, camera control, and user interfaces and interaction on light-field capture devices
    9.
    发明授权
    Light-field processing and analysis, camera control, and user interfaces and interaction on light-field capture devices 有权
    光场处理和分析,摄像机控制以及用户界面和光场捕获设备上的交互

    公开(公告)号:US08995785B2

    公开(公告)日:2015-03-31

    申请号:US13774986

    申请日:2013-02-22

    Applicant: Lytro, Inc.

    CPC classification number: H04N5/23293 H04N5/23212

    Abstract: In various embodiments, the present invention relates to methods, systems, architectures, algorithms, designs, and user interfaces for capturing, processing, analyzing, displaying, annotating, modifying, and/or interacting with light-field data on a light-field capture device. In at least one embodiment, the light-field capture device communicates to the user information about the scene during live-view to aid him or her in capturing light-field images that provide increased refocusing ability, increased parallax and perspective shifting ability, increased stereo disparity, and/or more dramatic post-capture effects. Additional embodiments present a standard 2D camera interface to software running on the light-field capture device to enable such software to function normally even though the device is actually capturing light-field data. Additional embodiments provide the ability to control camera optical elements to facilitate ease of composition and capture of light-field data, and/or generating a plurality of 2D video streams derived from a stream of light-field data.

    Abstract translation: 在各种实施例中,本发明涉及用于在光场捕获上捕获,处理,分析,显示,注释,修改和/或与光场数据交互的方法,系统,架构,算法,设计和用户界面 设备。 在至少一个实施例中,光场捕获设备在实时观看期间向用户传达关于场景的信息,以帮助他或她捕获提供增强的重聚焦能力,增加的视差和透视转换能力的光场图像,增加的立体声 差异性和/或更显着的捕获后效应。 另外的实施例将标准2D相机接口呈现给在光场捕获装置上运行的软件,以使得即使该装置实际上捕获光场数据也能使这样的软件正常工作。 另外的实施例提供了控制照相机光学元件以便于轻组合和捕获光场数据的能力,和/或产生从光场数据流导出的多个2D视频流的能力。

    Extended depth of field and variable center of perspective in light-field processing
    10.
    发明授权
    Extended depth of field and variable center of perspective in light-field processing 有权
    光场加工中的景深扩展和视角可变中心的扩展

    公开(公告)号:US08811769B1

    公开(公告)日:2014-08-19

    申请号:US13688026

    申请日:2012-11-28

    Applicant: Lytro, Inc.

    Abstract: According to various embodiments, the system and method of the present invention process light-field image data in a manner that reduces artifacts and that yields 2-D images with extended depth of field, and with variable placement of the center of perspective. Center of perspective can be varied based on user input or on pre-specified parameters. Various techniques for improving the presentation of light-field images with variable center of perspective are described, and for performing other effects in connection with projection of light-field images.

    Abstract translation: 根据各种实施例,本发明的系统和方法以减少伪影的方式处理光场图像数据,并产生具有扩展景深的2-D图像,并且具有透视中心的可变放置。 透视中心可以根据用户输入或预先指定的参数而变化。 描述了用于改善具有可变的透视中心的光场图像的呈现的各种技术,并且用于执行与光场图像的投影有关的其它效果。

Patent Agency Ranking