Generating static images with an event camera

    公开(公告)号:US11019273B2

    公开(公告)日:2021-05-25

    申请号:US16649005

    申请日:2018-06-28

    申请人: Apple Inc.

    IPC分类号: H04N5/235

    摘要: In accordance with some embodiments, a method is performed at an image processing device with a processor and non-transitory memory. The method includes triggering light emission, over a first emission duration, having a characterizing intensity as a function of time. The method further includes obtaining respective pixel events, from an event camera, corresponding to reflections of the light emission during the first emission duration, each respective pixel event corresponding to a breach of a respective comparator threshold indicative of a brightness level, each respective pixel event characterized by a respective electrical threshold value and a timestamp at which the respective electrical threshold value was breached. The method also includes generating a static image by determining a plurality of luminance estimation values from the respective pixel events, wherein the plurality of luminance estimation values respectively correspond to an amount of reflected light received by portions of the event camera.

    Dynamic foveated pipeline
    2.
    发明授权

    公开(公告)号:US12131437B2

    公开(公告)日:2024-10-29

    申请号:US18510916

    申请日:2023-11-16

    申请人: Apple Inc.

    IPC分类号: G06T3/18 G06T3/40 G06T9/00

    CPC分类号: G06T3/18 G06T3/40 G06T9/001

    摘要: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.

    Generating static images with an event camera

    公开(公告)号:US11770619B2

    公开(公告)日:2023-09-26

    申请号:US17235175

    申请日:2021-04-20

    申请人: Apple Inc.

    IPC分类号: H04N23/72 H04N23/71

    CPC分类号: H04N23/72 H04N23/71

    摘要: In accordance with some embodiments, a method is performed at an image processing device with a processor and non-transitory memory. The method includes triggering light emission, over a first emission duration, having a characterizing intensity as a function of time. The method further includes obtaining respective pixel events, from an event camera, corresponding to reflections of the light emission during the first emission duration, each respective pixel event corresponding to a breach of a respective comparator threshold indicative of a brightness level, each respective pixel event characterized by a respective electrical threshold value and a timestamp at which the respective electrical threshold value was breached. The method also includes generating a static image by determining a plurality of luminance estimation values from the respective pixel events, wherein the plurality of luminance estimation values respectively correspond to an amount of reflected light received by portions of the event camera.

    Dynamic foveated pipeline
    4.
    发明授权

    公开(公告)号:US11836885B2

    公开(公告)日:2023-12-05

    申请号:US17053181

    申请日:2019-05-06

    申请人: Apple Inc.

    IPC分类号: G06T3/00 G06T3/40 G06T9/00

    CPC分类号: G06T3/0093 G06T3/40 G06T9/001

    摘要: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.

    GENERATING STATIC IMAGES WITH AN EVENT CAMERA

    公开(公告)号:US20200252533A1

    公开(公告)日:2020-08-06

    申请号:US16649005

    申请日:2018-06-28

    申请人: Apple Inc.

    IPC分类号: H04N5/235

    摘要: In accordance with some embodiments, a method is performed at an image processing device with a processor and non-transitory memory. The method includes triggering light emission, over a first emission duration, having a characterizing intensity as a function of time. The method further includes obtaining respective pixel events, from an event camera, corresponding to reflections of the light emission during the first emission duration, each respective pixel event corresponding to a breach of a respective comparator threshold indicative of a brightness level, each respective pixel event characterized by a respective electrical threshold value and a timestamp at which the respective electrical threshold value was breached. The method also includes generating a static image by determining a plurality of luminance estimation values from the respective pixel events, wherein the plurality of luminance estimation values respectively correspond to an amount of reflected light received by portions of the event camera.

    DYNAMIC FOVEATED PIPELINE
    6.
    发明公开

    公开(公告)号:US20240087080A1

    公开(公告)日:2024-03-14

    申请号:US18510916

    申请日:2023-11-16

    申请人: Apple Inc.

    IPC分类号: G06T3/00 G06T3/40 G06T9/00

    CPC分类号: G06T3/0093 G06T3/40 G06T9/001

    摘要: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.

    GENERATING STATIC IMAGES WITH AN EVENT CAMERA

    公开(公告)号:US20210243347A1

    公开(公告)日:2021-08-05

    申请号:US17235175

    申请日:2021-04-20

    申请人: Apple Inc.

    IPC分类号: H04N5/235

    摘要: In accordance with some embodiments, a method is performed at an image processing device with a processor and non-transitory memory. The method includes triggering light emission, over a first emission duration, having a characterizing intensity as a function of time. The method further includes obtaining respective pixel events, from an event camera, corresponding to reflections of the light emission during the first emission duration, each respective pixel event corresponding to a breach of a respective comparator threshold indicative of a brightness level, each respective pixel event characterized by a respective electrical threshold value and a timestamp at which the respective electrical threshold value was breached. The method also includes generating a static image by determining a plurality of luminance estimation values from the respective pixel events, wherein the plurality of luminance estimation values respectively correspond to an amount of reflected light received by portions of the event camera.

    DYNAMIC FOVEATED PIPELINE
    8.
    发明申请

    公开(公告)号:US20210142443A1

    公开(公告)日:2021-05-13

    申请号:US17053181

    申请日:2019-05-06

    申请人: Apple Inc.

    IPC分类号: G06T3/00 G06T3/40 G06T9/00

    摘要: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.