-
公开(公告)号:US09740298B2
公开(公告)日:2017-08-22
申请号:US14922222
申请日:2015-10-26
Applicant: APPLE INC.
Inventor: Aviad Maizels , Alexander Shpunt , Tamir Berliner
CPC classification number: G06F3/017 , G02B27/0093 , G02B27/0172 , G02B2027/0134 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/011 , G06F3/013 , G06K9/00201 , G06K9/00671 , G06T19/006 , H04N13/189 , H04N13/344 , H04N13/363 , H04N13/366 , H04N13/383
Abstract: Embodiments of the invention provide apparatus and methods for interactive reality augmentation, including a 2-dimensional camera and a 3-dimensional camera, associated depth projector and content projector, and a processor linked to the 3-dimensional camera and the 2-dimensional camera. A depth map of the scene is produced using an output of the 3-dimensional camera, and coordinated with a 2-dimensional image captured by the 2-dimensional camera to identify a 3-dimensional object in the scene that meets predetermined criteria for projection of images thereon. The content projector projects a content image onto the 3-dimensional object responsively to instructions of the processor, which can be mediated by automatic recognition of user gestures.
-
公开(公告)号:US20190319036A1
公开(公告)日:2019-10-17
申请号:US16429005
申请日:2019-06-02
Applicant: Apple Inc.
Inventor: Zeev Zalevsky , Alexander Shpunt , Aviad Maizels , Javier Garcia
IPC: H01L27/11524 , G01B11/16 , H01L29/06 , G01B11/24 , G01B11/25 , H04N13/254 , H04N13/20 , H01L29/788 , H01L29/423 , H01L27/11519 , H01L23/535 , H01L23/528 , G06T7/521
Abstract: A system for object reconstruction includes an illuminating unit, comprising a light source and a generator of a non-periodic pattern. A diffractive optical element (DOE) is disposed in an optical path of illuminating light propagating from the illuminating unit toward an object, thereby projecting the non-periodic pattern onto an object. An imaging unit detects a light response of an illuminated region and generating image data indicative of the object within the projected pattern. A processor reconstructs a three-dimensional (3D) map of the object responsively to a shift of the pattern in the image data relative to a reference image of the pattern.
-
公开(公告)号:US20180059925A1
公开(公告)日:2018-03-01
申请号:US15806350
申请日:2017-11-08
Applicant: Apple Inc.
Inventor: Aviad Maizels , Alexander Shpunt , Shai Litvak
IPC: G06F3/0484 , G06F3/0488 , G06F3/01
CPC classification number: G06F3/04847 , G06F3/011 , G06F3/017 , G06F3/0488
Abstract: Operating a computerized system includes presenting user interface elements on a display screen. A first gesture made in a three-dimensional space by a by a distal portion of an upper extremity of a user is detected while a segment of the distal portion thereof rests on a surface. In response to the first gesture, an area of the display screen selected by the user is identified, and a corresponding user interface element is displayed. After displaying the corresponding user interface element, a second gesture made by the distal portion is detected while the segment continues to rest on the surface so as to select one of the user interface elements that appears in the selected area.
-
公开(公告)号:US20170004623A1
公开(公告)日:2017-01-05
申请号:US15256572
申请日:2016-09-04
Applicant: APPLE INC.
Inventor: Zeev Zalevsky , Alexander Shpunt , Aviad Maizels , Javier Garcia
CPC classification number: H01L27/11524 , G01B11/162 , G01B11/2441 , G01B11/2513 , G06T7/521 , G06T2207/10012 , G06T2207/20056 , H01L23/528 , H01L23/535 , H01L27/11519 , H01L29/0688 , H01L29/42328 , H01L29/788 , H01L2924/0002 , H04N13/20 , H04N13/254
Abstract: A system for object reconstruction includes an illuminating unit, comprising a coherent light source and a generator of a non-periodic pattern. A diffractive optical element (DOE) is disposed in an optical path of illuminating light propagating from the illuminating unit toward an object, thereby projecting the non-periodic pattern onto an object. An imaging unit detects a light response of an illuminated region and generating image data indicative of the object within the projected pattern. A processor reconstructs a three-dimensional (3D) map of the object responsively to a shift of the pattern in the image data relative to a reference image of the pattern.
Abstract translation: 一种用于物体重建的系统包括一个照明单元,包括相干光源和非周期性图案的发生器。 衍射光学元件(DOE)设置在从照明单元向物体传播的照明光的光路中,从而将非周期性图案投射到物体上。 成像单元检测被照射区域的光响应并且生成指示投影图案内的对象的图像数据。 响应于图像数据中的图案相对于图案的参考图像的移动,处理器重建物体的三维(3D)地图。
-
公开(公告)号:US20150287205A1
公开(公告)日:2015-10-08
申请号:US14745438
申请日:2015-06-21
Applicant: Apple Inc.
Inventor: Zeev Zalevsky , Alexander Shpunt , Aviad Maizels , Javier Garcia
CPC classification number: H01L27/11524 , G01B11/162 , G01B11/2441 , G01B11/2513 , G06T7/521 , G06T2207/10012 , G06T2207/20056 , H01L23/528 , H01L23/535 , H01L27/11519 , H01L29/0688 , H01L29/42328 , H01L29/788 , H01L2924/0002 , H04N13/20 , H04N13/254
Abstract: A system and method are presented for use in the object reconstruction. The system comprises an illuminating unit, and an imaging unit (see FIG. 1). The illuminating unit comprises a coherent light source and a generator of a random speckle pattern accommodated in the optical path of illuminating light propagating from the light source towards an object, thereby projecting onto the object a coherent random speckle pattern. The imaging unit is configured for detecting a light response of an illuminated region and generating image data. The image data is indicative of the object with the projected speckles pattern and thus indicative of a shift of the pattern in the image of the object relative to a reference image of said pattern. This enables real-time reconstruction of a three-dimensional map of the object.
Abstract translation: 提出了一种用于对象重构的系统和方法。 该系统包括照明单元和成像单元(参见图1)。 照明单元包括相干光源和容纳在从光源向物体传播的照明光的光路中的随机散斑图案的发生器,由此向对象投射相干随机散斑图案。 成像单元被配置用于检测照明区域的光响应并生成图像数据。 图像数据指示具有投影的斑点图案的对象,并且因此指示相对于所述图案的参考图像的对象的图像中的图案的偏移。 这使得能够对对象的三维地图进行实时重建。
-
公开(公告)号:US10608002B2
公开(公告)日:2020-03-31
申请号:US16429005
申请日:2019-06-02
Applicant: Apple Inc.
Inventor: Zeev Zalevsky , Alexander Shpunt , Aviad Maizels , Javier Garcia
IPC: H01L21/00 , H01L27/11524 , H04N13/254 , G06T7/521 , G01B11/25 , H04N13/20 , G01B11/16 , G01B11/24 , H01L23/528 , H01L23/535 , H01L27/11519 , H01L29/06 , H01L29/423 , H01L29/788
Abstract: A system for object reconstruction includes an illuminating unit, comprising a light source and a generator of a non-periodic pattern. A diffractive optical element (DOE) is disposed in an optical path of illuminating light propagating from the illuminating unit toward an object, thereby projecting the non-periodic pattern onto an object. An imaging unit detects a light response of an illuminated region and generating image data indicative of the object within the projected pattern. A processor reconstructs a three-dimensional (3D) map of the object responsively to a shift of the pattern in the image data relative to a reference image of the pattern.
-
公开(公告)号:US10340280B2
公开(公告)日:2019-07-02
申请号:US15623408
申请日:2017-06-15
Applicant: APPLE INC.
Inventor: Zeev Zalevsky , Alexander Shpunt , Aviad Maizels , Javier Garcia
IPC: H04N9/00 , H01L27/11524 , H04N13/254 , G01B11/16 , G01B11/25 , G06T7/521 , G01B11/24 , H01L23/528 , H01L23/535 , H01L27/11519 , H01L29/06 , H01L29/423 , H01L29/788 , H04N13/20
Abstract: A system for object reconstruction includes an illuminating unit, comprising a light source and a generator of a non-periodic pattern. A diffractive optical element (DOE) is disposed in an optical path of illuminating light propagating from the illuminating unit toward an object, thereby projecting the non-periodic pattern onto an object. An imaging unit detects a light response of an illuminated region and generating image data indicative of the object within the projected pattern. A processor reconstructs a three-dimensional (3D) map of the object responsively to a shift of the pattern in the image data relative to a reference image of the pattern.
-
公开(公告)号:US20170287923A1
公开(公告)日:2017-10-05
申请号:US15623408
申请日:2017-06-15
Applicant: APPLE INC.
Inventor: Zeev Zalevsky , Alexander Shpunt , Aviad Maizels , Javier Garcia
IPC: H01L27/11524 , H01L29/423 , H01L23/535 , H01L29/788 , H01L23/528 , H01L29/06 , H01L27/11519
CPC classification number: H01L27/11524 , G01B11/162 , G01B11/2441 , G01B11/2513 , G06T7/521 , G06T2207/10012 , G06T2207/20056 , H01L23/528 , H01L23/535 , H01L27/11519 , H01L29/0688 , H01L29/42328 , H01L29/788 , H01L2924/0002 , H04N13/20 , H04N13/254
Abstract: pattern. A processor reconstructs a three-dimensional (3D) map of the object responsively to a shift of the pattern in the image data relative to a reference image of the pattern.
-
公开(公告)号:US20160041625A1
公开(公告)日:2016-02-11
申请号:US14922222
申请日:2015-10-26
Applicant: APPLE INC.
Inventor: Aviad Maizels , Alexander Shpunt , Tamir Berliner
CPC classification number: G06F3/017 , G02B27/0093 , G02B27/0172 , G02B2027/0134 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/011 , G06F3/013 , G06K9/00201 , G06K9/00671 , G06T19/006 , H04N13/189 , H04N13/344 , H04N13/363 , H04N13/366 , H04N13/383
Abstract: Embodiments of the invention provide apparatus and methods for interactive reality augmentation, including a 2-dimensional camera and a 3-dimensional camera, associated depth projector and content projector, and a processor linked to the 3-dimensional camera and the 2-dimensional camera. A depth map of the scene is produced using an output of the 3-dimensional camera, and coordinated with a 2-dimensional image captured by the 2-dimensional camera to identify a 3-dimensional object in the scene that meets predetermined criteria for projection of images thereon. The content projector projects a content image onto the 3-dimensional object responsively to instructions of the processor, which can be mediated by automatic recognition of user gestures
Abstract translation: 本发明的实施例提供了用于交互式现实增强的装置和方法,包括二维相机和三维相机,相关联的深度投影仪和内容投影仪,以及连接到三维相机和二维相机的处理器。 使用三维相机的输出产生场景的深度图,并且与由二维相机拍摄的二维图像协调,以识别场景中满足预定标准的三维物体,以投影 图像上。 内容投影仪响应于处理器的指令将内容图像投影到3维物体上,该指令可以通过用户手势的自动识别来介导
-
公开(公告)号:US10719214B2
公开(公告)日:2020-07-21
申请号:US15806350
申请日:2017-11-08
Applicant: Apple Inc.
Inventor: Aviad Maizels , Alexander Shpunt , Shai Litvak
IPC: G06F3/048 , G06F3/0484 , G06F3/01 , G06F3/0488
Abstract: Operating a computerized system includes presenting user interface elements on a display screen. A first gesture made in a three-dimensional space by a by a distal portion of an upper extremity of a user is detected while a segment of the distal portion thereof rests on a surface. In response to the first gesture, an area of the display screen selected by the user is identified, and a corresponding user interface element is displayed. After displaying the corresponding user interface element, a second gesture made by the distal portion is detected while the segment continues to rest on the surface so as to select one of the user interface elements that appears in the selected area.
-
-
-
-
-
-
-
-
-