公开(公告)号：US08760551B2

公开(公告)日：2014-06-24

申请号：US13039016

申请日：2011-03-02

Applicant: John S. Haikin ,  Francisco Imai

Inventor： John S. Haikin ,  Francisco Imai

IPC: H04N5/222 ,  H04N5/76

CPC classification number: H04N5/23293 ,  G06K9/00308 ,  H04N1/00167 ,  H04N1/00336 ,  H04N1/00381 ,  H04N1/32101 ,  H04N1/32144 ,  H04N5/23219 ,  H04N5/772 ,  H04N9/8205 ,  H04N9/8227 ,  H04N2101/00 ,  H04N2201/3225 ,  H04N2201/3274

Abstract: An image capturing apparatus, method, and storage medium identifying image metadata based on user interest. The image capturing apparatus includes a first image capturing unit configured to capture an image of a scene for a user, a second image capturing unit configured to capture an image of the user, an identification unit configured to identify at least one region of interest of the scene based on a combination of eye and facial characteristics of the user of the image capturing apparatus during an image capturing operation, a processing unit configured to analyze at least facial characteristics of the user associated with each region of interest during the image capturing operation, a determining unit configured to determine a facial expression classification associated with each region of interest based on corresponding analyzed facial characteristics for each region during the image capturing operation, a recording unit configured to record facial expression metadata based on information representing the at least one region of interest and the facial expression classification associated with an image captured during the image capturing operation, and a rendering unit configured to render the image using the recorded facial expression metadata.

Abstract translation: 基于用户兴趣识别图像元数据的图像捕获设备，方法和存储介质。 所述图像拍摄装置包括被配置为捕获用户的场景的图像的第一图像拍摄单元，被配置为捕获用户的图像的第二图像拍摄单元，被配置为识别所述用户的至少一个感兴趣区域的识别单元 在图像拍摄操作期间基于图像捕获装置的用户的眼睛和面部特征的组合的场景，处理单元，被配置为在图像拍摄操作期间至少分析与每个感兴趣区域相关联的用户的面部特征， 确定单元，被配置为基于在图像拍摄操作期间针对每个区域的对应分析的面部特征来确定与每个感兴趣区域相关联的面部表情分类;记录单元，其被配置为基于表示所述至少一个感兴趣区域的信息记录面部表情元数据 和面部表情分类关联 d，其中在图像拍摄操作期间捕获图像，以及呈现单元，被配置为使用记录的面部表情元数据呈现图像。

公开(公告)号：US20110273466A1

公开(公告)日：2011-11-10

申请号：US13046674

申请日：2011-03-11

Applicant: Francisco Imai ,  John S. Haikin

Inventor： Francisco Imai ,  John S. Haikin

IPC: G09G5/02 ,  G09G5/00

CPC classification number: G09G3/20 ,  G09G3/003 ,  G09G2320/0626 ,  G09G2320/0666 ,  G09G2340/0407 ,  G09G2354/00

Abstract: An image is displayed by determining a relative position and orientation of a display in relation to a viewer's head, and rendering an image based on the relative position and orientation. The viewer's eye movement relative to the rendered image is tracked, with at least one area of interest in the image to the viewer being determined based on the viewer's eye movement, and an imaging property of the at least one area of interest is adjusted. Computer-generated data is obtained for display based on the at least one area of interest. At least one imaging property of the computer-generated data is adjusted according to the at least one imaging property that was adjusted for the at least one area of interest and the computer-generated data is displayed in the at least one area of interest along with a section of the image displayed in the at least one area of interest.

Abstract translation: 通过确定显示器相对于观看者的头部的相对位置和方位，以及基于相对位置和方向呈现图像来显示图像。 跟踪观看者相对于呈现的图像的眼睛运动，基于观看者的眼睛运动确定图像中至少一个感兴趣的区域，并且调整该至少一个感兴趣区域的成像属性。 获得基于至少一个感兴趣区域显示的计算机生成的数据。 计算机生成数据的至少一个成像属性根据针对至少一个感兴趣区域调整的至少一个成像属性进行调整，并且将计算机生成的数据显示在至少一个感兴趣的区域中以及 显示在所述至少一个感兴趣区域中的图像的一部分。

公开(公告)号：US20110273731A1

公开(公告)日：2011-11-10

申请号：US12977846

申请日：2010-12-23

Applicant: John S. Haikin ,  Francisco Imai

Inventor： John S. Haikin ,  Francisco Imai

IPC: G06F15/00 ,  G06F3/033

CPC classification number: G06F3/013 ,  G06F3/012

Abstract: An image selected to be printed is rendered for display, prior to printing, based on the relative position and orientation of a display in relation to a user's head, where the displayed rendered image is a representation of what the rendered image will look like when printed. The user's eye movement relative to the rendered image is tracked, with at least one area of interest in the image to the viewer being determined based on the viewer's eye movement, an imaging property of the at least one area of interest is adjusted, the image to be printed is rendered based on adjusting the imaging property, and the image is printed.

Abstract translation: 基于相对于用户头部的显示器的相对位置和方向，在打印之前，选择要打印的图像被渲染以进行显示，其中所显示的渲染图像是当打印时所呈现的图像将看起来像什么的表示 。 跟踪用户相对于渲染图像的眼睛运动，基于观看者的眼睛运动来确定图像中至少一个对观看者感兴趣的区域，调整至少一个感兴趣区域的成像属性，图像 基于调整成像特性来进行打印，并且打印图像。

公开(公告)号：US20110273369A1

公开(公告)日：2011-11-10

申请号：US12776842

申请日：2010-05-10

Applicant: Francisco Imai ,  John S. Haikin

Inventor： Francisco Imai ,  John S. Haikin

IPC: G06F3/033

CPC classification number: G06T15/20 ,  G06F3/04845 ,  G06T15/50 ,  G06T2215/16

Abstract: An image is displayed by determining a relative position and orientation of a display in relation to a viewer's head, and rendering an image based on the relative position and orientation. The viewer's eye movement relative to the rendered image is tracked, with at least one area of interest in the image to the viewer being determined based on the viewer's eye movement, and an imaging property of the at least one area of interest is adjusted.

Abstract translation: 通过确定显示器相对于观看者的头部的相对位置和方位，以及基于相对位置和方向呈现图像来显示图像。 跟踪观看者相对于呈现的图像的眼睛运动，基于观看者的眼睛运动确定图像中至少一个感兴趣的区域，并且调整该至少一个感兴趣区域的成像属性。

公开(公告)号：US20120224077A1

公开(公告)日：2012-09-06

申请号：US13039016

申请日：2011-03-02

Applicant: Francisco Imai ,  John S. Haikin

Inventor： Francisco Imai ,  John S. Haikin

IPC: G06K9/62 ,  H04N5/228

CPC classification number: H04N5/23293 ,  G06K9/00308 ,  H04N1/00167 ,  H04N1/00336 ,  H04N1/00381 ,  H04N1/32101 ,  H04N1/32144 ,  H04N5/23219 ,  H04N5/772 ,  H04N9/8205 ,  H04N9/8227 ,  H04N2101/00 ,  H04N2201/3225 ,  H04N2201/3274

Abstract: An image capturing apparatus, method, and storage medium identifying image metadata based on user interest. The image capturing apparatus includes a first image capturing unit configured to capture an image of a scene for a user, a second image capturing unit configured to capture an image of the user, an identification unit configured to identify at least one region of interest of the scene based on a combination of eye and facial characteristics of the user of the image capturing apparatus during an image capturing operation, a processing unit configured to analyze at least facial characteristics of the user associated with each region of interest during the image capturing operation, a determining unit configured to determine a facial expression classification associated with each region of interest based on corresponding analyzed facial characteristics for each region during the image capturing operation, a recording unit configured to record facial expression metadata based on information representing the at least one region of interest and the facial expression classification associated with an image captured during the image capturing operation, and a rendering unit configured to render the image using the recorded facial expression metadata.

Abstract translation: 基于用户兴趣识别图像元数据的图像捕获设备，方法和存储介质。 所述图像拍摄装置包括被配置为捕获用户的场景的图像的第一图像拍摄单元，被配置为捕获用户的图像的第二图像拍摄单元，被配置为识别所述用户的至少一个感兴趣区域的识别单元 在图像拍摄操作期间基于图像捕获装置的用户的眼睛和面部特征的组合的场景，处理单元，被配置为在图像拍摄操作期间至少分析与每个感兴趣区域相关联的用户的面部特征， 确定单元，被配置为基于在图像拍摄操作期间针对每个区域的对应分析的面部特征来确定与每个感兴趣区域相关联的面部表情分类;记录单元，其被配置为基于表示所述至少一个感兴趣区域的信息记录面部表情元数据 和面部表情分类关联 d，其中在图像拍摄操作期间捕获图像，以及呈现单元，被配置为使用记录的面部表情元数据呈现图像。

公开(公告)号：US08558923B2

公开(公告)日：2013-10-15

申请号：US12772841

申请日：2010-05-03

Applicant: Francisco Imai

Inventor： Francisco Imai

IPC: H04N5/262

CPC classification number: H04N5/23212 ,  G10L15/26

Abstract: An image capturing apparatus and method for selective real-time focus/parameter adjustment. The image capturing apparatus includes a display unit, an adjustment unit, and a generation unit. The display unit is configured to display an image. The interface unit is configured to enable a user to select a plurality of regions of the image displayed on the display unit. The adjustment unit is configured to enable the user to adjust at least one focus/parameter of at least one selected region of the image displayed on the display unit. The generation unit is configured to convert the image including at least one adjusted selected region into image data, where at least one focus/parameter of the at least one adjusted selected region has been adjusted by the adjustment unit prior to conversion.

Abstract translation: 用于选择性实时对焦/参数调整的图像捕获装置和方法。 摄像装置包括显示单元，调整单元和生成单元。 显示单元被配置为显示图像。 接口单元被配置为使得用户能够选择显示在显示单元上的图像的多个区域。 调整单元被配置为使得用户能够调整显示在显示单元上的图像的至少一个选定区域的至少一个焦点/参数。 生成单元被配置为将包括至少一个经调整的所选择的区域的图像转换为图像数据，其中在转换之前由调整单元调整了至少一个经调整的所选区域的至少一个焦点/参数。

公开(公告)号：US20130088612A1

公开(公告)日：2013-04-11

申请号：US13269537

申请日：2011-10-07

Applicant: Francisco Imai

Inventor： Francisco Imai

IPC: H04N5/228 ,  H04N9/07 ,  H04N5/225

CPC classification number: H04N5/2254 ,  H04N5/238 ,  H04N9/045

Abstract: Image capture using an image capture device that includes an imaging assembly having a spectral sensitivity tunable in accordance with a spectral capture mask, and imaging optics having a polarization filter tunable in accordance with a polarization control mask for projecting an image of a scene onto the imaging assembly. A default polarization control mask is applied to the imaging optics, and a default spectral capture mask is applied to the imaging assembly. An image of the scene is captured using the imaging assembly.

Abstract translation: 使用包括具有根据光谱捕获掩模可调谐的光谱灵敏度的成像组件的图像捕获装置的图像捕捉，以及具有根据偏振控制掩模可调谐的偏振滤波器的成像光学器件，用于将场景的图像投影到成像 部件。 将默认偏振控制掩模应用于成像光学元件，并且将默认光谱捕获掩模应用于成像组件。 使用成像组件捕获场景的图像。

公开(公告)号：US20120069221A1

公开(公告)日：2012-03-22

申请号：US12886075

申请日：2010-09-20

Applicant: Francisco Imai

Inventor： Francisco Imai

IPC: H04N9/68

CPC classification number: H04N5/58 ,  G09G3/20 ,  G09G3/3611 ,  G09G2320/0626 ,  G09G2320/0666 ,  G09G2330/02 ,  G09G2360/144 ,  G09G2360/16 ,  H04N5/23241

Abstract: An image capture device includes an image sensor for capturing image data of a scene, and a display screen for displaying a preview of the captured image of the scene. Additionally, the image capture device includes a photovoltaic solar cell for outputting electrical energy responsive to environmental lighting conditions. A control section determines whether the image capture device is or is not currently being used in a bright environment. Responsive to a determination that the image capture device is currently being used in a bright environment, the control section increases brightness of the display screen, and switches electrical energy outputted from the photovoltaic cell for use by the display screen.

Abstract translation: 图像捕捉装置包括用于拍摄场景的图像数据的图像传感器和用于显示场景的拍摄图像的预览的显示屏幕。 此外，图像捕获装置包括用于响应于环境照明条件输出电能的光伏太阳能电池。 控制部分确定在明亮的环境中图像捕捉装置是否正在使用中。 响应于在明亮的环境中当前正在使用图像捕获装置的确定，控制部分增加显示屏的亮度，并且切换由显示屏使用的光伏电池输出的电能。

公开(公告)号：US20110267531A1

公开(公告)日：2011-11-03

申请号：US12772841

申请日：2010-05-03

Applicant: Francisco Imai

Inventor： Francisco Imai

IPC: H04N5/222 ,  G10L17/00 ,  G06F3/041

CPC classification number: H04N5/23212 ,  G10L15/26

Abstract: An image capturing apparatus and method for selective real-time focus/parameter adjustment. The image capturing apparatus includes a display unit, an adjustment unit, and a generation unit. The display unit is configured to display an image. The interface unit is configured to enable a user to select a plurality of regions of the image displayed on the display unit. The adjustment unit is configured to enable the user to adjust at least one focus/parameter of at least one selected region of the image displayed on the display unit. The generation unit is configured to convert the image including at least one adjusted selected region into image data, where at least one focus/parameter of the at least one adjusted selected region has been adjusted by the adjustment unit prior to conversion.

Abstract translation: 用于选择性实时对焦/参数调整的图像捕获装置和方法。 摄像装置包括显示单元，调整单元和生成单元。 显示单元被配置为显示图像。 接口单元被配置为使得用户能够选择显示在显示单元上的图像的多个区域。 调整单元被配置为使得用户能够调整显示在显示单元上的图像的至少一个选定区域的至少一个焦点/参数。 生成单元被配置为将包括至少一个经调整的所选择的区域的图像转换为图像数据，其中在转换之前由调整单元调整了至少一个经调整的所选区域的至少一个焦点/参数。

公开(公告)号：US20100128112A1

公开(公告)日：2010-05-27

申请号：US12323789

申请日：2008-11-26

Applicant: Stefan Marti ,  Francisco Imai ,  Seung Wook Kim

Inventor： Stefan Marti ,  Francisco Imai ,  Seung Wook Kim

IPC: H04N13/00 ,  G06K9/00

CPC classification number: G06F3/012 ,  G06F3/011 ,  G06F3/016 ,  H04N13/366

Abstract: A system for displaying three-dimensional (3-D) content and enabling a user to interact with the content in an immersive, realistic environment is described. The system has a display component that is non-planar and provides the user with an extended field-of-view (FOV), one factor in the creating the immersive user environment. The system also has a tracking sensor component for tracking a user face. The tracking sensor may include one or more 3-D and 2-D cameras. In addition to tracking the face or head, it may also track other body parts, such as hands and arms. An image perspective adjustment module processes data from the face tracking and enables the user to perceive the 3-D content with motion parallax. The hand and other body part output data is used by gesture detection modules to detect collisions between the user's hand and 3-D content. When a collision is detected, there may be tactile feedback to the user to indicate that there has been contact with a 3-D object. All these components contribute towards creating an immersive and realistic environment for viewing and interacting with 3-D content.

Abstract translation: 描述了一种用于显示三维（3-D）内容并使用户能够在沉浸式，逼真的环境中与内容交互的系统。 该系统具有非平面的显示组件，并为用户提供扩展视野（FOV），这是创建沉浸式用户环境的一个因素。 该系统还具有跟踪用户面部的跟踪传感器部件。 跟踪传感器可以包括一个或多个3-D和2-D相机。 除了跟踪脸部或头部之外，它还可以跟踪其他身体部位，如手和手臂。 图像透视调整模块处理来自面部跟踪的数据，并且使得用户能够利用运动视差来感知3-D内容。 手部和其他身体部位输出数据由手势检测模块用于检测用户手和3-D内容之间的碰撞。 当检测到碰撞时，可能有触觉反馈给用户以指示已经接触到3-D物体。 所有这些组件都有助于创建一个沉浸式和逼真的环境，用于查看和与3D内容进行交互。