公开(公告)号：US08134555B2

公开(公告)日：2012-03-13

申请号：US12105141

申请日：2008-04-17

申请人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

发明人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

IPC分类号： G06T15/00

CPC分类号： G01B11/25

摘要： An apparatus for generating a surface normal map of an object may include a plurality of light sources having intensities that are controllable so as to generate one or more gradient illumination patterns. The light sources are configured and arranged to illuminate the surface of the object with the gradient illumination patterns. A camera may receive light reflected from the illuminated surface of the object, and generate data representative of the reflected light. A processing system may process the data so as to estimate the surface normal map of the surface of the object. A specular normal map and a diffuse normal map of the surface of the object may be generated separately, by placing polarizers on the light sources and in front of the camera so as to illuminate the surface of the object with polarized spherical gradient illumination patterns.

摘要翻译： 用于产生物体的表面法线图的装置可以包括具有可控制的强度的多个光源，以便生成一个或多个梯度照明图案。 光源被配置和布置成用梯度照明图案来照亮物体的表面。 相机可以接收从物体的照射表面反射的光，并产生表示反射光的数据。 处理系统可以处理数据以估计对象表面的表面法线贴图。 物体表面的镜面法线贴图和漫反射法线图可以单独生成，方法是将偏振器放置在光源上并在相机前方，以偏光球形渐变照明图案照射物体表面。

公开(公告)号：US08902232B2

公开(公告)日：2014-12-02

申请号：US12364284

申请日：2009-02-02

申请人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

发明人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

IPC分类号： G06T15/00 ,  G06T13/40

CPC分类号： G06T13/40 ,  G06T2207/30196

摘要： Acquisition, modeling, compression, and synthesis of realistic facial deformations using polynomial displacement maps are described. An analysis phase can be included where the relationship between motion capture markers and detailed facial geometry is inferred. A synthesis phase can be included where detailed animated facial geometry is driven by a sparse set of motion capture markers. For analysis, an actor can be recorded wearing facial markers while performing a set of training expression clips. Real-time high-resolution facial deformations are captured, including dynamic wrinkle and pore detail, using interleaved structured light 3D scanning and photometric stereo. Next, displacements are calculated between a neutral mesh driven by the motion capture markers and the high-resolution captured expressions. These geometric displacements are stored in one or more polynomial displacement maps parameterized according to the local deformations of the motion capture dots. For synthesis, the polynomial displacement maps can be driven with new motion capture data.

摘要翻译： 描述使用多项式位移图的采集，建模，压缩和逼真的面部变形的综合。 可以包括分析阶段，其中推断运动捕捉标记和详细面部几何之间的关系。 可以包括合成阶段，其中详细的动画面部几何由稀疏的运动捕捉标记组驱动。 为了分析，可以在执行一组训练表情剪辑时，记录佩戴面部标记的演员。 捕获实时高分辨率面部变形，包括动态皱纹和细孔细节，使用交错结构光3D扫描和光度立体声。 接下来，在由运动捕捉标记驱动的中性网格和高分辨率捕获表达式之间计算位移。 这些几何位移存储在根据运动捕获点的局部变形参数化的一个或多个多项式位移图中。 为了合成，多项式位移图可以用新的运动捕捉数据驱动。

公开(公告)号：US20090195545A1

公开(公告)日：2009-08-06

申请号：US12364284

申请日：2009-02-02

申请人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

发明人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

IPC分类号： G06T15/70

CPC分类号： G06T13/40 ,  G06T2207/30196

摘要： Acquisition, modeling, compression, and synthesis of realistic facial deformations using polynomial displacement maps are described. An analysis phase can be included where the relationship between motion capture markers and detailed facial geometry is inferred. A synthesis phase can be included where detailed animated facial geometry is driven by a sparse set of motion capture markers. For analysis, an actor can be recorded wearing facial markers while performing a set of training expression clips. Real-time high-resolution facial deformations are captured, including dynamic wrinkle and pore detail, using interleaved structured light 3D scanning and photometric stereo. Next, displacements are calculated between a neutral mesh driven by the motion capture markers and the high-resolution captured expressions. These geometric displacements are stored in one or more polynomial displacement maps parameterized according to the local deformations of the motion capture dots. For synthesis, the polynomial displacement maps can be driven with new motion capture data.

摘要翻译： 描述使用多项式位移图的采集，建模，压缩和逼真的面部变形的综合。 可以包括分析阶段，其中推断运动捕捉标记和详细面部几何之间的关系。 可以包括合成阶段，其中详细的动画面部几何由稀疏的运动捕捉标记组驱动。 为了分析，可以在执行一组训练表情剪辑时，记录佩戴面部标记的演员。 捕获实时高分辨率面部变形，包括动态皱纹和细孔细节，使用交错结构光3D扫描和光度立体声。 接下来，在由运动捕捉标记驱动的中性网格和高分辨率捕获表达式之间计算位移。 这些几何位移存储在根据运动捕获点的局部变形参数化的一个或多个多项式位移图中。 为了合成，多项式位移图可以用新的运动捕捉数据驱动。

公开(公告)号：US20080304081A1

公开(公告)日：2008-12-11

申请号：US12105141

申请日：2008-04-17

申请人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

发明人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

IPC分类号： G01B11/24

CPC分类号： G01B11/25

摘要： An apparatus for generating a surface normal map of an object may include a plurality of light sources having intensities that are controllable so as to generate one or more gradient illumination patterns. The light sources are configured and arranged to illuminate the surface of the object with the gradient illumination patterns. A camera may receive light reflected from the illuminated surface of the object, and generate data representative of the reflected light. A processing system may process the data so as to estimate the surface normal map of the surface of the object. A specular normal map and a diffuse normal map of the surface of the object may be generated separately, by placing polarizers on the light sources and in front of the camera so as to illuminate the surface of the object with polarized spherical gradient illumination patterns.

摘要翻译： 用于产生物体的表面法线图的装置可以包括具有可控制的强度的多个光源，以便生成一个或多个梯度照明图案。 光源被配置和布置成用梯度照明图案来照亮物体的表面。 相机可以接收从物体的被照射表面反射的光，并产生表示反射光的数据。 处理系统可以处理数据以估计对象表面的表面法线贴图。 物体表面的镜面法线贴图和漫反射法线图可以单独生成，方法是将偏振器放置在光源上并在相机前方，以偏光球形渐变照明图案照射物体表面。

公开(公告)号：US20140327748A1

公开(公告)日：2014-11-06

申请号：US13850229

申请日：2013-03-25

申请人： Paul E. Debevec ,  Andrew Jones ,  Mark Bolas ,  Ian McDowall

发明人： Paul E. Debevec ,  Andrew Jones ,  Mark Bolas ,  Ian McDowall

IPC分类号： H04N13/04

CPC分类号： H04N13/302 ,  G02B27/225 ,  H04N13/30 ,  H04N13/305 ,  H04N13/324 ,  H04N13/354 ,  H04N13/363 ,  H04N13/366 ,  H04N13/368 ,  H04N13/373 ,  H04N13/376 ,  H04N13/38

摘要： An interactive, autostereoscopic system for displaying an object in 3D includes a mirror configured to spin around a vertical axis when actuated by a motor, a high speed video projector, and a processing system including a graphics card interfaced to the video projector. An anisotropic reflector is bonded onto an inclined surface of the mirror. The video projector projects video signals of the object from the projector onto the inclined surface of the mirror while the mirror is spinning, so that light rays representing the video signals are redirected toward a field of view of a 360 degree range. The processing system renders the redirected light rays so as to interactively generate a horizontal-parallax 3D display of the object. Vertical parallax can be included in the display by adjusting vertically the displayed views of the object, in response to tracking of viewer motion by a tracking system.

摘要翻译： 用于以3D显示对象的交互式自动立体系统包括：镜子，被构造成当由电动机，高速视频投影仪以及包括与视频投影仪接口连接的显卡的处理系统启动时绕垂直轴旋转。 各向异性反射器粘合在反射镜的倾斜表面上。 视频投影机在镜子旋转时将投影仪的物体的视频信号投影到镜子的倾斜表面上，使得表示视频信号的光线被朝向360度范围的视野被重定向。 处理系统呈现重定向的光线，以交互地产生对象的水平视差3D显示。 响应于跟踪系统跟踪观看者运动，垂直视差可以包括在显示器中，以垂直地调整对象的显示视图。

公开(公告)号：US07044613B2

公开(公告)日：2006-05-16

申请号：US10165359

申请日：2002-06-07

申请人： Paul E. Debevec

发明人： Paul E. Debevec

IPC分类号： G03B15/02

CPC分类号： G03B15/02 ,  G03B15/07 ,  H04N5/2224 ,  H04N5/272 ,  H04N5/275

摘要： An illumination reproduction apparatus and process for illuminating a subject with the illumination at a location in a scene when the subject is not in the scene. Scene illumination data is generated that specifies the illumination at the location in the scene from a plurality of spatial directions. The subject is then illuminated with the illumination at the location in the scene by driving a plurality of light sources surrounding the subject with the scene illumination data.

公开(公告)号：US06919962B2

公开(公告)日：2005-07-19

申请号：US10774173

申请日：2004-02-07

申请人： Paul E. Debevec ,  Andrew J. Gardner ,  Timothy S. Hawkins

发明人： Paul E. Debevec ,  Andrew J. Gardner ,  Timothy S. Hawkins

IPC分类号： G01N21/55 ,  G01N21/57

CPC分类号： G01N21/55 ,  G01N21/57 ,  G01N2021/556

摘要： A reflectometry apparatus and method is presented that allow the diffuse and specular reflectance parameters of an object to be independently and reliably measured, and that allow the variations in surface normal and surface height to be estimated. An extended light source having an elongated configuration, for example a linear cylindrical light source such as a neon tube, is moved across the surface of an object while a digital camera detects the reflected light to acquire a series of images of the object surface. A reflectance trace table is synthesized for a range of model parameters using a virtualized rendition of the linear light source. For each pixel, the observed reflectances are compared to the synthesized reflectance trace table, to determine the reflectance parameters that most closely match the observed data.

摘要翻译： 提出一种反射测量装置和方法，其允许物体的漫反射和镜面反射参数被独立且可靠地测量，并且允许估计表面法线和表面高度的变化。 当数字照相机检测到反射光以获得物体表面的一系列图像时，具有细长构造的延伸光源（例如诸如氖管的线性圆柱形光源）被移动穿过物体的表面。 使用线性光源的虚拟化再现，针对范围的模型参数合成反射率轨迹表。 对于每个像素，将观察到的反射率与合成的反射率轨迹表进行比较，以确定与观测数据最接近的反射参数。

公开(公告)号：US09562857B2

公开(公告)日：2017-02-07

申请号：US14212751

申请日：2014-03-14

申请人： Paul E. Debevec ,  Xueming Yu ,  Graham Leslie Fyffe ,  Abhijeet Ghosh

发明人： Paul E. Debevec ,  Xueming Yu ,  Graham Leslie Fyffe ,  Abhijeet Ghosh

IPC分类号： G01N21/55 ,  G01B11/30 ,  G01B11/25

CPC分类号： G01N21/55 ,  G01B11/25 ,  G01B11/30

摘要： An apparatus to measure surface orientation maps of an object may include a light source that is configured to illuminate the object with a controllable field of illumination. One or more cameras may be configured to capture at least one image of the object. A processor may be configured to process the image(s) to extract the reflectance properties of the object including an albedo, a reflection vector, a roughness, and/or anisotropy parameters of a specular reflectance lobe associated with the object. The controllable field of illumination may include limited-order Spherical Harmonics (SH) and Fourier Series (FS) illumination patterns with substantially similar polarization. The SH and FS illumination patterns are used with different light sources.

摘要翻译： 用于测量物体的表面取向图的装置可以包括配置成用可控制的照明场照射物体的光源。 一个或多个摄像机可以被配置为捕获对象的至少一个图像。 处理器可以被配置为处理图像以提取对象的反射特性，包括与对象相关联的镜面反射率波瓣的反照率，反射矢量，粗糙度和/或各向异性参数。 可控的照明领域可以包括具有基本相似极化的有限次球面谐波（SH）和傅里叶级数（FS）照明图案。 SH和FS照明图案与不同的光源一起使用。

公开(公告)号：US20160261850A1

公开(公告)日：2016-09-08

申请号：US14640813

申请日：2015-03-06

申请人： Paul E. Debevec ,  Graham Leslie Fyffe

发明人： Paul E. Debevec ,  Graham Leslie Fyffe

IPC分类号： H04N13/02 ,  G06T15/04 ,  G06K9/00

CPC分类号： H04N13/243 ,  G06K9/00221 ,  G06T15/04 ,  G06T2207/10012 ,  G06T2215/12 ,  H04N13/254 ,  H04N13/257 ,  H04N13/296

摘要： A system may almost instantly capturing high-resolution geometry and reflectance data of a portion of a human subject. The system may include multiple cameras, each oriented to controllably capture an image of the portion of the human subject from a different location in space; multiple lights, each oriented to controllably illuminate the portion of the human subject from a location in space significantly different than the location in space of the other lights; and a controller. The controller may divide the cameras into subgroups with each subgroup of cameras containing at least one camera and with each camera belonging to only one of the subgroups; cause each subgroup of cameras to sequentially capture a single image of the portion of the human subject; and cause at least one of the lights to light while each subgroup of cameras captures a single image of the portion of the human subject. The system may include an image processing system that generates the high resolution geometry and reflectance data based on only one image from each camera.A polarizing optical element may be between each camera and the portion of the human subject. A polarizer filter may be between each light and the portion of the human subject. A controller may cause all of the cameras to simultaneously capture a single image of the portion of the human subject while the portion of the human subject is illuminated by all of the lights. The specular reflections from the portion of the human subject that are captured by one of the cameras may have a color distribution across the portion of the human subject that is different than the specular reflections from the portion of the human subject that are captured by another of the cameras.

摘要翻译： 系统可以几乎立即捕获人类对象的一部分的高分辨率几何和反射率数据。 该系统可以包括多个相机，每个相机定向成从空间中的不同位置可控地捕获人物对象的部分的图像; 多个灯，每个灯定向为可控地照射来自与其他灯的空间中的位置明显不同的空间中的人物的部分; 和控制器。 控制器可以将摄像机分成子组，每个摄像机子组包含至少一个照相机，每个照相机仅属于一个子组; 使每个摄像机子组顺序地捕获人类对象部分的单个图像; 并且使得至少一个灯点亮，而每个照相机子组拍摄人物对象的该部分的单个图像。 该系统可以包括基于来自每个相机的仅一个图像生成高分辨率几何形状和反射率数据的图像处理系统。 偏振光学元件可以在每个照相机和人类对象的部分之间。 偏振器滤光器可以在每个光和人对象的部分之间。 控制器可以使得所有摄像机同时捕获人类对象的一部分的单个图像，同时人体对象的部分被所有的灯照亮。 来自人类对象的由相机中的一个拍摄的部分的镜面反射可以具有穿过人类受试者的部分的颜色分布，该颜色分布不同于来自人类对象的部分的镜面反射，其被另一个 相机。

公开(公告)号：US08432436B2

公开(公告)日：2013-04-30

申请号：US12105120

申请日：2008-04-17

申请人： Paul E. Debevec ,  Andrew Jones ,  Mark Bolas ,  Ian McDowall

发明人： Paul E. Debevec ,  Andrew Jones ,  Mark Bolas ,  Ian McDowall

IPC分类号： H04N13/04

CPC分类号： H04N13/302 ,  G02B27/225 ,  H04N13/30 ,  H04N13/305 ,  H04N13/324 ,  H04N13/354 ,  H04N13/363 ,  H04N13/366 ,  H04N13/368 ,  H04N13/373 ,  H04N13/376 ,  H04N13/38

摘要： An interactive, autostereoscopic system for displaying an object in 3D includes a mirror configured to spin around a vertical axis when actuated by a motor, a high speed video projector, and a processing system including a graphics card interfaced to the video projector. An anisotropic reflector is bonded onto an inclined surface of the mirror. The video projector projects video signals of the object from the projector onto the inclined surface of the mirror while the mirror is spinning, so that light rays representing the video signals are redirected toward a field of view of a 360 degree range. The processing system renders the redirected light rays so as to interactively generate a horizontal-parallax 3D display of the object. Vertical parallax can be included in the display by adjusting vertically the displayed views of the object, in response to tracking of viewer motion by a tracking system.

摘要翻译： 用于以3D显示对象的交互式自动立体系统包括：镜子，被构造成当由电动机，高速视频投影仪以及包括与视频投影仪接口连接的显卡的处理系统启动时绕垂直轴旋转。 各向异性反射器粘合在反射镜的倾斜表面上。 视频投影机在镜子旋转时将投影仪的物体的视频信号投影到镜子的倾斜表面上，使得表示视频信号的光线被朝向360度范围的视野被重定向。 处理系统呈现重定向的光线，以交互地产生对象的水平视差3D显示。 响应于跟踪系统跟踪观看者运动，垂直视差可以包括在显示器中，以垂直地调整对象的显示视图。