Scene capturing and view rendering based on a longitudinally aligned camera array

    公开(公告)号:US07542073B2

    公开(公告)日:2009-06-02

    申请号:US10970233

    申请日:2004-10-21

    CPC classification number: H04N13/279 H04N13/221 H04N13/243

    Abstract: In one embodiment, a longitudinal camera array is rotated through a capture cylinder, with each camera in the array capturing multiple images as the array rotates. These images can be looking outward along the radials of the cylinder, or alternatively looking tangential to the cylinder. The longitudinal camera array allows the surrounding scene to be captured from multiple different planes that are substantially parallel to the ends of the capture cylinder, allowing for more accurate subsequent rendering of the scene. A view of the scene can be subsequently rendered by determining a location and direction of view of an observer, and then selecting one or more of the multiple lateral and longitudinally adjacent capture images, as well as one or more pixels within that capture image(s), to use to determine a display value for the pixel.

    Scene capturing and view rendering based on a longitudinally aligned camera array
    62.
    发明授权
    Scene capturing and view rendering based on a longitudinally aligned camera array 有权
    基于纵向对齐的摄像机阵列的场景捕获和视图渲染

    公开(公告)号:US07538797B2

    公开(公告)日:2009-05-26

    申请号:US10970511

    申请日:2004-10-21

    CPC classification number: H04N13/279 H04N13/221 H04N13/243

    Abstract: In one embodiment, a longitudinal camera array is rotated through a capture cylinder, with each camera in the array capturing multiple images as the array rotates. These images can be looking outward along the radials of the cylinder, or alternatively looking tangential to the cylinder. The longitudinal camera array allows the surrounding scene to be captured from multiple different planes that are substantially parallel to the ends of the capture cylinder, allowing for more accurate subsequent rendering of the scene. A view of the scene can be subsequently rendered by determining a location and direction of view of an observer, and then selecting one or more of the multiple lateral and longitudinally adjacent capture images, as well as one or more pixels within that capture image(s), to use to determine a display value for the pixel.

    Abstract translation: 在一个实施例中,纵向相机阵列旋转通过捕获圆筒,阵列中的每个相机在阵列中捕获多个图像。 这些图像可以沿着圆柱体的径向向外看,或者与圆筒相切地看。 纵向相机阵列允许从基本上平行于捕获圆筒的端部的多个不同平面捕获周围场景,从而允许更准确地随后渲染场景。 可以随后通过确定观察者的位置和方向,然后选择多个横向和纵向相邻捕获图像中的一个或多个,以及该捕获图像内的一个或多个像素来呈现场景视图 ),用于确定像素的显示值。

    Push-to-talk communications in computing environments
    63.
    发明授权
    Push-to-talk communications in computing environments 失效
    计算环境中的一键通讯

    公开(公告)号:US07536191B2

    公开(公告)日:2009-05-19

    申请号:US11172658

    申请日:2005-07-01

    Applicant: Chong Luo Jiang Li

    Inventor: Chong Luo Jiang Li

    CPC classification number: H04L65/4061

    Abstract: Described is a communication mechanism that provides push-to-talk functionality for mobile and desktop computing environments. Mobile and desktop computers are configured as client computers in a client/server architecture. Some of the client computers are configured to handle multiple push-to-talk sessions simultaneously. If multiple streams from different sessions are active at the same time, the client computer may determine which of these overlapped streams to record and then record them for later playback. A server handles the registration of the client computers, manages the multiple sessions for each of the client computers, and performs a floor control process so that each push-to-talk session operates in a half-duplex mode.

    Abstract translation: 描述了为移动和桌面计算环境提供一键通功能的通信机制。 移动和桌面计算机被配置为客户机/服务器架构中的客户端计算机。 一些客户端计算机被配置为同时处理多个即按即说会话。 如果来自不同会话的多个流同时处于活动状态,则客户端计算机可以确定要记录的这些重叠流中的哪一个,然后将其记录以供稍后播放。 服务器处理客户端计算机的注册,管理每个客户端计算机的多个会话,并执行楼层控制过程,以便每个即按即说会话都以半双工模式运行。

    System and method for calibrating multiple cameras without employing a pattern by inter-image homography
    65.
    发明授权
    System and method for calibrating multiple cameras without employing a pattern by inter-image homography 失效
    用于校准多个摄像机的系统和方法,而不通过图像间单张照相采用图案

    公开(公告)号:US07512261B2

    公开(公告)日:2009-03-31

    申请号:US10923150

    申请日:2004-08-19

    CPC classification number: G06K9/209 G06T7/80

    Abstract: Interactive multi-view video presents new types of video capture systems, video formats, video compression algorithms, and services. Many video cameras are allocated to capture an event from various related locations and directions. The captured videos are compressed in control PCs and are sent to a server in real-time. Users can subscribe to a new type of service that allows users to connect to the servers and receive multi-view videos interactively. In one embodiment of the invention, an automatic pattern-free calibration tool is employed to calibrate the multiple cameras. In contrast with a pattern-based method which uses the correspondences between image points and pattern points, the pattern-free calibration method is based on the correspondences between image points from different views.

    Abstract translation: 交互式多视图视频呈现新型的视频捕获系统,视频格式,视频压缩算法和服务。 许多摄像机被分配以捕获来自各种相关位置和方向的事件。 捕获的视频在控制PC中被压缩,并被实时发送到服务器。 用户可以订阅一种新的服务类型,允许用户连接到服务器并以交互方式接收多视图视频。 在本发明的一个实施例中,采用自动无花纹校准工具来校准多个照相机。 与使用图像点和图案点之间的对应关系的基于图案的方法相比,无图案校准方法基于来自不同视图的图像点之间的对应关系。

    Distributed Kernel Density Estimation
    66.
    发明申请
    Distributed Kernel Density Estimation 有权
    分布式核密度估计

    公开(公告)号:US20080313188A1

    公开(公告)日:2008-12-18

    申请号:US11763285

    申请日:2007-06-14

    CPC classification number: H04L67/14 G06K9/6226 G06K9/6298 H04L67/10

    Abstract: The described systems and methods can be used to estimate the global distributed kernel density without prior information of data using a gossip based method. In the gossip based method, a node in a distributed network periodically selects and exchanges kernels with a random node in the network. After exchanging, both the initiating and the target node use the received kernels to update their local estimates. In addition, a data reduction method can be used to optimize the size of the kernel set at each node.

    Abstract translation: 所描述的系统和方法可以用于使用基于八卦的方法来估计全局分布式核密度,而无需使用数据的先验信息。 在基于八卦的方法中,分布式网络中的节点周期性地选择并与网络中的随机节点交换内核。 交换后,启动节点和目标节点都使用接收到的内核来更新其本地估计。 此外,可以使用数据简化方法来优化每个节点处的内核集的大小。

    Streaming Media Codec with Transform Coefficient Bounding
    67.
    发明申请
    Streaming Media Codec with Transform Coefficient Bounding 有权
    流媒体编解码器与变换系数边界

    公开(公告)号:US20080219345A1

    公开(公告)日:2008-09-11

    申请号:US11682684

    申请日:2007-03-06

    Applicant: Jiang Li Hua Cai

    Inventor: Jiang Li Hua Cai

    CPC classification number: H04L65/607 H04N19/61

    Abstract: A streaming media codec may include a collection of media stream processing modules arranged into a processing graph. One or more of the modules may perform a Fourier-related transform, and a significant fraction of media stream processing may occur post-transform. The media stream may be considered as a sequence of processing blocks, and post-transform processing blocks contain transform coefficients. Such transform coefficients are amenable to classification into processing classes. Some processing classes may require significantly less processing effort than others by post-transform processing modules. Such transform coefficient classes may be efficiently specified, for example, with coefficient bounding rectangles, and the specification provided to one or more post-transform streaming media processing modules to enable the modules to allocate their processing resources more effectively. Streaming media processing modules making effective use of the transform coefficient class information, and streaming media codecs that incorporate them, are called transform coefficient bounding (TCB) enhanced.

    Abstract translation: 流媒体编解码器可以包括布置在处理图中的媒体流处理模块的集合。 一个或多个模块可以执行傅立叶相关变换,并且在变换后可能发生很大一部分媒体流处理。 媒体流可以被认为是一系列处理块,后变换处理块包含变换系数。 这种变换系数适合于分类为处理类。 通过后变换处理模块,某些处理类可能需要比其他处理类更少的处理能力。 可以例如利用系数边界矩形有效地指定这种变换系数类,并且将规范提供给一个或多个后变换流媒体处理模块,以使得模块能够更有效地分配其处理资源。 使用有效利用变换系数类信息的流媒体处理模块和结合它们的流媒体编解码器被称为增强的变换系数边界(TCB)。

    Epipolar geometry-based motion estimation for multi-view image and video coding
    68.
    发明申请
    Epipolar geometry-based motion estimation for multi-view image and video coding 有权
    用于多视图图像和视频编码的基于双极几何的运动估计

    公开(公告)号:US20080172384A1

    公开(公告)日:2008-07-17

    申请号:US11653587

    申请日:2007-01-16

    CPC classification number: G06T7/292 G06T7/238 G06T2207/10016 G06T2207/20088

    Abstract: Described is fast motion estimation based upon epipolar geometry, which can be used in compressing multi-view video. An epipolar line is computed based on a point (e.g., a centroid point) in a macroblock to be predicted, and a temporary starting point in an image is determined, such as a median predicted search center. A search starting point is further determined based on the temporary starting point and the epipolar line, e.g., a point on the epipolar line corresponding to an intersecting line that is projected orthogonally from the temporary point to the epipolar line. A motion estimation mechanism searches the search space to produce a motion vector. The search may be conducted starting at the search starting point in a reduced search area located around the epipolar line, e.g., a local diamond search and/or rotated unsymmetrical rood-pattern search.

    Abstract translation: 描述了基于对极几何的快速运动估计,可用于压缩多视图视频。 基于要预测的宏块中的点(例如,质心点)计算核线,并且确定图像中的临时起始点,诸如中值预测搜索中心。 基于临时起点和核线,进一步确定搜索起始点,例如对应于从临时点到对极线正交投影的相交线的对极线上的点。 运动估计机制搜索搜索空间以产生运动矢量。 搜索可以在位于核线附近的缩小搜索区域的搜索起点开始进行,例如本地菱形搜索和/或旋转的不对称轮廓图案搜索。

    Low Complexity Real-time Video Coding
    69.
    发明申请
    Low Complexity Real-time Video Coding 有权
    低复杂度实时视频编码

    公开(公告)号:US20080159409A1

    公开(公告)日:2008-07-03

    申请号:US12047837

    申请日:2008-03-13

    Abstract: In a first exemplary media implementation, one or more processor-accessible media include processor-executable instructions that, when executed, direct a device to perform actions including: comparing an accuracy indicator to at least one threshold, the accuracy indicator corresponding to a reference macroblock selected for a target macroblock; ascertaining a refinement case from multiple refinement cases based on the comparing, each refinement case of the multiple refinement cases defining multiple test points in relation to the reference macroblock; and analyzing the ascertained refinement case with regard to the target macroblock. In a second exemplary media implementation, one or more media include processor-executable instructions that, when executed, direct a device to perform actions including: determining if two chrominance sums have magnitudes that are each less than a first product and four luminance sums have magnitudes that are each less than a second product; and if so, forwarding all zero values for a macroblock.

    Abstract translation: 在第一示例性媒体实现中,一个或多个处理器可访问媒体包括处理器可执行指令,其在被执行时指示设备执行动作,包括:将精度指示符与至少一个阈值进行比较,对应于参考宏块 为目标宏块选择; 基于所述比较确定来自多个细化情况的细化情况,所述多个细化情况相对于所述参考宏块定义多个测试点的多个细化情况的每个细化情况; 并且针对目标宏块分析确定的细化情况。 在第二示例性媒体实现中,一个或多个媒体包括处理器可执行指令,其在被执行时指示设备执行动作,包括:确定两个色度和是否具有小于第一乘积的量值,并且四个亮度和具有大小 每个都不到第二个产品; 如果是,转发宏块的所有零值。

    Bi-level and full-color video combination for video communication
    70.
    发明授权
    Bi-level and full-color video combination for video communication 有权
    双级和全色视频组合,用于视频通信

    公开(公告)号:US07359004B2

    公开(公告)日:2008-04-15

    申请号:US10445310

    申请日:2003-05-23

    CPC classification number: H04L12/5602

    Abstract: Systems and methods for video communication are described. In one aspect, network bandwidth conditions are estimated. Bi-level or full-color video is then transmitted over the network at transmission bit rates that are controlled as a function of the estimated bandwidth conditions. To this end, network bandwidth capability is periodically probed to identify similar, additional, or decreased bandwidth capabilities as compared to the estimated bandwidth conditions. Decisions to hold, decrease, or increase the video transmission bit rate are made based on the estimated bandwidth conditions in view of the probing operations. When the transmission bit rate is increased or decreased, the transmission bit rate is calculated to target an upper or lower bit rate, both of which are indicated by the estimated bandwidth conditions. Bi-level video communication is switched to full-color video transmission, or vice versa, when the video transmission bit rate respectively reaches the upper bit rate or the lower bit rate.

    Abstract translation: 描述视频通信的系统和方法。 在一个方面,估计网络带宽条件。 然后以传输比特速率通过网络传输双电平或全色视频,该传输比特率作为估计的带宽条件的函数来控制。 为此,与估计的带宽条件相比,周期性地探测网络带宽能力以识别类似的,附加的或降低的带宽能力。 鉴于探测操作,基于估计的带宽条件进行保持,减少或增加视频传输比特率的决定。 当传输比特率增加或减少时,传输比特率被计算为针对上限或更低比特率,两者都由估计的带宽条件指示。 当视频传输比特率分别达到较高比特率或较低比特率时,双级视频通信切换到全色视频传输,反之亦然。

Patent Agency Ranking