-
公开(公告)号：US12088932B2
公开(公告)日：2024-09-10
申请号：US18168521
申请日：2023-02-13
发明人： Ramesh Panchagnula , David Cole , Alan Moss
IPC分类号： H04N23/951 , G06T19/00 , H04N19/587
CPC分类号： H04N23/951 , G06T19/00 , H04N19/587
摘要： Methods and apparatus for capturing, communicating and using image data to support virtual reality experiences are described. Images, e.g., frames, are captured at a high resolution but lower frame rate than is used for playback. Interpolation is applied to captured frames to generate interpolated frames. Captured frames, along with interpolated frame information, are communicated to the playback device. The combination of captured and interpolated frames correspond to a second frame playback rate which is higher than the image capture rate. Cameras operate at a high image resolution but slower frame rate than images could be captured with the same cameras at a lower resolution. Interpolation is performed prior to delivery to the user device with segments to be interpolated being selected based on motion and/or lens FOV information. A relatively small amount of interpolated frame data is communicated compared to captured frame data for efficient bandwidth use.
-
公开(公告)号：US11470299B2
公开(公告)日：2022-10-11
申请号：US17032554
申请日：2020-09-25
发明人： Ramesh Panchagnula , Alan Moss
IPC分类号： H04N13/161 , H04N13/194 , H04N13/00
摘要： A method and system for encoding a stereoscopic image pair is disclosed. Groups of pixels are analyzed to determine the depth of each pixel group. The number of bits per pixel used to encode each pixel group is selected based on the depth of that pixel group. Therefore, images of objects closer to the camera pair, which appear closer to the viewer, are encoded with a larger number of bits per pixel than objects perceived to be farther from the viewer. The number of bits per pixel may also be increased based on a number of objects depicted or motion detected. The size of prediction blocks used to encode image portions may also be determined based on an angular distance of an image portion relative to the center of the frame. Therefore, smaller prediction blocks may be used to encode image portions closer to the center of the frame.
-
公开(公告)号：US11991418B1
公开(公告)日：2024-05-21
申请号：US16510869
申请日：2019-07-12
发明人： Matt McCarty , Hector Medina , David Cole , Alan Moss
IPC分类号： H04N21/472 , G06F3/01 , H04N21/422
CPC分类号： H04N21/47217 , G06F3/011 , H04N21/42202
摘要： Methods and apparatus for implementing a playback system capable of operating as a virtual or augmented reality device are described. In various embodiment one or more environmental triggers are detected and an action is taken based on the detected trigger, user input and/or other environmental conditions. The methods allow a user who is subject to an immersive experience to smoothly transition in/or out of the virtual environment and respond to environmental triggers which may require a user to take an action.
-
4.发明公开公开(公告)号：US20230281910A1
公开(公告)日：2023-09-07
申请号：US18317402
申请日：2023-05-15
发明人： Hector Medina , David Cole , Alan Moss
IPC分类号： G06T15/04 , H04N13/189 , H04N13/111 , H04N5/272
CPC分类号： G06T15/04 , H04N13/189 , H04N13/111 , H04N5/272
摘要： A background image is also generated, e.g., by filling portions of a captured image where a foreground object was extracted and communicated to the playback device, Foreground objects are identified and point cloud representations of the foreground objects are generated and communicated to a playback device so that they can be used in generating images including the background which is communicated separately. In the case of a point cloud representation a number of points in an environment, e.g., 3D space, are communicated to the playback device along with color information. Thus in some embodiments a foreground object is represented as a set of points with corresponding color information on a per point basis. Foreground object information is communicated and processed in some embodiments at a different rate, e.g., faster rate, then the background textures. The playback device renders images which are sent to the display by first rendering a background layer using the communicated background information, e.g., background texture(s), UV map and environmental geometry, e.g., mesh, to which the background textures are applied.
-
5.发明授权公开(公告)号：US11688124B2
公开(公告)日：2023-06-27
申请号：US17650994
申请日：2022-02-14
发明人： Hector Medina , David Cole , Alan Moss
IPC分类号： G06T15/04 , H04N5/272 , H04N13/189 , H04N13/111
CPC分类号： G06T15/04 , H04N5/272 , H04N13/111 , H04N13/189
摘要： A background image is also generated, e.g., by filling portions of a captured image where a foreground object was extracted and communicated to the playback device, Foreground objects are identified and point cloud representations of the foreground objects are generated and communicated to a playback device so that they can be used in generating images including the background which is communicated separately. In the case of a point cloud representation a number of points in an environment, e.g., 3D space, are communicated to the playback device along with color information. Thus in some embodiments a foreground object is represented as a set of points with corresponding color information on a per point basis. Foreground object information is communicated and processed in some embodiments at a different rate, e.g., faster rate, then the background textures. The playback device renders images which are sent to the display by first rendering a background layer using the communicated background information, e.g., background texture(s), UV map and environmental geometry, e.g., mesh, to which the background textures are applied.
-
公开(公告)号：US20230199333A1
公开(公告)日：2023-06-22
申请号：US18168521
申请日：2023-02-13
发明人： Ramesh Panchagnula , David Cole , Alan Moss
IPC分类号： H04N23/951 , H04N19/587 , G06T19/00
CPC分类号： H04N23/951 , H04N19/587 , G06T19/00
摘要： Methods and apparatus for capturing, communicating and using image data to support virtual reality experiences are described. Images, e.g., frames, are captured at a high resolution but lower frame rate than is used for playback. Interpolation is applied to captured frames to generate interpolated frames. Captured frames, along with interpolated frame information, are communicated to the playback device. The combination of captured and interpolated frames correspond to a second frame playback rate which is higher than the image capture rate. Cameras operate at a high image resolution but slower frame rate than images could be captured with the same cameras at a lower resolution. Interpolation is performed prior to delivery to the user device with segments to be interpolated being selected based on motion and/or lens FOV information. A relatively small amount of interpolated frame data is communicated compared to captured frame data for efficient bandwidth use.
-
公开(公告)号：US11582384B2
公开(公告)日：2023-02-14
申请号：US16858531
申请日：2020-04-24
发明人： Ramesh Panchagnula , David Cole , Alan Moss
IPC分类号： H04N5/232 , H04N19/587 , G06T19/00
摘要： Methods and apparatus for capturing, communicating and using image data to support virtual reality experiences are described. Images, e.g., frames, are captured at a high resolution but lower frame rate than is used for playback. Interpolation is applied to captured frames to generate interpolated frames. Captured frames, along with interpolated frame information, are communicated to the playback device. The combination of captured and interpolated frames correspond to a second frame playback rate which is higher than the image capture rate. Cameras operate at a high image resolution but slower frame rate than images could be captured with the same cameras at a lower resolution. Interpolation is performed prior to delivery to the user device with segments to be interpolated being selected based on motion and/or lens FOV information. A relatively small amount of interpolated frame data is communicated compared to captured frame data for efficient bandwidth use.
-
8.发明申请公开(公告)号：US20220245884A1
公开(公告)日：2022-08-04
申请号：US17650994
申请日：2022-02-14
发明人： Hector Medina , David Cole , Alan Moss
IPC分类号： G06T15/04 , H04N5/272 , H04N13/189 , H04N13/111
摘要： A background image is also generated, e.g., by filling portions of a captured image where a foreground object was extracted and communicated to the playback device, Foreground objects are identified and point cloud representations of the foreground objects are generated and communicated to a playback device so that they can be used in generating images including the background which is communicated separately. In the case of a point cloud representation a number of points in an environment, e.g., 3D space, are communicated to the playback device along with color information. Thus in some embodiments a foreground object is represented as a set of points with corresponding color information on a per point basis. Foreground object information is communicated and processed in some embodiments at a different rate, e.g., faster rate, then the background textures. The playback device renders images which are sent to the display by first rendering a background layer using the communicated background information, e.g., background texture(s), UV map and environmental geometry, e.g., mesh, to which the background textures are applied.
-
公开(公告)号：US20210044747A1
公开(公告)日：2021-02-11
申请号：US16858531
申请日：2020-04-24
发明人： Ramesh Panchagnula , David Cole , Alan Moss
IPC分类号： H04N5/232 , H04N19/587 , G06T19/00
摘要： Methods and apparatus for capturing, communicating and using image data to support virtual reality experiences are described. Images, e.g., frames, are captured at a high resolution but lower frame rate than is used for playback. Interpolation is applied to captured frames to generate interpolated frames. Captured frames, along with interpolated frame information, are communicated to the playback device. The combination of captured and interpolated frames correspond to a second frame playback rate which is higher than the image capture rate. Cameras operate at a high image resolution but slower frame rate than images could be captured with the same cameras at a lower resolution. Interpolation is performed prior to delivery to the user device with segments to be interpolated being selected based on motion and/or lens FOV information. A relatively small amount of interpolated frame data is communicated compared to captured frame data for efficient bandwidth use.
-
公开(公告)号：US11388384B2
公开(公告)日：2022-07-12
申请号：US16037273
申请日：2018-07-17
发明人： David Cole , Alan Moss , Hector Medina
IPC分类号： H04N13/189 , H04N19/44 , G06T17/20 , H04N21/44 , H04N21/435 , H04N21/426 , G06T15/04 , H04N21/81 , H04N13/106 , H04N13/139 , H04N13/161 , H04N13/194 , H04N13/243 , H04N13/275 , H04N13/279 , H04N19/597 , H04N19/136 , H04N19/172 , H04N5/232 , H04N21/2343 , H04N21/2387 , H04N21/437 , H04N21/472 , H04N13/00
摘要： Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.
-
-
-
-
-
-
-
-
-
搜索结果
13 条记录 (耗时 0.016 秒)
