公开(公告)号：US12192554B2

公开(公告)日：2025-01-07

申请号：US18329040

申请日：2023-06-05

Applicant: Apple Inc.

Inventor： Moinul H. Khan ,  Jim C. Chou ,  Sorin C. Cismas

IPC: H04N21/2662 ,  H04L1/00 ,  H04N19/59 ,  H04W72/542

Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

公开(公告)号：US20240422358A1

公开(公告)日：2024-12-19

申请号：US18745956

申请日：2024-06-17

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/70 ,  H04N19/174 ,  H04N19/184 ,  H04N19/186

Abstract: This disclosure is directed to systems and methods of streaming extensions for video encoding. The streaming extensions may enable the bitstream syntax for layered video data to be modified to reduce overhead for encoding. The bitstream syntax may be modified to enable variable length luma and chroma components, and enable the alignment between the layers and slice to be bit aligned to enable increased granularity in image encoding, and to minimize overhead between different elements within the layers.

公开(公告)号：US20230254510A1

公开(公告)日：2023-08-10

申请号：US18301737

申请日：2023-04-17

Applicant: Apple Inc.

Inventor： Jim C. Chou ,  Sorin C. Cismas

IPC: H04N19/63 ,  H04N19/117 ,  H04N19/147 ,  H04N19/174 ,  H04N19/176 ,  H04N19/18

CPC classification number: H04N19/63 ,  H04N19/117 ,  H04N19/147 ,  H04N19/174 ,  H04N19/176 ,  H04N19/18

Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder. The encoded frequency data is packetized and transmitted to a receiving device. On the receiving device, the encoded data is decoded to recover the frequency bands. Wavelet synthesis is then performed on the frequency bands to reconstruct the pixel data for display. The system may encode parts of frames (tiles or slices) using one or more encoders and transmit the encoded parts as they are ready. A pre-filter component may perform a lens warp on the pixel data prior to the wavelet transform.

公开(公告)号：US20230084718A1

公开(公告)日：2023-03-16

申请号：US17589642

申请日：2022-01-31

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/149 ,  H04N19/14 ,  H04N19/30 ,  H04N19/186 ,  H04N19/174

Abstract: This disclosure is directed to systems and methods of rate control in multiple pass video encoding. The video encoder may complete multiple encoding passes for slices of an image. Rate control algorithms may be implemented that scale the quantization step size and quantization matrix values depending on the determined size of the image slices. This may enable the size of slices to be adjusted based on size parameters for the image data.

公开(公告)号：US20230396824A1

公开(公告)日：2023-12-07

申请号：US18329040

申请日：2023-06-05

Applicant: Apple Inc.

Inventor： Moinul H. Khan ,  Jim C. Chou ,  Sorin C. Cismas

IPC: H04N21/2662 ,  H04N19/59 ,  H04L1/00 ,  H04W72/542

CPC classification number: H04N21/2662 ,  H04N19/59 ,  H04L1/0009 ,  H04L1/0003 ,  H04W72/542

Abstract: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.

公开(公告)号：US11496758B2

公开(公告)日：2022-11-08

申请号：US17252697

申请日：2019-06-27

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Jim C. Chou ,  Ling Su ,  Keangpo R. Ho

IPC: H04N19/37 ,  H04N19/119 ,  H04N19/164 ,  H04N19/167 ,  H04N19/174 ,  H04N19/176 ,  H04N19/169 ,  H04N19/46 ,  H04N19/63

Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.

公开(公告)号：US20160360234A1

公开(公告)日：2016-12-08

申请号：US15172064

申请日：2016-06-02

Applicant: Apple Inc.

Inventor： Alexandros Michael Tourapis ,  David William Singer ,  Haitao Guo ,  Hsi-Jung Wu ,  Sorin C. Cismas ,  Xiaohua Yang ,  Yeping Su ,  Dazhong Zhang

IPC: H04N19/593 ,  H04N19/182 ,  H04N19/176

CPC classification number: H04N19/593 ,  H04N19/117 ,  H04N19/156 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182

Abstract: Methods are described for encoding and decoding blocks of image data using intra block copying (IBC). A source block for intra block copying is selected from a source region of a current image that is closer to the current block than a threshold, wherein the source region does not include a portion of the current image that is further from the current block than the threshold.

Abstract translation: 描述了使用块内复制（IBC）对图像数据块进行编码和解码的方法。 从当前图像的比当前块更靠近阈值的源区域中选择用于帧内块复制的源块，其中源区域不包括当前图像的比当前块更远的部分， 阈。

公开(公告)号：US20230092305A1

公开(公告)日：2023-03-23

申请号：US18052807

申请日：2022-11-04

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Jim C. Chou ,  Ling Su ,  Keangpo R. Ho

IPC: H04N19/37 ,  H04N19/119 ,  H04N19/164 ,  H04N19/167 ,  H04N19/174 ,  H04N19/176 ,  H04N19/169 ,  H04N19/46 ,  H04N19/63

Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.

公开(公告)号：US20230079090A1

公开(公告)日：2023-03-16

申请号：US17675823

申请日：2022-02-18

Applicant: Apple Inc.

Inventor： Ganesh G. Yadav ,  Sorin C. Cismas

IPC: H04N19/436 ,  H04N19/176 ,  H04N19/423 ,  H04N19/40 ,  H04N19/186

Abstract: The present disclosure relates to systems and methods of multi-pipe scheduling for image decoding. For example, a bitstream may include compressed slices that are scheduled to each of the multiple decoding pipelines present in the image processing circuitry of an electronic device. The bitstream may include image data that was encoded using variable-length coding. This results in some bits of the image data containing denser and/or sparser syntax elements and result in variable processing times. The scheduling circuitry may be able to monitor each of the multiple decoder pipelines rate of bit consumption and the number of bits initially scheduled to each of the multiple pipelines and the number of bits consumed by each of the multiple pipelines over time so that incoming compressed slices may be scheduled to the pipe that will be able to process the compressed slice the fastest.

公开(公告)号：US20210274200A1

公开(公告)日：2021-09-02

申请号：US17252697

申请日：2019-06-27

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Jim C. Chou ,  Ling Su ,  Keangpo R. Ho

IPC: H04N19/37 ,  H04N19/176 ,  H04N19/169 ,  H04N19/63 ,  H04N19/164 ,  H04N19/167 ,  H04N19/46 ,  H04N19/174 ,  H04N19/119

Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands are organized into blocks that are provided to a block-based encoder that encodes the blocks and passes the encoded blocks to a wireless interface that packetizes the blocks for transmittal over a wireless connection. The encoder may categorize the encoded frequency bands into multiple priority levels, and may tag each frequency block with metadata indicating the frequency band represented in the block, the priority of the frequency band, and timing information. The wireless interface may then transmit or drop packets according to the priority levels of the encoded frequency blocks in the packets and/or according to the timing information of the frequency blocks in the packets.