公开(公告)号：US20220329805A1

公开(公告)日：2022-10-13

申请号：US17843160

申请日：2022-06-17

Applicant: Apple Inc.

Inventor： Krishnakanth Rapaka ,  Munehiro Nakazato ,  Jiandong Shen ,  Ganesh G. Yadav ,  Sorin Constantin Cismas ,  Jim C. Chou ,  Hao Pan

IPC: H04N19/124 ,  H04N19/60

Abstract: In one implementation, a method of encoding an image is performed at a device including one or more processors and non-transitory memory. The method includes determining a category of a spatial portion of an image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters. The method includes quantizing the spatial portion of the image based on the categorization.

公开(公告)号：US20230079090A1

公开(公告)日：2023-03-16

申请号：US17675823

申请日：2022-02-18

Applicant: Apple Inc.

Inventor： Ganesh G. Yadav ,  Sorin C. Cismas

IPC: H04N19/436 ,  H04N19/176 ,  H04N19/423 ,  H04N19/40 ,  H04N19/186

Abstract: The present disclosure relates to systems and methods of multi-pipe scheduling for image decoding. For example, a bitstream may include compressed slices that are scheduled to each of the multiple decoding pipelines present in the image processing circuitry of an electronic device. The bitstream may include image data that was encoded using variable-length coding. This results in some bits of the image data containing denser and/or sparser syntax elements and result in variable processing times. The scheduling circuitry may be able to monitor each of the multiple decoder pipelines rate of bit consumption and the number of bits initially scheduled to each of the multiple pipelines and the number of bits consumed by each of the multiple pipelines over time so that incoming compressed slices may be scheduled to the pipe that will be able to process the compressed slice the fastest.

公开(公告)号：US20240314361A1

公开(公告)日：2024-09-19

申请号：US18671720

申请日：2024-05-22

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/66 ,  H04L65/65 ,  H04L65/70 ,  H04N19/174 ,  H04N19/186

CPC classification number: H04N19/66 ,  H04L65/65 ,  H04L65/70 ,  H04N19/174 ,  H04N19/186

Abstract: This disclosure is directed to systems and methods of data partitioning in image encoding. A video encoder may receive a single stream of video data that includes multiple layers. The video encoder may encode the one or more layers utilizing multiple counters for each component within the layers. The multiple counters may correspond to the header bits, luma bits, and chroma bits within each slice layer. The encoded layers may then be assembled into a single slice before it is sent to a decoder for decoding of image frame.

公开(公告)号：US20240121401A1

公开(公告)日：2024-04-11

申请号：US18545989

申请日：2023-12-19

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/149 ,  H04N19/14 ,  H04N19/174 ,  H04N19/186 ,  H04N19/30

CPC classification number: H04N19/149 ,  H04N19/14 ,  H04N19/174 ,  H04N19/186 ,  H04N19/30

Abstract: This disclosure is directed to systems and methods of rate control in multiple pass video encoding. The video encoder may complete multiple encoding passes for slices of an image. Rate control algorithms may be implemented that scale the quantization step size and quantization matrix values depending on the determined size of the image slices. This may enable the size of slices to be adjusted based on size parameters for the image data.

公开(公告)号：US20240422358A1

公开(公告)日：2024-12-19

申请号：US18745956

申请日：2024-06-17

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/70 ,  H04N19/174 ,  H04N19/184 ,  H04N19/186

Abstract: This disclosure is directed to systems and methods of streaming extensions for video encoding. The streaming extensions may enable the bitstream syntax for layered video data to be modified to reduce overhead for encoding. The bitstream syntax may be modified to enable variable length luma and chroma components, and enable the alignment between the layers and slice to be bit aligned to enable increased granularity in image encoding, and to minimize overhead between different elements within the layers.

公开(公告)号：US20230084718A1

公开(公告)日：2023-03-16

申请号：US17589642

申请日：2022-01-31

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/149 ,  H04N19/14 ,  H04N19/30 ,  H04N19/186 ,  H04N19/174

Abstract: This disclosure is directed to systems and methods of rate control in multiple pass video encoding. The video encoder may complete multiple encoding passes for slices of an image. Rate control algorithms may be implemented that scale the quantization step size and quantization matrix values depending on the determined size of the image slices. This may enable the size of slices to be adjusted based on size parameters for the image data.

公开(公告)号：US11843776B2

公开(公告)日：2023-12-12

申请号：US17843160

申请日：2022-06-17

Applicant: Apple Inc.

Inventor： Krishnakanth Rapaka ,  Munehiro Nakazato ,  Jiandong Shen ,  Ganesh G. Yadav ,  Sorin Constantin Cismas ,  Jim C. Chou ,  Hao Pan

IPC: H04N19/124 ,  H04N19/60 ,  H04N19/126

CPC classification number: H04N19/124 ,  H04N19/126 ,  H04N19/60

Abstract: In one implementation, a method of encoding an image is performed at a device including one or more processors and non-transitory memory. The method includes determining a category of a spatial portion of an image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters. The method includes quantizing the spatial portion of the image based on the categorization.

公开(公告)号：US20230080223A1

公开(公告)日：2023-03-16

申请号：US17589589

申请日：2022-01-31

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/66 ,  H04N19/174 ,  H04N19/186 ,  H04L65/65 ,  H04L65/60

Abstract: This disclosure is directed to systems and methods of data partitioning in image encoding. A video encoder may receive a single stream of video data that includes multiple layers. The video encoder may encode the one or more layers utilizing multiple counters for each component within the layers. The multiple counters may correspond to the header bits, luma bits, and chroma bits within each slice layer. The encoded layers may then be assembled into a single slice before it is sent to a decoder for decoding of image frame.

公开(公告)号：US20230079859A1

公开(公告)日：2023-03-16

申请号：US17589641

申请日：2022-01-31

Applicant: Apple Inc.

Inventor： Sorin C. Cismas ,  Ganesh G. Yadav

IPC: H04N19/70 ,  H04N19/184 ,  H04N19/186 ,  H04N19/174

Abstract: This disclosure is directed to systems and methods of streaming extensions for video encoding. The streaming extensions may enable the bitstream syntax for layered video data to be modified to reduce overhead for encoding. The bitstream syntax may be modified to enable variable length luma and chroma components, and enable the alignment between the layers and slice to be bit aligned to enable increased granularity in image encoding, and to minimize overhead between different elements within the layers.