公开(公告)号：US20230396819A1

公开(公告)日：2023-12-07

申请号：US18327364

申请日：2023-06-01

Applicant: APPLE INC.

Inventor： Ke ZHANG ,  Xiaoxia SUN ,  Shujie LIU ,  Xiaosong ZHOU ,  Jian LI ,  Xun SHI ,  Jiefu ZHAI ,  Albert E KEINATH ,  Hsi-Jung WU ,  Jingteng XUE ,  Xingyu ZHANG ,  Jun XIN

IPC: H04N21/2343 ,  H04N7/01 ,  G06V40/16 ,  G06V40/20 ,  G06V30/10 ,  H04N21/231

CPC classification number: H04N21/2343 ,  H04N7/0127 ,  H04N21/231 ,  G06V40/20 ,  G06V30/10 ,  G06V40/172

Abstract: A video delivery system generates and stores reduced bandwidth videos from source video. The system may include a track generator that executes functionality of application(s) to be used at sink devices, in which the track generator generates tracks from execution of the application(s) on source video and generates tracks having a reduced data size as compared to the source video. The track generator may execute a first instance of application functionality on the source video, which identifies region(s) of interest from the source video. The track generator further may downsample the source video according to downsampling parameters, and execute a second instance of application functionality on the downsampled video. The track generator may determine, from a comparison of outputs from the first and second instances of the application, whether the output from the second instance of application functionality is within an error tolerance of the output from the first instance of application functionality. If so, the track generator may generate a track from the downsampled video. In this manner, the system generates tracks that enable reliable application operation when processed by sink devices but also have reduced size as compared to source video.

公开(公告)号：US20210185361A1

公开(公告)日：2021-06-17

申请号：US17188473

申请日：2021-03-01

Applicant: Apple Inc.

Inventor： Xiaohua YANG ,  Alexandros TOURAPIS ,  Dazhong ZHANG ,  Hang YUAN ,  Hsi-Jung WU ,  Jae Hoon KIM ,  Jiefu ZHAI ,  Ming CHEN ,  Xiaosong ZHOU

IPC: H04N19/90 ,  H04N19/52 ,  H04N19/597 ,  G06F3/01 ,  H04N21/2343

Abstract: In communication applications, aggregate source image data at a transmitter exceeds the data that is needed to display a rendering of a viewport at a receiver. Improved streaming techniques that include estimating a location of a viewport at a future time. According to such techniques, the viewport may represent a portion of an image from a multi-directional video to be displayed at the future time, and tile(s) of the image may be identified in which the viewport is estimated to be located. In these techniques, the image data of tile(s) in which the viewport is estimated to be located may be requested at a first service tier, and the other tile in which the viewport is not estimated to be located may be requested at a second service tier, lower than the first service tier.

公开(公告)号：US20210099507A1

公开(公告)日：2021-04-01

申请号：US16825381

申请日：2020-03-20

Applicant: Apple Inc.

Inventor： Fanyi DUANMU ,  Alexandros TOURAPIS ,  Jun XIN ,  Hsi-Jung WU ,  Xiaosong ZHOU

IPC: H04L29/06 ,  H04N13/344 ,  H04N13/161 ,  H04N13/194 ,  H04N13/111

Abstract: Techniques for multi-view video streaming are described in the present disclosure, wherein a viewport prediction may be employed at a client-end based on analysis of pre-fetched media item data and ancillary information. A streaming method may first prefetch a portion of content of a multi-view media item. The method may next identify a salient region from the prefetched content and may then download additional content of the media item that corresponds to the identified salient region.

公开(公告)号：US20210084332A1

公开(公告)日：2021-03-18

申请号：US16569725

申请日：2019-09-13

Applicant: Apple Inc.

Inventor： Fanyi DUANMU ,  Eduardo ASBUN ,  Xiaosong ZHOU ,  Jun XIN ,  Hsi-Jung WU ,  John SU ,  Samir GEHANI ,  Christopher FLICK ,  Shalini SAHOO

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/187

Abstract: Techniques are disclosed for coding and delivering multi-view video in which the video is represented as a manifest file identifying a plurality of segments of the video available for download. The multi-view video may be partitioned spatially into a plurality of tiles that, in aggregate, encompass the entire spatial area of the video. The tiles are coded as segments contains coded video representing content contained within its respective tile. Tiles may be given different sizes based on saliency of the content within their respective regions. In this manner, tiles with high levels of interest may have relatively large spatial areas, which can lead to efficient coding in the presence of content motion.

公开(公告)号：US20200380260A1

公开(公告)日：2020-12-03

申请号：US16882959

申请日：2020-05-26

Applicant: Apple Inc.

Inventor： Bartlomiej RYMKOWSKI ,  Robert BAILEY ,  Ethan TIRA-THOMPSON ,  Shuang GAO ,  Ben ENGLERT ,  Emilie KIM ,  Shujie LIU ,  Ke ZHANG ,  Vinay SHARMA ,  Xiaosong ZHOU

IPC: G06K9/00 ,  G06T7/73 ,  G06T7/246

Abstract: Techniques disclosed for managing video captured by an imaging device. Methods disclosed capture a video in response to a capture command received at the imaging device. Following a video capture, techniques for classifying the captured video based on feature(s) extracted therefrom, for marking the captured video based on the classification, and for generating a media item from the captured video according to the marking are disclosed. Accordingly, the captured video may be classified as representing a static event, and, as a result, a media item of a still image may be generated. Otherwise, the captured video may be classified as representing a dynamic event, and, as a result, a media item of a video may be generated.