-
1.
公开(公告)号:US20180084270A1
公开(公告)日:2018-03-22
申请号:US15271055
申请日:2016-09-20
发明人: Ihab Amer , Gabor Sines , Edward Harold , Jinbo Qiu , Lei Zhang , Yang Liu , Zhen Chen , Ying Luo , Shu-Hsien Wu , Zhong Cai
IPC分类号: H04N19/513 , H04N19/172 , H04N19/105
CPC分类号: H04N19/57 , H04N19/433
摘要: A processing apparatus is provided that includes an encoder configured to encode current frames of video data using previously encoded reference frames and perform motion searches within a search window about each of a plurality of co-located portions of a reference frame. The processing apparatus also includes a processor configured to determine, prior to performing the motion searches, which locations of the reference frame to reload the search window according to a threshold number of search window reloads using predicted motions of portions of the reference frame corresponding to each of the locations. The processor is also configured to cause the encoder to reload the search window at the determined locations of the reference frame and, for each of the remaining locations of the reference frame, slide the search window in a first direction indicated by the location of the next co-located portion of the reference frame.
-
公开(公告)号:US11711571B2
公开(公告)日:2023-07-25
申请号:US17193484
申请日:2021-03-05
发明人: Ihab Amer , Guennadi Riguer , Thomas Perry , Mehdi Saeedi , Gabor Sines , Yang Liu
IPC分类号: H04N21/44 , H04N21/438 , H04N21/431 , H04N21/43
CPC分类号: H04N21/44012 , H04N21/4307 , H04N21/438 , H04N21/4318 , H04N21/44008
摘要: A server offloads graphics effects processing to a client device with graphics processing resources by determining a modification to a graphics effects operation, generating a portion of a rendered video stream using the modification to the graphics effects operation, and providing an encoded representation of the portion of the rendered video stream to the client device, along with metadata representing the modification implemented. The client device decodes the encoded representation to recover the portion of the rendered video stream and selectively performs a graphics effects operation on the recovered portion to at least partially revert the resulting graphics effects for the portion to the intended effects without the modification implemented by the server.
-
3.
公开(公告)号:US10805643B2
公开(公告)日:2020-10-13
申请号:US15085562
申请日:2016-03-30
发明人: Ihab Amer , Gabor Sines , Khaled Mammou , Haibo Liu , Arun Sundaresan Iyer
IPC分类号: G06F1/32 , H04N19/895 , H04N19/66 , H04N19/70
摘要: Various codecs and methods of using the same are disclosed. In one aspect, a method of processing video data is provided that includes encoding or decoding the video data with a codec in aggressive deployment and correcting one or more errors in the encoding or decoding wherein the error correction includes re-encoding or re-decoding the video data in a non-aggressive deployment or generating a skip picture.
-
公开(公告)号:US10341650B2
公开(公告)日:2019-07-02
申请号:US15130873
申请日:2016-04-15
发明人: Khaled Mammou , Ihab Amer , Gabor Sines , Lei Zhang , Layla A. Mah , Guennadi Riguer , David Glen
IPC分类号: H04N19/103 , H04N19/167 , H04N19/597 , H04N19/162 , H04N19/124 , G06K9/00 , H04N19/17
摘要: Systems, methods and apparatuses of processing data of a VR system are disclosed that comprise receiving tracking information which includes at least one of user position information and eye gaze point information. One or more processors may be used to predict, based on the user tracking information, a user viewpoint of a next frame of a sequence of frames of video data to be displayed. Using the prediction, a portion of the next frame of video data to be displayed is rendered at an estimated location in the next frame. A corresponding matching portion in a previously encoded frame is determined based on the estimated location of the portion in the next frame and the portion of the next frame of video data is encoded.
-
公开(公告)号:US20230403415A1
公开(公告)日:2023-12-14
申请号:US17838552
申请日:2022-06-13
发明人: Ihab Amer , Gabor Sines , Haibo Liu , Khaled Mammou , Arun Sundaresan Iyer
IPC分类号: H04N21/2343 , H04N21/4402 , H04N21/442
CPC分类号: H04N21/2343 , H04N21/4402 , H04N21/44209
摘要: Adaptive decoder-drive encoder reconfiguration techniques are described. In one example, techniques include detecting an operational condition at a consumer using a sensor, the consumer receiving a communication of digital content from an encoder; generating an adaptation instruction by the decoder based on the detecting; transmitting the adaptation instruction by the decoder for receipt by the encoder; and receiving an adapted communication of the digital content generated by the encoder, the adapted communication caused by reconfiguration of the encoder based on the adaptation instruction received from the decoder.
-
公开(公告)号:US10169843B1
公开(公告)日:2019-01-01
申请号:US15818072
申请日:2017-11-20
发明人: Ihab Amer , Guennadi Riguer , Ruijin Wu , Skyler J. Saleh , Boris Ivanovic , Gabor Sines
摘要: A processing system selectively renders pixels or blocks of pixels of an image and leaves some pixels or blocks of pixels unrendered to conserve resources. The processing system generates a motion vector field to identify regions of an image having moving areas. The processing system uses a rendering processor to identify as regions of interest those units having little to no motion, based on the motion vector field, and a large amount of edge activity, and to minimize the probability of unrendered pixels, or “holes”, in these regions. To avoid noticeable patterns, the rendering processor applies a probability map to determine the possible locations of holes, assigning to each unit a probability indicating the percentage of pixels within the unit that will be holes, and assigning a lower probability to units identified as regions of interest.
-
公开(公告)号:US20240319760A1
公开(公告)日:2024-09-26
申请号:US18126166
申请日:2023-03-24
发明人: Ian Charles Colbert , Alexander Sabino Duenas , Stephen Jiacheng Fu , Omer Irshad , Mohammad Hamed Mousazadeh , Ihab Amer , Gabor Sines
摘要: A processing device includes an automated overclocking system and a processor. The automated overclocking system is data-driven and includes an inference engine that executes a machine learning model configured to generate a first output based on a current configuration of the processing device. The first output includes a first set of overclocking parameters. The processor is configured to adjust one or more operating characteristics of at least one component of the processing device based on the first set of overclocking parameters.
-
8.
公开(公告)号:US10368087B2
公开(公告)日:2019-07-30
申请号:US15271055
申请日:2016-09-20
发明人: Ihab Amer , Gabor Sines , Edward Harold , Jinbo Qiu , Lei Zhang , Yang Liu , Zhen Chen , Ying Luo , Shu-Hsien Wu , Zhong Cai
IPC分类号: H04N19/513 , H04N19/105 , H04N19/172 , H04N19/57 , H04N19/433
摘要: A processing apparatus is provided that includes an encoder configured to encode current frames of video data using previously encoded reference frames and perform motion searches within a search window about each of a plurality of co-located portions of a reference frame. The processing apparatus also includes a processor configured to determine, prior to performing the motion searches, which locations of the reference frame to reload the search window according to a threshold number of search window reloads using predicted motions of portions of the reference frame corresponding to each of the locations. The processor is also configured to cause the encoder to reload the search window at the determined locations of the reference frame and, for each of the remaining locations of the reference frame, slide the search window in a first direction indicated by the location of the next co-located portion of the reference frame.
-
公开(公告)号:US20150092856A1
公开(公告)日:2015-04-02
申请号:US14043427
申请日:2013-10-01
发明人: Khaled MAMMOU , Ihab Amer , Sines Gabor , Lei Zhang , Michael Schmit , Daniel Wong
IPC分类号: H04N19/597 , H04N19/583 , H04N19/51 , H04N19/56
CPC分类号: H04N19/51 , H04N19/46 , H04N19/52 , H04N19/521 , H04N19/56 , H04N19/597
摘要: The present disclosure is directed a system and method for exploiting camera and depth information associated with rendered video frames, such as those rendered by a server operating as part of a cloud gaming service, to more efficiently encode the rendered video frames for transmission over a network. The method and system of the present disclosure can be used in a server operating in a cloud gaming service to improve, for example, the amount of latency, downstream bandwidth, and/or computational processing power associated with playing a video game over its service. The method and system of the present disclosure can be further used in other applications where camera and depth information of a rendered or captured video frame is available.
摘要翻译: 本公开涉及一种用于利用与渲染的视频帧相关联的相机和深度信息的系统和方法,诸如由作为云游戏服务的一部分操作的服务器呈现的那些视频帧,以更有效地对所渲染的视频帧进行编码以在网络上传输 。 本公开的方法和系统可以用于在云游戏服务中操作的服务器中,以改善例如与通过其服务播放视频游戏相关的等待时间,下行带宽和/或计算处理能力的量。 本公开的方法和系统可以进一步用于其中可用于渲染或捕获的视频帧的相机和深度信息的其他应用中。
-
公开(公告)号:US11252430B2
公开(公告)日:2022-02-15
申请号:US16671992
申请日:2019-11-01
发明人: Khaled Mammou , Ihab Amer , Gabor Sines , Lei Zhang , Michael Schmit , Daniel Wong
IPC分类号: H04N19/51 , H04N19/46 , H04N19/513 , H04N19/597 , H04N19/52 , H04N19/56
摘要: The present disclosure is directed a system and method for exploiting camera and depth information associated with rendered video frames, such as those rendered by a server operating as part of a cloud gaming service, to more efficiently encode the rendered video frames for transmission over a network. The method and system of the present disclosure can be used in a server operating in a cloud gaming service to improve, for example, the amount of latency, downstream bandwidth, and/or computational processing power associated with playing a video game over its service. The method and system of the present disclosure can be further used in other applications where camera and depth information of a rendered or captured video frame is available.
-
-
-
-
-
-
-
-
-