Method and apparatus for generating video intermediate frame

    公开(公告)号:US12185023B2

    公开(公告)日:2024-12-31

    申请号:US18206459

    申请日:2023-06-06

    Abstract: A method for generating a video intermediate frame, including obtaining a target video frame pair; constructing an image pyramid for each video frame in the target video frame pair; and generating an intermediate frame of the target video frame pair by using a bidirectional optical flow estimation model and a pixel synthesis model in a layer-by-layer recursive calling manner according to an order of the image pyramid from a high layer to a low layer based on the image pyramid, wherein the generating of the intermediate frame of the target video frame pair comprising: repairing a bidirectional optical flow corresponding to a previous layer using the bidirectional optical flow estimation model, and repairing a previous intermediate frame corresponding to the previous layer using the pixel synthesis model.

    Computing apparatus and operation method of the same

    公开(公告)号:US11640650B2

    公开(公告)日:2023-05-02

    申请号:US17030905

    申请日:2020-09-24

    Abstract: Provided are a computing apparatus for constructing a mosaic image and an operation method of the same. The computing apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: segment an input image into a plurality of sub areas to obtain a plurality of sub area images, extract a feature from each of the plurality of sub area images, generate a plurality of source images respectively corresponding to the plurality of sub areas using an image generation neural network, the image generation neural network using, as a condition, the feature extracted from each of the plurality of sub area images, and combine the plurality of source images respectively corresponding to the plurality of sub areas to generate a mosaic image.

    Electronic device for performing video quality assessment, and operation method of the electronic device

    公开(公告)号:US12266165B2

    公开(公告)日:2025-04-01

    申请号:US17824587

    申请日:2022-05-25

    Abstract: An electronic device is provided. The electronic device includes a memory storing one or more instructions, and a processor configured to execute the one or more instruction stored in the memory. The processor is configured to execute the one or more instructions to obtain a subjective assessment score for each of a plurality of sub-regions included in an input frame, the subjective assessment score being a Mean Opinion Score (MOS); obtain a location weight for each of the plurality of sub-regions, the location weight indicating characteristics according to a location of a display; obtain a weighted assessment score for each of the plurality of sub-regions, based on the subjective assessment score for each of the plurality of sub-regions and the location weight for each of the plurality of sub-regions; and obtain a final quality score for the entire video frame, based on the weighted assessment score for each of the plurality of sub-regions.

    Electronic apparatus for audio signal processing and operating method thereof

    公开(公告)号:US12192738B2

    公开(公告)日:2025-01-07

    申请号:US17727202

    申请日:2022-04-22

    Abstract: A method of an electronic apparatus for audio signal processing includes obtaining a parameter related to spatialization of an audio object, obtaining rendering information based on the parameter related to spatialization, and rendering the audio object based on the rendering information. The parameter related to spatialization includes at least one of an object parameter of a feature of at least one of the audio object or a video object associated with the audio object, an electronic apparatus parameter of a feature of the electronic apparatus, or a user parameter of a feature of a user.

    Display device and operating method thereof

    公开(公告)号:US11928381B2

    公开(公告)日:2024-03-12

    申请号:US17835702

    申请日:2022-06-08

    CPC classification number: G06F3/1423 G06F3/011

    Abstract: Provided is a display device including a display configured to display first content; a memory storing instructions; and a processor configured to execute the instructions to: obtain first content information by analyzing the first content, obtain user tracking information by tracking a user viewing the first content displayed by the display, determine whether a trigger condition is satisfied, based on at least one of the first content information or the user tracking information, and based on the trigger condition being satisfied, control a communication unit to transmit second content to a projector connected to the display device, wherein the second content is generated based on the first content.

    AI downscaling apparatus and operating method thereof, and AI upscaling apparatus and operating method thereof

    公开(公告)号:US12254591B2

    公开(公告)日:2025-03-18

    申请号:US18638310

    申请日:2024-04-17

    Abstract: An artificial intelligence (AI) upscaling apparatus for upscaling a low-resolution image to a high-resolution image includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, wherein the processor is configured to: obtain a second image corresponding to a first image, which is downscaled from an original image by an AI downscaling apparatus by using a first deep neural network (DNN); and obtain a third image by upscaling the second image by using a second DNN corresponding to the first DNN, and wherein the second DNN is trained to minimize a difference between a first restored image, which results from applying no pixel movement to an original training image, and second restored images, which result from downscaling, upscaling, and subsequently retranslating one or more translation images obtained by applying pixel movement to the original training image.

    Computing device and operating method thereof

    公开(公告)号:US12035007B2

    公开(公告)日:2024-07-09

    申请号:US17312295

    申请日:2021-01-08

    CPC classification number: H04N21/4666 H04N21/4667

    Abstract: The disclosure relates to an artificial intelligence (AI) system and an application thereof. A computing device disclosed includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, wherein the processor is configured to execute the one or more instructions to input a recommendation recipient's consumption information to a first neural network configured to receive item consumption information of a user and reconstruct the item consumption information and a second neural network embedded into the first neural network and having been trained with respect to metadata consumption information corresponding to the item consumption information, and obtain item recommendation information to which the metadata consumption information is reflected.

    AI downscaling apparatus and operating method thereof, and AI upscaling apparatus and operating method thereof

    公开(公告)号:US11989852B2

    公开(公告)日:2024-05-21

    申请号:US17312276

    申请日:2021-01-11

    CPC classification number: G06T3/4046 G06T3/4053

    Abstract: An artificial intelligence (AI) upscaling apparatus for upscaling a low-resolution image to a high-resolution image includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, wherein the processor is configured to: obtain a second image corresponding to a first image, which is downscaled from an original image by an AI downscaling apparatus by using a first deep neural network (DNN); and obtain a third image by upscaling the second image by using a second DNN corresponding to the first DNN, and wherein the second DNN is trained to minimize a difference between a first restored image, which results from applying no pixel movement to an original training image, and second restored images, which result from downscaling, upscaling, and subsequently retranslating one or more translation images obtained by applying pixel movement to the original training image.

Patent Agency Ranking