公开(公告)号：US11810267B2

公开(公告)日：2023-11-07

申请号：US17240396

申请日：2021-04-26

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Ji Li ,  Huan Yang ,  Jianlong Fu

IPC: G06T3/40 ,  G06N20/00

CPC classification number: G06T3/4046 ,  G06N20/00 ,  G06T3/4084

Abstract: A system and method for rich content transformation are provided. The system and method allow rich content transformation to be separately processed on a client device and on a cloud-based server. The client device downsizes a rich content and transmits the downsized rich content to the cloud-based server via a network. The cloud-based server calculates function parameters based on the downsized rich content using one or more machine learning models included in the server. The calculated function parameters are transmitted to the client device via the network. The client device then applies these function parameters to the rich content on the client device to obtain the transformed rich content.

公开(公告)号：US20240153189A1

公开(公告)日：2024-05-09

申请号：US18279764

申请日：2022-04-02

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bei Liu ,  Huan Yang ,  Jianlong Fu

IPC: G06T13/80 ,  G06T7/12 ,  G06T7/246 ,  G06T7/70 ,  G06V10/44

CPC classification number: G06T13/80 ,  G06T7/12 ,  G06T7/246 ,  G06T7/70 ,  G06V10/44 ,  G06T2207/20084

Abstract: According to implementations of the subject matter described herein, there is provided a solution for generating a video from an image. In this solution, an input image and a reference video are obtained; a motion pattern of a reference object in the reference video is determined based on the reference video. An output video with the input image as a starting frame is generated. Motion of a target object in the output video has the motion pattern of the reference object and the target object is in the input image. In this way, according to the solution, the motion pattern of the reference object in the reference video can be intuitively applied to the input image to generate the output video, and the motion of the target object in the output video has the motion pattern of the reference object.

公开(公告)号：US11935154B2

公开(公告)日：2024-03-19

申请号：US17684889

申请日：2022-03-02

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ji Li ,  Fatima Zohra Daha ,  Bei Liu ,  Huan Yang ,  Jianlong Fu

IPC: G06T7/00 ,  G06F3/0482 ,  G06T11/00

CPC classification number: G06T11/00 ,  G06F3/0482 ,  G06T7/0002 ,  G06T2200/24 ,  G06T2207/20081 ,  G06T2207/30168

Abstract: A method and system for transforming an input image via a plurality of image transformation stylizers includes receiving the input image; providing the input image, information about the plurality of image transformation stylizers and at least one of user data, history data, and contextual data to a trained machine-learning (ML) model for selecting a subset of the plurality of image transformation stylizers; receiving as an output from the ML model the subset of image transformation stylizers; executing the subset of the image transformation stylizers on the input image to generate a plurality of transformed output images; ranking the plurality of transformed output images based on at least one of the input image, the user data, the history data, and the contextual data; and providing the ranked plurality of transformed output images for display.

公开(公告)号：US20230177643A1

公开(公告)日：2023-06-08

申请号：US17919723

申请日：2021-04-20

Applicant: Microsoft Technology Licensing, LLC

Inventor： Huan Yang ,  Jianlong FU ,  Baining GUO

IPC: G06T3/40 ,  G06T7/40

CPC classification number: G06T3/4053 ,  G06T7/40 ,  G06T3/4046 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20021

Abstract: There is provided a solution for image processing. In this solution, first and second information is determined based on texture features of an input image and a reference image. The first information at least indicates for a first pixel block in the input image a second pixel block in the reference image most relevant to the first pixel block in terms of the texture features, and the second information at least indicates a relevance of the first pixel block to the second pixel block. A transferred feature map with a target resolution is determined based on the first information and the reference image. The input image is transformed into an output image with the target resolution based on the transferred feature map and the second information. The output image reflects a texture feature of the reference image.