公开(公告)号：US20220141455A1

公开(公告)日：2022-05-05

申请号：US17430893

申请日：2020-01-29

Applicant: Nokia Technologies Oy

Inventor： Francesco CRICRI ,  Caglar AYTEKIN ,  Miska HANNUKSELA ,  Xingyang NI

IPC: H04N19/11 ,  H04N19/85 ,  H04N19/159 ,  H04N19/176 ,  G06N3/08 ,  G06N3/04

Abstract: A method comprising: obtaining a configuration of at least one neural network comprising a plurality of intra-prediction mode agnostic layers and one or more intra-prediction mode specific layers, the one or more intra-prediction mode specific layers corresponding to different intra-prediction modes; obtaining at least one input video frame comprising a plurality of blocks; determining to encode one or more blocks using intra prediction; determining an intra-prediction mode for each of said one or more blocks; grouping blocks having same intra-prediction mode into groups, each group being assigned with a computation path among the plurality of intra-prediction mode agnostic and the one or more intra-prediction mode specific layers; training the plurality of intra-prediction mode agnostic and/or the one or more intra-prediction mode specific layers of the neural networks based on a training loss between an output of the neural networks relating to a group of blocks and ground-truth blocks, wherein the ground-truth blocks are either blocks of the input video frame or reconstructed blocks; and encoding a block using a computation path assigned to an intra-prediction mode for the block.

公开(公告)号：US20220012637A1

公开(公告)日：2022-01-13

申请号：US17370462

申请日：2021-07-08

Applicant: Nokia Technologies Oy

Inventor： Hamed REZAZADEGAN TAVAKOLI ,  Francesco CRICRI ,  Emre Baris AKSU

IPC: G06N20/00

Abstract: A node for a federated machine learning system that comprises the node and one or more other nodes configured for the same machine learning task, the node comprising: a federated student machine learning network configured to update a machine learning model in dependence upon updated machine learning models of the one or more node; a teacher machine learning network; means for receiving unlabeled data; means for teaching, using supervised learning, at least the federated first machine learning network using the teacher machine learning network, wherein the teacher machine learning network is configured to receive the data and produce pseudo labels for supervised learning using the data and wherein the federated student machine learning network is configured to perform supervised learning in dependence upon the same received data and the pseudo-labels.

公开(公告)号：US20200311551A1

公开(公告)日：2020-10-01

申请号：US16828106

申请日：2020-03-24

Applicant: NOKIA TECHNOLOGIES OY

Inventor： Caglar AYTEKIN ,  Francesco CRICRI ,  Yat Hong LAM

IPC: G06N3/08 ,  G06N20/10 ,  G06T9/00 ,  G06T3/40

Abstract: A method, apparatus, and computer program product are provided for training a neural network or providing a pre-trained neural network with the weight-updates being compressible using at least a weight-update compression loss function and/or task loss function. The weight-update compression loss function can comprise a weight-update vector defined as a latest weight vector minus an initial weight vector before training. A pre-trained neural network can be compressed by pruning one or more small-valued weights. The training of the neural network can consider the compressibility of the neural network, for instance, using a compression loss function, such as a task loss and/or a weight-update compression loss. The compressed neural network can be applied within a decoding loop of an encoder side or in a post-processing stage, as well as at a decoder side.

公开(公告)号：US20200008004A1

公开(公告)日：2020-01-02

申请号：US16465393

申请日：2017-11-29

Applicant: NOKIA TECHNOLOGIES OY

Inventor： Antti ERONEN ,  Jussi LEPPÄNEN ,  Francesco CRICRI ,  Arto LEHTINIEMI

IPC: H04S7/00 ,  G06K9/62 ,  H04S3/00 ,  G06K9/00

Abstract: A method comprising: causing analysis of a portion of a visual scene; causing modification of a first sound object to modify a spatial extent of the first sound object in dependence upon the analysis of the portion of the visual scene corresponding to the first sound object; and causing rendering of the visual scene and the corresponding sound scene including of the modified first sound object with modified spatial extent.

公开(公告)号：US20190102627A1

公开(公告)日：2019-04-04

申请号：US16087451

申请日：2017-03-27

Applicant: NOKIA TECHNOLOGIES OY

Inventor： Jussi LEPPÄNEN ,  Antti ERONEN ,  Arto LEHTINIEMI ,  Francesco CRICRI

IPC: G06K9/00 ,  H04N21/81 ,  G02B27/01

Abstract: A method comprising: creating a visual indicator based on at least one of visual analysis or audio analysis performed for a content comprising at least one visual element, wherein the visual indicator is selectable such that upon a selection of the visual indicator, access to the content is provided.