公开(公告)号：US12026463B2

公开(公告)日：2024-07-02

申请号：US18323900

申请日：2023-05-25

Applicant: Snap Inc.

Inventor： Vitor Rocha de Carvalho ,  Luis Carlos Dos Santos Marujo ,  Leonardo Ribas Machado das Neves

IPC: G06F40/263 ,  G06F40/284 ,  G06F40/295 ,  G06N20/00

CPC classification number: G06F40/263 ,  G06F40/284 ,  G06F40/295 ,  G06N20/00

Abstract: Systems, devices, media, and methods are presented for generating a language detection model of a language analysis system. The systems and methods access a set of messages including text elements and convert the set of messages into a set of training messages. The set of training messages are configured for training a language detection model. The systems and methods train a classifier based on the set of training messages. The classifier has a set of features representing word frequency, character frequency, and a character ratio. The systems and methods generate a language detection model based on the classifier and the set of features.

公开(公告)号：US20240022532A1

公开(公告)日：2024-01-18

申请号：US18358919

申请日：2023-07-25

Applicant: Snap Inc.

Inventor： Vitor Rocha de Carvalho ,  Leonardo Ribas Machado das Neves ,  Seungwhan Moon

IPC: H04L51/10 ,  G06N3/08 ,  G06V30/19 ,  G06V10/82 ,  G06V10/40

CPC classification number: H04L51/10 ,  G06N3/08 ,  G06V30/19147 ,  G06V30/19173 ,  G06V10/82 ,  G06V10/40 ,  H04L67/10

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use an attention-based mechanism that emphasis or de-emphasizes each data type (e.g., image, word, character) in the multimodal message based on each datatypes relevance. The output of the attention mechanism can be used to update a recurrent network to identify one or more words in the caption as being a named entity.

公开(公告)号：US11816906B2

公开(公告)日：2023-11-14

申请号：US17248400

申请日：2021-01-22

Applicant: Snap Inc.

Inventor： Vítor Silva Sousa ,  Nils Murrugarra-Llerena ,  Leonardo Ribas Machado das Neves ,  Neil Shah

IPC: G06V20/70 ,  G06F16/58 ,  G06N3/08 ,  G06F18/214 ,  G06F18/2431 ,  G06N3/04 ,  H04L51/10

CPC classification number: G06V20/70 ,  G06F16/5866 ,  G06F18/214 ,  G06F18/2431 ,  G06N3/08 ,  G06N3/04 ,  G06V2201/10 ,  H04L51/10

Abstract: A messaging system performs engagement analysis based on labels associated with content items produced by users of the messaging system. The messaging system is configured to process content items comprising images to identify elements in the images and determine labels for the images based on conditions indicating when to associate a label of the labels with an image of the images based on the elements in the image. The messaging system is further configured to associate the label with the content item, in response to determining to associate the label with the image, associating the label with the content item. The messaging system is further configured to determine engagement scores for the label based on interactions of users with the content items associated with label and adjust the engagement scores to determine trends in the labels to generate adjusted engagement scores.

公开(公告)号：US11551042B1

公开(公告)日：2023-01-10

申请号：US16552393

申请日：2019-08-27

Applicant: Snap Inc.

Inventor： Jianfei Yu ,  Luis Carlos Dos Santos Marujo ,  Venkata Satya Pradeep Karuturi ,  Leonardo Ribas Machado das Neves ,  Ning Xu ,  William Brendel

IPC: G06F40/30 ,  G06K9/62 ,  G06N3/08 ,  G06N20/20 ,  G06N3/04 ,  G06F40/284 ,  G10L25/30 ,  G06F40/295 ,  G06F40/279 ,  G06F40/289 ,  G10L15/18 ,  G10L15/16

Abstract: Sentiment classification can be implemented by an entity-level multimodal sentiment classification neural network. The neural network can include left, right, and target entity subnetworks. The neural network can further include an image network that generates representation data that is combined and weighted with data output by the left, right, and target entity subnetworks to output a sentiment classification for an entity included in a network post.

公开(公告)号：US11475254B1

公开(公告)日：2022-10-18

申请号：US16125275

申请日：2018-09-07

Applicant: Snap Inc.

Inventor： Vitor Rocha de Carvalho ,  Leonardo Ribas Machado das Neves ,  Seungwhan Moon

IPC: G06K9/62 ,  G06N3/08 ,  G06V30/10

Abstract: A machine learning based system can identify an entity as the likely subject of a multimodal message (e.g., a social media post having a short text phrase overlaid on an image) by creating embeddings for an image of the multimodal message and one or more string embeddings from text of the multimodal message. The embeddings can be weighted to maximize information gain, then recombined and compared against a result embedding database to identify an entity as the subject of the multimodal message.

公开(公告)号：US11422996B1

公开(公告)日：2022-08-23

申请号：US16396119

申请日：2019-04-26

Applicant: Snap Inc.

Inventor： Lawrence Jason Muhlstein ,  Leonardo Ribas Machado das Neves ,  Yanen Li ,  Ning Xu

IPC: G06F16/22 ,  G06N3/08 ,  G06F3/0481 ,  G06F3/0488

Abstract: A neural network system can select content based on user and item content embeddings in an approach that can be updated in real time on the user device without server support. Requests for content sent to the server can include an anonymous user embedding that includes data describing the user's inputs. The content that is nearest to the user embedding in a joint embedding space can be returned as suggested content.

公开(公告)号：US20210390411A1

公开(公告)日：2021-12-16

申请号：US17459161

申请日：2021-08-27

Applicant: Snap Inc.

Inventor： Vitor Rocha de Carvalho ,  Leonardo Ribas Machado das Neves ,  Seungwhan Moon

IPC: G06N3/08 ,  H04L12/58 ,  G06K9/66

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use an attention-based mechanism that emphasis or de-emphasizes each data type (e.g., image, word, character) in the multimodal message based on each datatypes relevance. The output of the attention mechanism can be used to update a recurrent network to identify one or more words in the caption as being a named entity.

公开(公告)号：US20210256213A1

公开(公告)日：2021-08-19

申请号：US17306010

申请日：2021-05-03

Applicant: Snap Inc.

Inventor： Di Lu ,  Leonardo Ribas Machado das Neves ,  Vitor Rocha de Carvalho ,  Ning Zhang

IPC: G06F40/295 ,  G06F40/30 ,  G06N3/08 ,  G06N20/00

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.

公开(公告)号：US12056454B2

公开(公告)日：2024-08-06

申请号：US18201075

申请日：2023-05-23

Applicant: Snap Inc.

Inventor： Di Lu ,  Leonardo Ribas Machado das Neves ,  Vitor Rocha de Carvalho ,  Ning Zhang

IPC: G06F40/295 ,  G06F40/30 ,  G06N3/08 ,  G06N20/00

CPC classification number: G06F40/295 ,  G06F40/30 ,  G06N3/08 ,  G06N20/00

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.

公开(公告)号：US11948558B2

公开(公告)日：2024-04-02

申请号：US17938470

申请日：2022-10-06

Applicant: Snap Inc.

Inventor： Leonardo Ribas Machado das Neves ,  Vítor Silva Sousa ,  Shubham Vij

IPC: G10L15/18 ,  G10L15/197 ,  H04L51/10

CPC classification number: G10L15/1822 ,  G10L15/197 ,  H04L51/10

Abstract: A messaging system performs trend analysis on content produced by users of the messaging system. The messaging system is configured to extract modifications from content items received from client devices associated with users where the content items are modified using the modifications that comprises a text caption or a media overlay. The messaging system is further configured to determine one or more words from the content items and the extracted modifications and determine a frequency of the one or more words in the content items and the extracted modifications. The messaging system is further configured to determine whether the one or more words is a trend based on the frequency and an aggregate frequency. The messaging system is further configured to in response to the one or more words being determined as the trend, generating trend content associated with the one or more words, the trend content being a text, an image, or an augmentation content.