公开(公告)号：US20250150414A1

公开(公告)日：2025-05-08

申请号：US18388153

申请日：2023-11-08

Applicant: Snap Inc.

Inventor： Aliaksei Mikhailiuk ,  Sergey Smetanin ,  Pavel Savchenkov ,  Hee Hun Kim ,  Tianxiang Gao ,  Neha Yadav ,  Bingqian Lu ,  Emily Ann Claudet

IPC: H04L51/02 ,  G06F40/30 ,  G06V30/148 ,  H04L51/063

Abstract: A computer-implemented method and system for responding to user posts containing images with relevant image responses during conversation between a user and a chatbot. The system receives an image post from the user and generates a description of the image using an image-to-text model. User intent is determined based on the image and description. If responding with an image is appropriate based on the user intent, the system generates a prompt using the image description and passes it to a text generation model to create an image description and caption. The image description and caption are used to synthesize a new image. The resulting image and caption are packaged into a post that is provided as a response to the user. The system uses machine learning pipelines and models to analyze images, detect inappropriate content, classify user intent, generate text, and synthesize images.

公开(公告)号：US20240414108A1

公开(公告)日：2024-12-12

申请号：US18677723

申请日：2024-05-29

Applicant: Snap Inc.

Inventor： Haowen Sun ,  William Spencer Mulligan ,  Nathan Kenneth Boyd ,  Hee Hun Kim ,  Dmytro Ishchenko ,  Lily Hinkeldey ,  Jason Brewer ,  Charles Melbye ,  Aleksandr Mashrabov

IPC: H04L51/02 ,  G06F16/34 ,  H04L51/216

Abstract: A chatbot system for an interactive platform is disclosed. The chatbot system retrieves a conversation history of one or more conversations between a user and a chatbot from a conversation history datastore and generates one or more summarized memories using the conversation history. One or more moderated memories are generated using the summarized memories. The moderated memories are stored in a memories datastore. A user prompt is received, and a current conversation context is generated from a current conversation between the user and the chatbot. One or more memories are retrieved from the memories datastore using the current conversation context. An augmented prompt is generated using the user prompt and the one or more memories, which is communicated to a generative AI model. A response is received from the generative AI model to the augmented prompt, which is provided to the user.