公开(公告)号：US20250150414A1

公开(公告)日：2025-05-08

申请号：US18388153

申请日：2023-11-08

Applicant: Snap Inc.

Inventor： Aliaksei Mikhailiuk ,  Sergey Smetanin ,  Pavel Savchenkov ,  Hee Hun Kim ,  Tianxiang Gao ,  Neha Yadav ,  Bingqian Lu ,  Emily Ann Claudet

IPC: H04L51/02 ,  G06F40/30 ,  G06V30/148 ,  H04L51/063

Abstract: A computer-implemented method and system for responding to user posts containing images with relevant image responses during conversation between a user and a chatbot. The system receives an image post from the user and generates a description of the image using an image-to-text model. User intent is determined based on the image and description. If responding with an image is appropriate based on the user intent, the system generates a prompt using the image description and passes it to a text generation model to create an image description and caption. The image description and caption are used to synthesize a new image. The resulting image and caption are packaged into a post that is provided as a response to the user. The system uses machine learning pipelines and models to analyze images, detect inappropriate content, classify user intent, generate text, and synthesize images.