Techniques for predicting whether a submission includes a forged image. A computer system receives a submission from a user that includes an image and image metadata, such as an identifier for the user and a User-Agent string value. An image pixel embedding is generated from the image, and a profile embedding is generated from the image metadata. The image embedding is indicative of whether the image is similar to known image forgeries. The profile embedding is generated from a user activity embedding indicative of User-Agent values associated with the user identifier. The profile embedding is generated using a machine learning model that uses stored parameters to associate user activity, device information, and forgery groups. The profile embedding thus indicates whether the user is associated with known image forgeries. The image pixel embedding and profile embedding are then used by a neural network to output a forgery prediction.