-
公开(公告)号:US20240303789A1
公开(公告)日:2024-09-12
申请号:US18389072
申请日:2023-11-13
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Ashkan MIRZAEI , Tristan TY AUMENTADO-ARMSTRONG , Konstantinos G. DERPANIS , Igor GILITSCHENSKI , Aleksai LEVINSHTEIN , Marcus BRUBAKER
Abstract: Provided is a method of training a neural radiance field and producing a rendering of a 3D scene from a novel viewpoint with view-dependent effects. The neural radiance field is initially trained using a first loss associated with a plurality of unmasked regions associated with a reference image and a plurality of target images. The training may also be updated using a second loss associated with a depth estimate of a masked region in the reference image. The training may also be further updated using a third loss associated with a view-substituted image associated with a respective target image. The view-substituted image is a volume rendering from the reference viewpoint across pixels with view-substituted target colors. In some embodiments, the neural radiance field is additionally trained with a fourth loss. The fourth loss is associated with dis-occluded pixels in a target image.
-
公开(公告)号:US20250078362A1
公开(公告)日:2025-03-06
申请号:US18816534
申请日:2024-08-27
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Ashkan MIRZAEI , Tristan Ty Aumentado-Armstrong , Marcus A. Brubaker , Igor Gilitschenski , Aleksai Levinshtein , Konstantinos G. Derpanis
Abstract: A method for editing a local area of a target image using a diffusion model, includes: receiving an input image; receiving a text instruction to edit the input image; generating a relevance map based on the diffusion model and the text instruction; generating a rendered image by performing a relevance guided image editing method on the input image, based on the generated relevance map; and providing, to the user, the generated rendered image.
-
3.
公开(公告)号:US20250069321A1
公开(公告)日:2025-02-27
申请号:US18800919
申请日:2024-08-12
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Tristan AUMENTADO-ARMSTRONG , Ashkan MIRZAEI , Aleksai LEVINSHTEIN , Marcus Anthony BRUBAKER , Konstantinos G. DERPANIS , Igor GILITSCHENSKI
Abstract: An electronic device includes: a camera; a memory; a processor to obtain a plurality of multiview color images of the object; obtain, from the latent field about the object, a plurality of multiview latent images and a plurality of camera parameters respectively corresponding to the plurality of multiview latent images; based on the plurality of multiview latent images and the plurality of camera parameters, render a first feature map about the object by using a latent field and an autoencoder; based on the first feature map about the object, train the improved NeRF by performing iterative operations; receive a request for a novel view of the object; generate, by using the improved NeRF, a second feature map from the novel view of the object; and generate, by a decoder of the autoencoder, an image about the novel view of the object based on the second feature map.
-
公开(公告)号:US20240153046A1
公开(公告)日:2024-05-09
申请号:US18228472
申请日:2023-07-31
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Ashkan MIRZAEI , Ttistan TY AUMENTADO-ARMSTRONG , Konstantinos G. DERPANIS , Marcus A. BRUBAKER , Igor GILITSCHENSKI , Aleksai LEVINSHTEIN
CPC classification number: G06T5/005 , G06T7/11 , G06V10/774 , G06V10/82 , G06V10/945 , G06V20/49 , G06T2200/04 , G06T2200/24 , G06T2207/10021 , G06T2207/10028 , G06T2207/20021 , G06T2207/20081 , G06T2207/20084 , G06T2207/20092
Abstract: A computer-implemented method of configuring an electronic device for inpainting source three-dimensional (3D) scenes, includes: receiving the source 3D scenes and a user's input about a first object of the source 3D scenes; generating accurate object masks about the first object of the source 3D scenes; and generating inpainted 3D scenes of the source 3D scenes by using an inpainting neural radiance field (NeRF) based on the accurate object masks.
-
-
-