-
公开(公告)号：US12148089B2
公开(公告)日：2024-11-19
申请号：US17889168
申请日：2022-08-16
Applicant: Adobe Inc.
Inventor： Ankit Phogat , Xin Sun , Vineet Batra , Sumit Dhingra , Nathan A. Carr , Milos Hasan
Abstract: Embodiments are disclosed for performing 3-D vectorization. The method includes obtaining a three-dimensional rendered image and a camera position. The method further includes obtaining a triangle mesh representing the three-dimensional rendered image. The method further involves creating a reduced triangle mesh by removing one or more triangles from the triangle mesh. The method further involves subdividing each triangle of the reduced triangle mesh into one or more subdivided triangles. The method further involves performing a mapping of each pixel of the three-dimensional rendered image to the reduced triangle mesh. The method further involves assigning a color value to each vertex of the reduced triangle mesh. The method further involves sorting each triangle of the reduced triangle mesh using a depth value of each triangle. The method further involves generating a two-dimensional triangle mesh using the sorted triangles of the reduced triangle mesh.
-
公开(公告)号：US11657562B2
公开(公告)日：2023-05-23
申请号：US17233910
申请日：2021-04-19
Applicant: Adobe Inc.
Inventor： Xin Sun , Milos Hasan , Nathan Carr
CPC classification number: G06T15/06 , G06T1/20 , G06T7/507 , G06T7/536 , G06T15/005
Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize hemispherical clamping for importance sampling of an image-based light (IBL) to generate a digital image of a virtual environment. For example, the disclosed systems identify a hemispherical portion of an IBL image that corresponds to a reflective surface location on a virtual object. The disclosed systems can then clamp the IBL image using one or more importance sampling algorithms to exclude portions of the IBL image outside of the hemispherical portion that do not contribute direct lighting onto the reflective surface location. The disclosed systems can further utilize the one or more importance sampling algorithms to efficiently sample a ray direction between the reflective surface location and the hemispherical portion of the IBL image. In certain embodiments, the disclosed systems use the sampled ray direction to generate a digital image rendering portraying the virtual object.
-
公开(公告)号：US20220284640A1
公开(公告)日：2022-09-08
申请号：US17664800
申请日：2022-05-24
Applicant: Adobe Inc.
Inventor： Xin Sun , Ruben Villegas , Manuel Lagunas Arto , Jimei Yang , Jianming Zhang
Abstract: Introduced here are techniques for relighting an image by automatically segmenting a human object in an image. The segmented image is input to an encoder that transforms it into a feature space. The feature space is concatenated with coefficients of a target illumination for the image and input to an albedo decoder and a light transport detector to predict an albedo map and a light transport matrix, respectively. In addition, the output of the encoder is concatenated with outputs of residual parts of each decoder and fed to a light coefficients block, which predicts coefficients of the illumination for the image. The light transport matrix and predicted illumination coefficients are multiplied to obtain a shading map that can sharpen details of the image. Scaling the resulting image by the albedo map to produce the relight image. The relight image can be refined to denoise the relight image.
-
公开(公告)号：US20210295571A1
公开(公告)日：2021-09-23
申请号：US16823092
申请日：2020-03-18
Applicant: Adobe Inc.
Inventor： Xin Sun , Ruben Villegas , Manuel Lagunas Arto , Jimei Yang , Jianming Zhang
Abstract: Introduced here are techniques for relighting an image by automatically segmenting a human object in an image. The segmented image is input to an encoder that transforms it into a feature space. The feature space is concatenated with coefficients of a target illumination for the image and input to an albedo decoder and a light transport detector to predict an albedo map and a light transport matrix, respectively. In addition, the output of the encoder is concatenated with outputs of residual parts of each decoder and fed to a light coefficients block, which predicts coefficients of the illumination for the image. The light transport matrix and predicted illumination coefficients are multiplied to obtain a shading map that can sharpen details of the image. Scaling the resulting image by the albedo map to produce the relight image. The relight image can be refined to denoise the relight image.
-
公开(公告)号：US20200312009A1
公开(公告)日：2020-10-01
申请号：US16368548
申请日：2019-03-28
Applicant: ADOBE INC.
Inventor： Xin Sun , Nathan Aaron Carr , Alexandr Kuznetsov
Abstract: Images are rendered from deeply learned raytracing parameters. Active learning, via a machine learning (ML) model (e.g., implemented by a deep neural network), is used to automatically determine, infer, and/or predict optimized, or at least somewhat optimized, values for parameters used in raytracing methods. Utilizing deep learning to determine optimized, or at least somewhat optimized, values for raytracing parameters is in contrast to conventional methods, which require users to rely of heuristics for parameter value setting. In various embodiments, one or more parameters regarding the termination and splitting of traced light paths in stochastic-based (e.g., Monte Carlo) raytracing are determined via active learning. In some embodiments, one or more parameters regarding the sampling rate of shadow rays are also determined.
-
Patent Agency Ranking
公开(公告)号：US10650599B2
公开(公告)日：2020-05-12
申请号：US16029205
申请日：2018-07-06
Applicant: Adobe Inc.
Inventor： Xin Sun , Nathan Carr , Hao Qin
Abstract: The present disclosure includes methods and systems for rendering digital images of a virtual environment utilizing full path space learning. In particular, one or more embodiments of the disclosed systems and methods estimate a global light transport function based on sampled paths within a virtual environment. Moreover, in one or more embodiments, the disclosed systems and methods utilize the global light transport function to sample additional paths. Accordingly, the disclosed systems and methods can iteratively update an estimated global light transport function and utilize the estimated global light transport function to focus path sampling on regions of a virtual environment most likely to impact rendering a digital image of the virtual environment from a particular camera perspective.
-
公开(公告)号：US20190355095A1
公开(公告)日：2019-11-21
申请号：US15980367
申请日：2018-05-15
Applicant: Adobe Inc.
Abstract: In some embodiments, a computing device uses a blue noise sampling operation to identify source pixels from an input image defining respective pixel sets. Each pixel set is associated with a respective weight matrix for a down-scaling operation. The blue noise sampling operation causes an overlap region between first and second pixel sets. The computing device assigns an overlap pixel in the overlap region to the first weight matrix based on the overlap pixel being closer to the first source pixel. The computing device modifies the second weight matrix to exclude the overlap pixel from a portion of the down-scaling operation involving the second weight matrix. The computing device performs the down-scaling operation on the input image by combining the first pixel set into a first target pixel with the first weight matrix and combining the second pixel set into a second target with the modified second weight matrix.
-
公开(公告)号：US10290146B2
公开(公告)日：2019-05-14
申请号：US15335069
申请日：2016-10-26
Applicant: ADOBE INC.
Inventor： Zhili Chen , Xin Sun , Nathan Carr
Abstract: Techniques disclosed herein display depth effects in digital artwork based on movement of a display. In one technique, a first rendering of the digital artwork is displayed on the display. While the first rendering is displayed, a movement of the display is determined based on motion information from a motion sensor associated with the display. Based on the movement of the display, a position of the digital artwork is determined relative to a fixed gaze direction and a fixed light direction in a 3 dimensional (3D) model. A second rendering of the digital artwork is displayed on the display on the artwork. Displaying the second rendering involves displaying a depth effect based on variable depth of the digital artwork and the position of the digital artwork relative to the fixed gaze direction and the fixed light direction in the 3D model.
-
公开(公告)号：US20250139883A1
公开(公告)日：2025-05-01
申请号：US18499673
申请日：2023-11-01
Applicant: ADOBE INC.
Inventor： Milos Hasan , Iliyan Georgiev , Sai Bi , Julien Philip , Kalyan K. Sunkavalli , Xin Sun , Fujun Luan , Kevin James Blackburn-Matzen , Zexiang Xu , Kai Zhang
IPC: G06T17/00 , G06T7/90 , H04N13/279
Abstract: Embodiments are configured to render 3D models using an importance sampling method. First, embodiments obtain a 3D model including a plurality of density values corresponding to a plurality of locations in a 3D space, respectively. Embodiments then sample the color information from within a random subset of the plurality of locations using a probability distribution based on the plurality of density values. Embodiments have a higher probability to sample each location within the random subset of locations if the location has a higher density probability. Embodiments then an image depicting a view of the 3D model based on the sampling within the random subset of the plurality of locations.
-
公开(公告)号：US20240185503A1
公开(公告)日：2024-06-06
申请号：US18439182
申请日：2024-02-12
Applicant: Adobe Inc.
Inventor： Theo Thonat , Xin Sun , Tamy Boubekeur , Nathan Carr , Francois Beaune
Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.
-
-
-
-
-
-
-
-
-
Search Results
40
records
(took 0.022 seconds)
