公开(公告)号：US20240355081A1

公开(公告)日：2024-10-24

申请号：US18760288

申请日：2024-07-01

申请人： Apple Inc.

发明人： Bryce L. Schmidtchen ,  Bryan Cline ,  Charles O. Goddard ,  Michael I. Weinstein ,  Tsao-Wei Huang ,  Tobias Rick ,  Vedant Saran ,  Alexander Menzies ,  Alexandre Da Veiga

IPC分类号： G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/00

CPC分类号： G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/006 ,  G06T2219/2004

摘要： Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

公开(公告)号：US20240346770A1

公开(公告)日：2024-10-17

申请号：US18742054

申请日：2024-06-13

申请人： Meta Platforms Technologies, LLC

发明人： Jason Saragih ,  Shih-En Wei ,  Tomas Simon Kreuz ,  Kris Makoto Kitani ,  Ye Yuan

IPC分类号： G06T19/00 ,  G06T15/10 ,  G06V40/10 ,  G06V40/20

CPC分类号： G06T19/00 ,  G06T15/10 ,  G06V40/103 ,  G06V40/23

摘要： A method for simulating a solid body animation of a subject includes retrieving a first frame that includes a body image of a subject. The method also includes selecting, from the first frame, multiple key points within the body image of the subject that define a hull of a body part and multiple joint points that define a joint between two body parts, identifying a geometry, a speed, and a mass of the body part to include in a dynamic model of the subject, based on the key points and the joint points, determining, based on the dynamic model of the subject, a pose of the subject in a second frame after the first frame in a video stream, and providing the video stream to an immersive reality application running on a client device.

公开(公告)号：US12112394B2

公开(公告)日：2024-10-08

申请号：US16780745

申请日：2020-02-03

申请人： Sony Interactive Entertainment Inc.

发明人： Mark E. Cerny ,  Florian Strauss ,  Tobias Berghoff

IPC分类号： G06T1/20 ,  G06F9/38 ,  G06F9/46 ,  G06F9/50 ,  G06T15/00 ,  G06T15/10 ,  G06T17/10

CPC分类号： G06T1/20 ,  G06F9/3877 ,  G06F9/461 ,  G06F9/5061 ,  G06T15/005 ,  G06T15/10 ,  G06T17/10

摘要： A method including rendering graphics for an application using graphics processing units (GPUs). Responsibility for rendering of geometry is divided between GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known. A plurality of pieces of geometry of an image frame is assigned to the GPUs for geometry testing. A first GPU state configuring one or more shaders to perform the geometry testing is set. Geometry testing is performed at GPUs on the plurality of pieces of geometry to generate information regarding each piece of geometry and its relation to each of the plurality of screen regions. A second GPU state configuring the one or more shaders to perform rendering is set. The information generated for each of the plurality of pieces of geometry is used when rendering the plurality of pieces of geometry at the GPUs.

公开(公告)号：US20240312166A1

公开(公告)日：2024-09-19

申请号：US18400889

申请日：2023-12-29

申请人： SAMSUNG ELECTRONICS CO., LTD.

发明人： Isaac Hisanao KASAHARA ,  Shubham AGRAWAL ,  Kazim Selim ENGIN ,  Nikhil Narsingh CHAVAN DAFLE ,  Shuran SONG ,  Ibrahim Volkan ISLER

IPC分类号： G06T19/20 ,  G05D1/622 ,  G06T5/77 ,  G06T7/13 ,  G06T15/10 ,  G06T15/40 ,  G06T17/20

CPC分类号： G06T19/20 ,  G05D1/622 ,  G06T5/77 ,  G06T7/13 ,  G06T15/10 ,  G06T15/40 ,  G06T17/20 ,  G05D2101/15 ,  G05D2105/10 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2210/56 ,  G06T2219/004 ,  G06T2219/2012 ,  G06T2219/2016

摘要： Methods and devices for processing image data for scene completion, including receiving an original image from an original viewpoint corresponding to a first direction, wherein the original image includes an object; obtaining a first image from a new viewpoint corresponding to a second direction different from the first direction by rotating the original image based on 3-dimensional (3D) information generated from 2-dimensional (2D) information which is obtained from the original image; determining an area within the first image for generating a second surface of the object based on depth information about a depth between the object and the background of the original image, wherein the determined area is expected to include an object area; and obtaining a second image by inputting the first image and the determined area to an artificial intelligence (AI) inpainting model, wherein the AI inpainting model generates the second surface of the object which occupies a portion of the determined area in the second image.

公开(公告)号：US12079922B2

公开(公告)日：2024-09-03

申请号：US18152068

申请日：2023-01-09

申请人： XEROX CORPORATION

发明人： Gregory M. Youngblood ,  Matthew Shreve ,  Mark J. Stefik ,  Robert Thomas Krivacic ,  Lester D. Nelson ,  Jacob Le

IPC分类号： G06T15/10 ,  G06T15/04 ,  G06T15/80

CPC分类号： G06T15/10 ,  G06T15/04 ,  G06T15/80

摘要： A system and method for translating a 2D image to a 3D image is provided. A 2D image having pixels grouped into tiles is obtained. Contour lines associated with an altitude value are located on the 2D image. The altitude values are determined. Each tile in the 2D image is represented using at least one voxel. A height map of the voxels is generated based on the contour lines and altitude values as a base layer for a 3D image. A terrain type of each of the voxels of the 3D image is determined and objects are placed in the 3D image. The 3D image is output.

公开(公告)号：US12067681B2

公开(公告)日：2024-08-20

申请号：US18208805

申请日：2023-06-12

申请人： Imagination Technologies Limited

发明人： John W. Howson

IPC分类号： G06T17/20 ,  G06F9/38 ,  G06T1/20 ,  G06T15/10

CPC分类号： G06T17/20 ,  G06F9/3885 ,  G06T1/20 ,  G06T15/10

摘要： Methods and tessellation modules for tessellating a patch to generate tessellated geometry data representing the tessellated patch. Received geometry data representing a patch is processed to identify tessellation factors of the patch. Based on the identified tessellation factors of the patch, tessellation instances to be used in tessellating the patch are determined. The tessellation instances are allocated amongst a plurality of tessellation pipelines that operate in parallel, wherein a respective set of one or more of the tessellation instances is allocated to each of the tessellation pipelines, and wherein each of the tessellation pipelines generates tessellated geometry data associated with the respective allocated set of one or more of the tessellation instances.

公开(公告)号：US20240273810A1

公开(公告)日：2024-08-15

申请号：US18430113

申请日：2024-02-01

申请人： NVIDIA Corporation

发明人： Ankit Goyal ,  Jie Xu ,  Yijie Guo ,  Valts Blukis ,  Yu-Wei Chao ,  Dieter Fox

IPC分类号： G06T15/10 ,  G05D1/243 ,  G05D101/15 ,  G06T7/55

CPC分类号： G06T15/10 ,  G05D1/2435 ,  G06T7/55 ,  G05D2101/15 ,  G06T2207/20084

摘要： In various examples, a machine may generate, using sensor data capturing one or more views of an environment, a virtual environment including a 3D representation of the environment. The machine may render, using one or more virtual sensors in the virtual environment, one or more images of the 3D representation of the environment. The machine may apply the one or more images to one or more machine learning models (MLMs) trained to generate one or more predictions corresponding to the environment. The machine may perform one or more control operations based at least on the one or more predictions generated using the one or more MLMs.

公开(公告)号：US20240257445A1

公开(公告)日：2024-08-01

申请号：US18633446

申请日：2024-04-11

申请人： Fyusion, Inc.

发明人： Stefan Johannes Josef HOLZER ,  Abhishek KAR ,  Matteo MUNARO ,  Pavel HANCHAR ,  Radu Bogdan RUSU ,  Santi ARANO

IPC分类号： G06T15/20 ,  G01C21/32 ,  G06F9/451 ,  G06F16/29 ,  G06F17/18 ,  G06F30/15 ,  G06N3/02 ,  G06Q30/02 ,  G06T7/00 ,  G06T7/593 ,  G06T7/70 ,  G06T15/10 ,  G06T17/00 ,  G06T19/00 ,  H04N13/00 ,  H04N13/243 ,  H04N13/271 ,  H04N23/63

CPC分类号： G06T15/205 ,  G01C21/32 ,  G06F9/453 ,  G06F16/29 ,  G06F17/18 ,  G06F30/15 ,  G06N3/02 ,  G06Q30/0278 ,  G06T7/0002 ,  G06T7/0004 ,  G06T7/593 ,  G06T7/70 ,  G06T15/10 ,  G06T17/00 ,  G06T19/003 ,  G06T19/006 ,  H04N13/243 ,  H04N13/271 ,  H04N23/633 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/20076 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20224 ,  G06T2207/30108 ,  G06T2207/30244 ,  G06T2207/30248 ,  H04N2013/0081

摘要： A plurality of images may be analyzed to determine an object model. The object model may have a plurality of components, and each of the images may correspond with one or more of the components. Component condition information may be determined for one or more of the components based on the images. The component condition information may indicate damage incurred by the object portion corresponding with the component.

公开(公告)号：US20240242419A1

公开(公告)日：2024-07-18

申请号：US18606547

申请日：2024-03-15

申请人： Hyperforge Holdings Pte Ltd.

发明人： Michael GALLO

IPC分类号： G06T15/04 ,  G06T15/10 ,  G06T17/00 ,  G06T19/20

CPC分类号： G06T15/04 ,  G06T15/10 ,  G06T17/00 ,  G06T19/20 ,  G06T2219/2021

摘要： A method is provided for generating a volumetric texture for a 3D model of a physical object.

公开(公告)号：US12026957B2

公开(公告)日：2024-07-02

申请号：US17556861

申请日：2021-12-20

申请人： GM Cruise Holdings LLC

发明人： Hariprasad Govardhanam ,  Matthew Koehler ,  Chen Shen

IPC分类号： G06V20/58 ,  B60W60/00 ,  G06T3/4046 ,  G06T15/10

CPC分类号： G06V20/58 ,  B60W60/001 ,  G06T3/4046 ,  G06T15/10 ,  B60W2420/403 ,  B60W2420/408

摘要： The disclosed technology provides solutions for generating synthetic objects and in particular, for generating three-dimensional objects using known geometries that can be queried from a database using feature vector information. A process of the disclosed technology can include steps for receiving sensor data including a detected object, wherein the sensor data represents one or more three-dimensional (3D) attributes of the detected object, processing the sensor data to identify at least one intrinsic attribute associated with the detected object, and querying an object database, based on the at least one intrinsic attribute, to identify a stored object that is similar to the detected object. In some aspects, the process can further include steps for modifying one or more attributes of the stored object based on the one or more 3D attributes of the detected object to generate a synthetic object. Systems and machine-readable media are also provided.