公开(公告)号：US20230306678A1

公开(公告)日：2023-09-28

申请号：US17558881

申请日：2021-12-22

Applicant: NVIDIA Corporation

Inventor： Hang Su ,  Zitian Chen ,  Orazio Gallo

IPC: G06T15/10 ,  G06V10/82 ,  G06K9/62 ,  G06T7/70 ,  G06T1/20 ,  G06T7/20 ,  G06T7/60 ,  G06T15/06

CPC classification number: G06T15/10 ,  G06K9/6217 ,  G06T1/20 ,  G06T7/20 ,  G06T7/60 ,  G06T7/70 ,  G06T15/06 ,  G06V10/82

Abstract: A target image corresponding to a novel view may be synthesized from two source images, corresponding source camera poses, and pixel attribute correspondences between the two source images. A particular object in the target image need only be visible in one of the two source images for successful synthesis. Each pixel in the target image is defined according to an identified pixel in one of the two source images. The identified source pixel provides attributes such as color, texture, and feature descriptors for the target pixel. The source and target camera poses are used to define geometric relationships for identifying the source pixels. In an embodiment, the pixel attribute correspondences are optical flow that defines movement of attributes from a first image of the two source images to a second image of the two source images.

公开(公告)号：US11783532B1

公开(公告)日：2023-10-10

申请号：US17558881

申请日：2021-12-22

Applicant: NVIDIA Corporation

Inventor： Hang Su ,  Zitian Chen ,  Orazio Gallo

IPC: G06T15/10 ,  G06V10/82 ,  G06T15/06 ,  G06T1/20 ,  G06T7/20 ,  G06T7/60 ,  G06T7/70 ,  G06F18/21

CPC classification number: G06T15/10 ,  G06F18/21 ,  G06T1/20 ,  G06T7/20 ,  G06T7/60 ,  G06T7/70 ,  G06T15/06 ,  G06V10/82

Abstract: A target image corresponding to a novel view may be synthesized from two source images, corresponding source camera poses, and pixel attribute correspondences between the two source images. A particular object in the target image need only be visible in one of the two source images for successful synthesis. Each pixel in the target image is defined according to an identified pixel in one of the two source images. The identified source pixel provides attributes such as color, texture, and feature descriptors for the target pixel. The source and target camera poses are used to define geometric relationships for identifying the source pixels. In an embodiment, the pixel attribute correspondences are optical flow that defines movement of attributes from a first image of the two source images to a second image of the two source images.

公开(公告)号：US20250022290A1

公开(公告)日：2025-01-16

申请号：US18349853

申请日：2023-07-10

Applicant: NVIDIA Corporation

Inventor： Sakthivel SIVARAMAN ,  Arjun Guru ,  Rajath Shetty ,  Umar Iqbal ,  Orazio Gallo ,  Hang Su ,  Abhishek Badki ,  Varsha Hedau

IPC: G06V20/59 ,  G06T7/50 ,  G06T17/00

Abstract: In various examples, image-based three-dimensional occupant assessment for in-cabin monitoring systems and applications are provided. An evaluation function may determine a 3D representation of an occupant of a machine by evaluating sensor data comprising an image frame from an optical image sensor. The 3D representation may comprise at least one characteristic representative of a size of the occupant, (e.g., a 3D pose and/or 3D shape), which may be used to derive other characteristics such as, but not limited to weight, height, and/or age. A first processing path may generate a representation of one or more features corresponding to at least a portion of the occupant based on optical image data, and a second processing path may determine a depth corresponding to the one or more features based on depth data derived from the optical image data and ground truth depth data corresponding to the interior of the machine.