公开(公告)号：US20240037964A1

公开(公告)日：2024-02-01

申请号：US18481770

申请日：2023-10-05

Applicant: NVIDIA Corporation

Inventor： Jason Conrad Roche ,  Niranjan Avadhanam

IPC: G06V20/59 ,  G06N20/00 ,  G06F3/01 ,  G06N3/02

CPC classification number: G06V20/597 ,  G06N20/00 ,  G06F3/013 ,  G06N3/02

Abstract: In various examples, systems and methods are disclosed herein for a vehicle command operation system that may use technology across multiple modalities to cause vehicular operations to be performed in response to determining a focal point based on a gaze of an occupant. The system may utilize sensors to receive first data indicative of an eye gaze of an occupant of the vehicle. The system may utilize sensors to receive second data indicative of other data from the occupant. The system may then calculate a gaze vector based on the data indicative of the eye gaze of the occupant. The system may determine a focal point based on the gaze vector. In response to determining the focal point, the system causes an operation to be performed in the vehicle based on the second data.

公开(公告)号：US12198450B2

公开(公告)日：2025-01-14

申请号：US18481770

申请日：2023-10-05

Applicant: NVIDIA Corporation

Inventor： Jason Conrad Roche ,  Niranjan Avadhanam

IPC: G06T7/00 ,  G06F3/01 ,  G06N3/02 ,  G06N20/00 ,  G06V20/59

Abstract: In various examples, systems and methods are disclosed herein for a vehicle command operation system that may use technology across multiple modalities to cause vehicular operations to be performed in response to determining a focal point based on a gaze of an occupant. The system may utilize sensors to receive first data indicative of an eye gaze of an occupant of the vehicle. The system may utilize sensors to receive second data indicative of other data from the occupant. The system may then calculate a gaze vector based on the data indicative of the eye gaze of the occupant. The system may determine a focal point based on the gaze vector. In response to determining the focal point, the system causes an operation to be performed in the vehicle based on the second data.

公开(公告)号：US11682272B2

公开(公告)日：2023-06-20

申请号：US16922601

申请日：2020-07-07

Applicant: NVIDIA Corporation

Inventor： Niranjan Avadhanam ,  Sumit Bhattacharya ,  Atousa Torabi ,  Jason Conrad Roche

IPC: G08B3/10 ,  G06N3/08 ,  G08G1/005

CPC classification number: G08B3/10 ,  G06N3/08 ,  G08G1/005

Abstract: Systems and methods are disclosed herein for a pedestrian crossing warning system that may use multi-modal technology to determine attributes of a person and provide a warning to the person in response to a calculated risk level to effect a reduction of the risk level. The system may utilize sensors to receive data indicative of a trajectory of a person external to the vehicle. Specific attributes of the person such as age or walking aids may be determined. Based on the trajectory data and the specific attributes, a risk level may be determined by the system using a machine learning model. The system may cause emission of a warning to the person in response to the risk level.

公开(公告)号：US11790669B2

公开(公告)日：2023-10-17

申请号：US16859741

申请日：2020-04-27

Applicant: NVIDIA Corporation

Inventor： Jason Conrad Roche ,  Niranjan Avadhanam

IPC: G06V40/20 ,  G06V20/59 ,  G06N20/00 ,  G06F3/01 ,  G06N3/02

CPC classification number: G06V20/597 ,  G06F3/013 ,  G06N3/02 ,  G06N20/00

Abstract: In various examples, systems and methods are disclosed herein for a vehicle command operation system that may use technology across multiple modalities to cause vehicular operations to be performed in response to determining a focal point based on a gaze of an occupant. The system may utilize sensors to receive first data indicative of an eye gaze of an occupant of the vehicle. The system may utilize sensors to receive second data indicative of other data from the occupant. The system may then calculate a gaze vector based on the data indicative of the eye gaze of the occupant. The system may determine a focal point based on the gaze vector. In response to determining the focal point, the system causes an operation to be performed in the vehicle based on the second data.

公开(公告)号：US11590929B2

公开(公告)日：2023-02-28

申请号：US16867395

申请日：2020-05-05

Applicant: NVIDIA Corporation

Inventor： Sumit Bhattacharya ,  Jason Conrad Roche ,  Niranjan Avadhanam

IPC: G06F21/32 ,  B60R25/01 ,  B60R25/25 ,  B60R25/30 ,  G05B13/02 ,  G06N3/08 ,  G10L17/00 ,  G10L17/06 ,  G10L17/18 ,  G06V10/25 ,  G06V20/59

Abstract: Systems and methods are disclosed herein for implementation of a vehicle command operation system that may use multi-modal technology to authenticate an occupant of the vehicle to authorize a command and receive natural language commands for vehicular operations. The system may utilize sensors to receive data indicative of a voice command from an occupant of the vehicle. The system may receive second sensor data to aid in the determination of the corresponding vehicular operation in response to the received command. The system may retrieve authentication data for the occupants of the vehicle. The system authenticates the occupant to authorize a vehicular operation command using a neural network based on at least one of the first sensor data, the second sensor data, and the authentication data. Responsive to the authentication, the system may authorize the operation to be performed in the vehicle based on the vehicular operation command.

公开(公告)号：US20250148810A1

公开(公告)日：2025-05-08

申请号：US19019008

申请日：2025-01-13

Applicant: NVIDIA Corporation

Inventor： Jason Conrad Roche ,  Niranjan Avadhanam

IPC: G06V20/59 ,  G06F3/01 ,  G06N3/02 ,  G06N20/00

Abstract: In various examples, systems and methods are disclosed herein for a vehicle command operation system that may use technology across multiple modalities to cause vehicular operations to be performed in response to determining a focal point based on a gaze of an occupant. The system may utilize sensors to receive first data indicative of an eye gaze of an occupant of the vehicle. The system may utilize sensors to receive second data indicative of other data from the occupant. The system may then calculate a gaze vector based on the data indicative of the eye gaze of the occupant. The system may determine a focal point based on the gaze vector. In response to determining the focal point, the system causes an operation to be performed in the vehicle based on the second data.

公开(公告)号：US20230095988A1

公开(公告)日：2023-03-30

申请号：US18062163

申请日：2022-12-06

Applicant: NVIDIA Corporation

Inventor： Sumit Bhattacharya ,  Jason Conrad Roche ,  Niranjan Avadhanam

IPC: B60R25/01 ,  B60R25/25 ,  B60R25/30 ,  G05B13/02 ,  G06F21/32 ,  G06N3/08 ,  G10L17/00 ,  G10L17/06 ,  G10L17/18 ,  G06V10/25 ,  G06V20/59

Abstract: Systems and methods are disclosed herein for implementation of a vehicle command operation system that may use multi-modal technology to authenticate an occupant of the vehicle to authorize a command and receive natural language commands for vehicular operations. The system may utilize sensors to receive data indicative of a voice command from an occupant of the vehicle. The system may receive second sensor data to aid in the determination of the corresponding vehicular operation in response to the received command. The system may retrieve authentication data for the occupants of the vehicle. The system authenticates the occupant to authorize a vehicular operation command using a neural network based on at least one of the first sensor data, the second sensor data, and the authentication data. Responsive to the authentication, the system may authorize the operation to be performed in the vehicle based on the vehicular operation command.

公开(公告)号：US20220012988A1

公开(公告)日：2022-01-13

申请号：US16922601

申请日：2020-07-07

Applicant: NVIDIA Corporation

Inventor： Niranjan Avadhanam ,  Sumit Bhattacharya ,  Atousa Torabi ,  Jason Conrad Roche

IPC: G08B3/10 ,  G08G1/005 ,  G06N3/08

Abstract: Systems and methods are disclosed herein for a pedestrian crossing warning system that may use multi-modal technology to determine attributes of a person and provide a warning to the person in response to a calculated risk level to effect a reduction of the risk level. The system may utilize sensors to receive data indicative of a trajectory of a person external to the vehicle. Specific attributes of the person such as age or walking aids may be determined. Based on the trajectory data and the specific attributes, a risk level may be determined by the system using a machine learning model. The system may cause emission of a warning to the person in response to the risk level.