-
公开(公告)号:US20230169329A1
公开(公告)日:2023-06-01
申请号:US17540107
申请日:2021-12-01
Applicant: NVIDIA Corporation
Inventor: Fabio Tozeto Ramos , Rika Antonova , Ankur Handa , Dieter Fox
IPC: G06N3/08
CPC classification number: G06N3/08
Abstract: Systems and methods related to incorporating uncertain inputs into a neural network are described herein. A distribution is obtained and processed by a Reproducing Kernel Hilbert Space (RKHS) module to generate an embedding that represents the distribution. The features of the embedding may correspond to a number of Random Fourier Features (RFFs). The embedding can be added to additional features to form an aggregate input for the neural network. The neural network then processes the aggregate input to generate an output based on, at least in part, the embedding of the distribution. In some embodiments, a simulation can be run to generate a distribution for a feature, where each simulator instance generates a different sample for the feature over a plurality of time steps of the simulation. In some embodiments, the output neural network can be used to control robotic systems, vehicles, or other systems.
-
公开(公告)号:US20230073154A1
公开(公告)日:2023-03-09
申请号:US17930349
申请日:2022-09-07
Applicant: NVIDIA Corporation
Inventor: Christopher Jason Paxton , Weiyu Liu , Tucker Ryer Hermans , Dieter Fox
Abstract: A robotic system is provided for performing rearrangement tasks guided by a natural language instruction. The system can include a number of neural networks used to determine a selected rearrangement of the objects in accordance with the natural language instruction. A target object predictor network processes a point cloud of the scene and the natural language instruction to identify a set of query objects that are to-be-rearranged. A language conditioned prior network processes the point cloud, natural language instruction, and the set of query objects to sample a distribution of rearrangements to generate a number of sets of pose offsets for the set of query objects. A discriminator network then processes the samples to generate scores for the samples. The samples may be refined until a score for at least one of the sample generated by the discriminator network is above a threshold value.
-
公开(公告)号:US20220292699A1
公开(公告)日:2022-09-15
申请号:US17195296
申请日:2021-03-08
Applicant: NVIDIA Corporation
Inventor: Luyang Zhu , Arsalan Mousavian , Yu Xiang , Dieter Fox
Abstract: Apparatuses, systems, and techniques to estimate or predict depth information for image data. In at least one embodiment, depth information is predicted based at least in part on color information and geometry information associated with an image.
-
公开(公告)号:US20210334630A1
公开(公告)日:2021-10-28
申请号:US16860486
申请日:2020-04-28
Applicant: NVIDIA Corporation
Inventor: Alexander Conrad Lambert , Adam Harper Fishman , Dieter Fox , Byron Boots , Fabio Tozeto Ramos
Abstract: Apparatuses, systems, and techniques to infer a sequence of actions to perform using one or more neural networks trained, at least in part, by optimizing a probability distribution function using a cost function, wherein the probability distribution represents different sequences of actions that can be performed. In at least one embodiment, a model predictive control problem is formulated as a Bayesian inference task to infer a set of solutions.
-
公开(公告)号:US20200306960A1
公开(公告)日:2020-10-01
申请号:US16372274
申请日:2019-04-01
Applicant: NVIDIA Corporation
Inventor: Ankur Handa , Viktor Makoviichuk , Miles Macklin , Nathan Ratliff , Dieter Fox , Yevgen Chebotar , Jan Issac
Abstract: A machine-learning control system is trained to perform a task using a simulation. The simulation is governed by parameters that, in various embodiments, are not precisely known. In an embodiment, the parameters are specified with an initial value and expected range. After training on the simulation, the machine-learning control system attempts to perform the task in the real world. In an embodiment, the results of the attempt are compared to the expected results of the simulation, and the parameters that govern the simulation are adjusted so that the simulated result matches the real-world attempt. In an embodiment, the machine-learning control system is retrained on the updated simulation. In an embodiment, as additional real-world attempts are made, the simulation parameters are refined and the control system is retrained until the simulation is accurate and the control system is able to successfully perform the task in the real world.
-
公开(公告)号:US12275146B2
公开(公告)日:2025-04-15
申请号:US16372274
申请日:2019-04-01
Applicant: NVIDIA Corporation
Inventor: Ankur Handa , Viktor Makoviichuk , Miles Macklin , Nathan Ratliff , Dieter Fox , Yevgen Chebotar , Jan Issac
Abstract: A machine-learning control system is trained to perform a task using a simulation. The simulation is governed by parameters that, in various embodiments, are not precisely known. In an embodiment, the parameters are specified with an initial value and expected range. After training on the simulation, the machine-learning control system attempts to perform the task in the real world. In an embodiment, the results of the attempt are compared to the expected results of the simulation, and the parameters that govern the simulation are adjusted so that the simulated result matches the real-world attempt. In an embodiment, the machine-learning control system is retrained on the updated simulation. In an embodiment, as additional real-world attempts are made, the simulation parameters are refined and the control system is retrained until the simulation is accurate and the control system is able to successfully perform the task in the real world.
-
公开(公告)号:US20240157557A1
公开(公告)日:2024-05-16
申请号:US18125503
申请日:2023-03-23
Applicant: NVIDIA Corporation
Inventor: Sammy Joe Christen , Wei Yang , Claudia Perez D'Arpino , Dieter Fox , Yu-Wei Chao
IPC: B25J9/16 , G05B19/4155 , G06N3/08
CPC classification number: B25J9/1666 , B25J9/161 , B25J9/1612 , B25J9/163 , B25J9/1697 , G05B19/4155 , G06N3/08 , G05B2219/40202
Abstract: Apparatuses, systems, and techniques to control a real-world and/or virtual device (e.g., a robot). In at least one embodiment, the device is controlled based, at least in part on, for example, one or more neural networks. Parameter values for the neural network(s) may be obtained by training the neural network(s) to control movement of a first agent with respect to at least one first target while avoiding collision with at least one stationary first holder of the at least one first target, and updating the parameter values by training the neural network(s) to control movement of a second agent with respect to at least one second target while avoiding collision with at least one non-stationary second holder of the at least one second target.
-
公开(公告)号:US20240149447A1
公开(公告)日:2024-05-09
申请号:US18243467
申请日:2023-09-07
Applicant: NVIDIA Corporation
Inventor: Albert Wu , Clemens Eppner , Dieter Fox
IPC: B25J9/16
CPC classification number: B25J9/1664 , B25J9/161 , B25J9/163 , B25J9/1653 , B25J9/1671 , B25J9/1697
Abstract: Apparatuses, systems, and techniques to generate a motion plan. In at least one embodiment, a motion plan is generated using a neural network based, at least in part, on a demonstration of a task.
-
公开(公告)号:US20240095077A1
公开(公告)日:2024-03-21
申请号:US18122594
申请日:2023-03-16
Applicant: NVIDIA Corporation
Inventor: Ishika Singh , Arsalan Mousavian , Ankit Goyal , Danfei Xu , Jonathan Tremblay , Dieter Fox , Animesh Garg , Valts Blukis
CPC classification number: G06F9/5027 , G06N20/00
Abstract: Apparatuses, systems, and techniques to generate a prompt for one or more machine learning processes. In at least one embodiment, the machine learning process(es) generate(s) a plan to perform a task (identified in the prompt) that is to be performed by an agent (real world or virtual).
-
公开(公告)号:US20240037367A1
公开(公告)日:2024-02-01
申请号:US18133986
申请日:2023-04-12
Applicant: NVIDIA Corporation
Inventor: Alexander Conrad Lambert , Adam Harper Fishman , Dieter Fox , Byron Boots , Fabio Tozeto Ramos
CPC classification number: G06N3/006 , G05D1/0088 , G06F17/18 , G06N3/063 , G06N5/04 , G06F18/214 , G06N3/047
Abstract: Apparatuses, systems, and techniques to infer a sequence of actions to perform using one or more neural networks trained, at least in part, by optimizing a probability distribution function using a cost function, wherein the probability distribution represents different sequences of actions that can be performed. In at least one embodiment, a model predictive control problem is formulated as a Bayesian inference task to infer a set of solutions.
-
-
-
-
-
-
-
-
-